API tools faq
paste
Advertisement
Guest User

mon-elections

a guest
May 4th, 2023
109
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 211.14 KB | None | 0 0
raw download clone embed print report
  1. # grep 2023-05-04T12:44: /var/log/ceph/ceph-mon.ceph-01.log
  2. 2023-05-04T12:44:00.153+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  3. 2023-05-04T12:44:00.153+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754287 update_from_paxos
  4. 2023-05-04T12:44:00.153+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754287 update_from_paxos version 41754287 summary v 41754287
  5. 2023-05-04T12:44:00.153+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  6. 2023-05-04T12:44:00.154+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  7. 2023-05-04T12:44:00.154+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  8. 2023-05-04T12:44:00.155+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065852
  9. 2023-05-04T12:44:00.156+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065852 service_map e3257846 0 progress events
  10. 2023-05-04T12:44:00.156+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  11. 2023-05-04T12:44:00.156+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  12. 2023-05-04T12:44:00.156+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065852
  13. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.65:0/63 via mon.3 v2:192.168.32.68:3300/0
  14. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  15. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-01' type 16
  16. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18866ef00 from v2:192.168.32.68:3300/0
  17. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315376 192.168.32.65:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-01(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315376, , 0) v10
  18. 2023-05-04T12:44:00.157+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  19. 2023-05-04T12:44:00.157+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  20. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315376
  21. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  22. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113] via mon.3 v2:192.168.32.68:3300/0
  23. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  24. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-15' type 2
  25. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1868918c0 from v2:192.168.32.68:3300/0
  26. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166321840/ceph-15 up:active seq=3086799 v892362) v8 from mds.6 [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113]
  27. 2023-05-04T12:44:00.157+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166321840/ceph-15 up:active seq=3086799 v892362) v8 from mds.6 [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  28. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166321840
  29. 2023-05-04T12:44:00.157+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166321840/ceph-15 up:active seq=3086799 v892362) v8 noting time
  30. 2023-05-04T12:44:00.157+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869740f0 0x55e18a13f080 mdsbeacon(166321840/ceph-15 up:active seq=3086799 v892362) v8
  31. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.69:0/63 via mon.4 v2:192.168.32.69:3300/0
  32. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  33. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-26' type 16
  34. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186fbd400 from v2:192.168.32.69:3300/0
  35. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204935384 192.168.32.69:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-26(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204935384, , 0) v10
  36. 2023-05-04T12:44:00.157+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  37. 2023-05-04T12:44:00.157+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  38. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 204935384
  39. 2023-05-04T12:44:00.157+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  40. 2023-05-04T12:44:00.171+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.94:6832/6313,v1:192.168.32.94:6833/6313] via mon.2 v2:192.168.32.67:3300/0
  41. 2023-05-04T12:44:00.171+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  42. 2023-05-04T12:44:00.171+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.1031' type 4
  43. 2023-05-04T12:44:00.171+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187f72fc0 from v2:192.168.32.67:3300/0
  44. 2023-05-04T12:44:00.171+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754287 preprocess_query log(1 entries from seq 23992 at 2023-05-04T12:43:59.939265+0200) v1 from osd.1031 v2:192.168.32.94:6832/6313
  45. 2023-05-04T12:44:00.171+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754287 preprocess_log log(1 entries from seq 23992 at 2023-05-04T12:43:59.939265+0200) v1 from osd.1031
  46. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  47. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 update_from_paxos
  48. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 update_from_paxos version 41754288 summary v 41754287
  49. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 update_from_paxos latest full 41754287
  50. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754288 update_from_paxos applying incremental log 41754288 2023-05-04T12:43:58.693772+0200 mgr.ceph-03 (mgr.204968658) 117205 : cluster [DBG] pgmap v123472: 25065 pgs: 3 active+clean+scrubbing, 25034 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 170 MiB/s rd, 387 MiB/s wr, 4.55k op/s
  51. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754288 update_from_paxos applying incremental log 41754288 2023-05-04T12:43:58.972622+0200 osd.1148 (osd.1148) 907 : cluster [DBG] 2.ec8 deep-scrub starts
  52. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 check_subs
  53. 2023-05-04T12:44:00.179+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  54. 2023-05-04T12:44:00.180+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  55. 2023-05-04T12:44:00.180+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  56. 2023-05-04T12:44:00.181+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065852
  57. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065852 service_map e3257846 0 progress events
  58. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  59. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  60. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 create_pending v 41754289
  61. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754288 _updated_log for osd.1148 v2:192.168.32.96:6800/2870807
  62. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186945ef0 0x55e186e25680 log(last 907) v1
  63. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754288 _updated_log for mgr.204968658 192.168.32.67:0/63
  64. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186f0fd10 0x55e187bba300 log(last 117205) v1
  65. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 preprocess_query log(1 entries from seq 23992 at 2023-05-04T12:43:59.939265+0200) v1 from osd.1031 v2:192.168.32.94:6832/6313
  66. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 preprocess_log log(1 entries from seq 23992 at 2023-05-04T12:43:59.939265+0200) v1 from osd.1031
  67. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 prepare_update log(1 entries from seq 23992 at 2023-05-04T12:43:59.939265+0200) v1 from osd.1031 v2:192.168.32.94:6832/6313
  68. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 prepare_log log(1 entries from seq 23992 at 2023-05-04T12:43:59.939265+0200) v1 from osd.1031
  69. 2023-05-04T12:44:00.182+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754288 logging 2023-05-04T12:43:59.939265+0200 osd.1031 (osd.1031) 23992 : cluster [DBG] 20.154 scrub starts
  70. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.73:7023/16577,v1:192.168.32.73:7025/16577] via mon.4 v2:192.168.32.69:3300/0
  71. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  72. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.951' type 4
  73. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1b17a21c0 from v2:192.168.32.69:3300/0
  74. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 preprocess_query log(1 entries from seq 12842 at 2023-05-04T12:43:59.832823+0200) v1 from osd.951 v2:192.168.32.73:7023/16577
  75. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 preprocess_log log(1 entries from seq 12842 at 2023-05-04T12:43:59.832823+0200) v1 from osd.951
  76. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 prepare_update log(1 entries from seq 12842 at 2023-05-04T12:43:59.832823+0200) v1 from osd.951 v2:192.168.32.73:7023/16577
  77. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 prepare_log log(1 entries from seq 12842 at 2023-05-04T12:43:59.832823+0200) v1 from osd.951
  78. 2023-05-04T12:44:00.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 logging 2023-05-04T12:43:59.832823+0200 osd.951 (osd.951) 12842 : cluster [DBG] 12.11 deep-scrub ok
  79. 2023-05-04T12:44:00.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579] via mon.4 v2:192.168.32.69:3300/0
  80. 2023-05-04T12:44:00.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  81. 2023-05-04T12:44:00.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-11' type 2
  82. 2023-05-04T12:44:00.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186a49600 from v2:192.168.32.69:3300/0
  83. 2023-05-04T12:44:00.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166183211/ceph-11 up:active seq=3084454 v892362) v8 from mds.2 [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579]
  84. 2023-05-04T12:44:00.830+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166183211/ceph-11 up:active seq=3084454 v892362) v8 from mds.2 [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  85. 2023-05-04T12:44:00.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166183211
  86. 2023-05-04T12:44:00.830+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166183211/ceph-11 up:active seq=3084454 v892362) v8 noting time
  87. 2023-05-04T12:44:00.830+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869eb0e0 0x55e18a084dc0 mdsbeacon(166183211/ceph-11 up:active seq=3084454 v892362) v8
  88. 2023-05-04T12:44:00.908+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  89. 2023-05-04T12:44:00.908+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  90. 2023-05-04T12:44:00.908+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  91. 2023-05-04T12:44:00.908+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e19dcb92c0 from v2:192.168.32.68:3300/0
  92. 2023-05-04T12:44:00.908+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request monmgrreport(gid 204968658, 0 checks, 0 progress events) v3
  93. 2023-05-04T12:44:00.908+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgrstat prepare_report 25065 pgs: 28 active+clean+scrubbing+deep, 25034 active+clean, 3 active+clean+scrubbing; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 170 MiB/s rd, 338 MiB/s wr, 4.10k op/s, 0 health checks, 0 progress events
  94. 2023-05-04T12:44:00.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125] via mon.4 v2:192.168.32.69:3300/0
  95. 2023-05-04T12:44:00.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  96. 2023-05-04T12:44:00.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-23' type 2
  97. 2023-05-04T12:44:00.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a084dc0 from v2:192.168.32.69:3300/0
  98. 2023-05-04T12:44:00.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(195341627/ceph-23 up:active seq=951816 v892362) v8 from mds.1 [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125]
  99. 2023-05-04T12:44:00.936+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(195341627/ceph-23 up:active seq=951816 v892362) v8 from mds.1 [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  100. 2023-05-04T12:44:00.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 195341627
  101. 2023-05-04T12:44:00.936+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(195341627/ceph-23 up:active seq=951816 v892362) v8 noting time
  102. 2023-05-04T12:44:00.936+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186c453b0 0x55e18a0822c0 mdsbeacon(195341627/ceph-23 up:active seq=951816 v892362) v8
  103. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.94:6832/6313,v1:192.168.32.94:6833/6313] via mon.2 v2:192.168.32.67:3300/0
  104. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  105. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.1031' type 4
  106. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186eb21c0 from v2:192.168.32.67:3300/0
  107. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 preprocess_query log(1 entries from seq 23993 at 2023-05-04T12:44:00.001772+0200) v1 from osd.1031 v2:192.168.32.94:6832/6313
  108. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 preprocess_log log(1 entries from seq 23993 at 2023-05-04T12:44:00.001772+0200) v1 from osd.1031
  109. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 prepare_update log(1 entries from seq 23993 at 2023-05-04T12:44:00.001772+0200) v1 from osd.1031 v2:192.168.32.94:6832/6313
  110. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 prepare_log log(1 entries from seq 23993 at 2023-05-04T12:44:00.001772+0200) v1 from osd.1031
  111. 2023-05-04T12:44:00.983+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 logging 2023-05-04T12:44:00.001772+0200 osd.1031 (osd.1031) 23993 : cluster [DBG] 20.154 scrub ok
  112. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.80:6950/18292,v1:192.168.32.80:6951/18292] via mon.3 v2:192.168.32.68:3300/0
  113. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  114. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.564' type 4
  115. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d41c00 from v2:192.168.32.68:3300/0
  116. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 preprocess_query log(1 entries from seq 7980 at 2023-05-04T12:44:00.001006+0200) v1 from osd.564 v2:192.168.32.80:6950/18292
  117. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 preprocess_log log(1 entries from seq 7980 at 2023-05-04T12:44:00.001006+0200) v1 from osd.564
  118. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 prepare_update log(1 entries from seq 7980 at 2023-05-04T12:44:00.001006+0200) v1 from osd.564 v2:192.168.32.80:6950/18292
  119. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 prepare_log log(1 entries from seq 7980 at 2023-05-04T12:44:00.001006+0200) v1 from osd.564
  120. 2023-05-04T12:44:00.992+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754288 logging 2023-05-04T12:44:00.001006+0200 osd.564 (osd.564) 7980 : cluster [DBG] 12.17f scrub ok
  121. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.68:0/63 via mon.3 v2:192.168.32.68:3300/0
  122. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  123. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-25' type 16
  124. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187924280 from v2:192.168.32.68:3300/0
  125. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207635505 192.168.32.68:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-25(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207635505, , 0) v10
  126. 2023-05-04T12:44:01.050+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  127. 2023-05-04T12:44:01.050+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  128. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207635505
  129. 2023-05-04T12:44:01.050+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  130. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.66:0/63 via mon.4 v2:192.168.32.69:3300/0
  131. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  132. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-02' type 16
  133. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1870c9b80 from v2:192.168.32.69:3300/0
  134. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315386 192.168.32.66:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-02(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315386, , 0) v10
  135. 2023-05-04T12:44:01.128+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  136. 2023-05-04T12:44:01.128+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  137. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315386
  138. 2023-05-04T12:44:01.128+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  139. 2023-05-04T12:44:01.179+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754288 encode_full log v 41754288
  140. 2023-05-04T12:44:01.179+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754288 encode_pending v41754289
  141. 2023-05-04T12:44:01.179+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).mgrstat 63065853
  142. 2023-05-04T12:44:01.179+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  143. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  144. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos
  145. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos version 41754289 summary v 41754288
  146. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos latest full 41754288
  147. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 update_from_paxos applying incremental log 41754289 2023-05-04T12:43:59.832823+0200 osd.951 (osd.951) 12842 : cluster [DBG] 12.11 deep-scrub ok
  148. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 update_from_paxos applying incremental log 41754289 2023-05-04T12:43:59.939265+0200 osd.1031 (osd.1031) 23992 : cluster [DBG] 20.154 scrub starts
  149. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 update_from_paxos applying incremental log 41754289 2023-05-04T12:44:00.001006+0200 osd.564 (osd.564) 7980 : cluster [DBG] 12.17f scrub ok
  150. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 update_from_paxos applying incremental log 41754289 2023-05-04T12:44:00.001772+0200 osd.1031 (osd.1031) 23993 : cluster [DBG] 20.154 scrub ok
  151. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 check_subs
  152. 2023-05-04T12:44:01.192+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  153. 2023-05-04T12:44:01.193+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  154. 2023-05-04T12:44:01.193+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  155. 2023-05-04T12:44:01.194+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065852
  156. 2023-05-04T12:44:01.194+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065852 service_map e3257846 0 progress events
  157. 2023-05-04T12:44:01.194+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  158. 2023-05-04T12:44:01.194+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  159. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 create_pending v 41754290
  160. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 _updated_log for osd.1031 v2:192.168.32.94:6832/6313
  161. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186a8e1e0 0x55e186c4a300 log(last 23992) v1
  162. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 _updated_log for osd.951 v2:192.168.32.73:7023/16577
  163. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ec1b30 0x55e186d67380 log(last 12842) v1
  164. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 _updated_log for osd.1031 v2:192.168.32.94:6832/6313
  165. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e18699f0e0 0x55e1869ac780 log(last 23993) v1
  166. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754289 _updated_log for osd.564 v2:192.168.32.80:6950/18292
  167. 2023-05-04T12:44:01.195+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ead770 0x55e186d43800 log(last 7980) v1
  168. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.72:7034/35312,v1:192.168.32.72:7035/35312] via mon.4 v2:192.168.32.69:3300/0
  169. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  170. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.88' type 4
  171. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e189f7d500 from v2:192.168.32.69:3300/0
  172. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 preprocess_query log(1 entries from seq 1943 at 2023-05-04T12:44:01.078818+0200) v1 from osd.88 v2:192.168.32.72:7034/35312
  173. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 preprocess_log log(1 entries from seq 1943 at 2023-05-04T12:44:01.078818+0200) v1 from osd.88
  174. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 prepare_update log(1 entries from seq 1943 at 2023-05-04T12:44:01.078818+0200) v1 from osd.88 v2:192.168.32.72:7034/35312
  175. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 prepare_log log(1 entries from seq 1943 at 2023-05-04T12:44:01.078818+0200) v1 from osd.88
  176. 2023-05-04T12:44:01.196+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 logging 2023-05-04T12:44:01.078818+0200 osd.88 (osd.88) 1943 : cluster [DBG] purged_snaps scrub starts
  177. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 e1452893: 1260 total, 1260 up, 1260 in
  178. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 1 mon.ceph-01@0(leader).osd e1452893 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 71303168 full_alloc: 205520896 kv_alloc: 738197504
  179. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 tick balancer inc cache_bytes: 118448 inc comtd_bytes: 71303168 inc used_bytes: 118448 inc num_osdmaps: 418
  180. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 tick balancer full cache_bytes: 135436211 full comtd_bytes: 205520896 full used_bytes: 135436211 full num_osdmaps: 233
  181. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 should_prune could only prune 39 epochs (1452354..1452393), which is less than the required minimum (10000)
  182. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 try_prune_purged_snaps max_prune 100
  183. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 try_prune_purged_snaps actually pruned 0
  184. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 min_last_epoch_clean 1452871
  185. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754289 log
  186. 2023-05-04T12:44:01.203+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).auth v48228 auth
  187. 2023-05-04T12:44:01.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health tick
  188. 2023-05-04T12:44:01.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health check_member_health avail 99% total 1.1 TiB, used 454 MiB, avail 1.1 TiB
  189. 2023-05-04T12:44:01.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health 3645677
  190. 2023-05-04T12:44:01.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  191. 2023-05-04T12:44:01.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).config tick
  192. 2023-05-04T12:44:01.219+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  193. 2023-05-04T12:44:01.219+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos
  194. 2023-05-04T12:44:01.219+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos version 41754289 summary v 41754289
  195. 2023-05-04T12:44:01.219+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  196. 2023-05-04T12:44:01.219+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  197. 2023-05-04T12:44:01.220+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  198. 2023-05-04T12:44:01.222+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065853
  199. 2023-05-04T12:44:01.222+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065853 service_map e3257846 0 progress events
  200. 2023-05-04T12:44:01.222+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  201. 2023-05-04T12:44:01.222+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  202. 2023-05-04T12:44:01.222+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065853
  203. 2023-05-04T12:44:01.234+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  204. 2023-05-04T12:44:01.234+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos
  205. 2023-05-04T12:44:01.234+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754289 update_from_paxos version 41754289 summary v 41754289
  206. 2023-05-04T12:44:01.234+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  207. 2023-05-04T12:44:01.235+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  208. 2023-05-04T12:44:01.235+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  209. 2023-05-04T12:44:01.236+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065853
  210. 2023-05-04T12:44:01.237+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065853 service_map e3257846 0 progress events
  211. 2023-05-04T12:44:01.237+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  212. 2023-05-04T12:44:01.237+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  213. 2023-05-04T12:44:01.237+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health 3645677
  214. 2023-05-04T12:44:01.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806] via mon.4 v2:192.168.32.69:3300/0
  215. 2023-05-04T12:44:01.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  216. 2023-05-04T12:44:01.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-13' type 2
  217. 2023-05-04T12:44:01.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a0822c0 from v2:192.168.32.69:3300/0
  218. 2023-05-04T12:44:01.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(164509948/ceph-13 up:standby seq=3067733 v888115) v8 from mds.? [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806]
  219. 2023-05-04T12:44:01.251+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(164509948/ceph-13 up:standby seq=3067733 v888115) v8 from mds.? [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  220. 2023-05-04T12:44:01.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 164509948
  221. 2023-05-04T12:44:01.251+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(164509948/ceph-13 up:standby seq=3067733 v888115) v8 noting time
  222. 2023-05-04T12:44:01.251+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869ea0f0 0x55e186a48840 mdsbeacon(164509948/ceph-13 up:standby seq=3067733 v888115) v8
  223. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.72:7034/35312,v1:192.168.32.72:7035/35312] via mon.4 v2:192.168.32.69:3300/0
  224. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  225. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.88' type 4
  226. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d67080 from v2:192.168.32.69:3300/0
  227. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452893 preprocess_query osd_beacon(pgs [19.bc7,14.62c,19.1fb8,14.177,19.1c25,19.386,19.1e70,19.1098,19.1df,19.7b6,19.f72] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:44:01.367942+0200 v1452893) v2 from osd.88 v2:192.168.32.72:7034/35312
  228. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to osd.88 v2:192.168.32.72:7034/35312 via v2:192.168.32.69:3300/0 for request osd_beacon(pgs [19.bc7,14.62c,19.1fb8,14.177,19.1c25,19.386,19.1e70,19.1098,19.1df,19.7b6,19.f72] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:44:01.367942+0200 v1452893) v2
  229. 2023-05-04T12:44:01.367+0200 7ff6b2722700 7 mon.ceph-01@0(leader).osd e1452893 prepare_update osd_beacon(pgs [19.bc7,14.62c,19.1fb8,14.177,19.1c25,19.386,19.1e70,19.1098,19.1df,19.7b6,19.f72] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:44:01.367942+0200 v1452893) v2 from osd.88 v2:192.168.32.72:7034/35312
  230. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452893 prepare_beacon osd_beacon(pgs [19.bc7,14.62c,19.1fb8,14.177,19.1c25,19.386,19.1e70,19.1098,19.1df,19.7b6,19.f72] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:44:01.367942+0200 v1452893) v2 from osd.88
  231. 2023-05-04T12:44:01.367+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452893 should_propose
  232. 2023-05-04T12:44:01.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765] via mon.4 v2:192.168.32.69:3300/0
  233. 2023-05-04T12:44:01.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  234. 2023-05-04T12:44:01.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-10' type 2
  235. 2023-05-04T12:44:01.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186a48840 from v2:192.168.32.69:3300/0
  236. 2023-05-04T12:44:01.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(206920672/ceph-10 up:standby seq=62641 v892263) v8 from mds.? [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765]
  237. 2023-05-04T12:44:01.388+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(206920672/ceph-10 up:standby seq=62641 v892263) v8 from mds.? [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  238. 2023-05-04T12:44:01.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 206920672
  239. 2023-05-04T12:44:01.388+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(206920672/ceph-10 up:standby seq=62641 v892263) v8 noting time
  240. 2023-05-04T12:44:01.388+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e185e68f00 0x55e186a48580 mdsbeacon(206920672/ceph-10 up:standby seq=62641 v892263) v8
  241. 2023-05-04T12:44:01.484+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  242. 2023-05-04T12:44:01.484+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  243. 2023-05-04T12:44:01.484+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  244. 2023-05-04T12:44:01.484+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1880c1400 from v2:192.168.32.68:3300/0
  245. 2023-05-04T12:44:01.484+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-03(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204968658, [v2:192.168.32.67:6800/63,v1:192.168.32.67:6801/63], 1) v10
  246. 2023-05-04T12:44:01.484+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  247. 2023-05-04T12:44:01.484+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  248. 2023-05-04T12:44:01.484+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  249. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  250. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  251. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  252. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e188f83340 from v2:192.168.32.68:3300/0
  253. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 preprocess_query log(1 entries from seq 117206 at 2023-05-04T12:44:00.906539+0200) v1 from mgr.204968658 192.168.32.67:0/63
  254. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 preprocess_log log(1 entries from seq 117206 at 2023-05-04T12:44:00.906539+0200) v1 from mgr.204968658
  255. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 prepare_update log(1 entries from seq 117206 at 2023-05-04T12:44:00.906539+0200) v1 from mgr.204968658 192.168.32.67:0/63
  256. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 prepare_log log(1 entries from seq 117206 at 2023-05-04T12:44:00.906539+0200) v1 from mgr.204968658
  257. 2023-05-04T12:44:01.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 logging 2023-05-04T12:44:00.906539+0200 mgr.ceph-03 (mgr.204968658) 117206 : cluster [DBG] pgmap v123473: 25065 pgs: 3 active+clean+scrubbing, 25034 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 170 MiB/s rd, 338 MiB/s wr, 4.10k op/s
  258. 2023-05-04T12:44:01.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521] via mon.2 v2:192.168.32.67:3300/0
  259. 2023-05-04T12:44:01.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  260. 2023-05-04T12:44:01.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-17' type 2
  261. 2023-05-04T12:44:01.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a056840 from v2:192.168.32.67:3300/0
  262. 2023-05-04T12:44:01.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(174654745/ceph-17 up:active seq=2485932 v892362) v8 from mds.0 [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521]
  263. 2023-05-04T12:44:01.686+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(174654745/ceph-17 up:active seq=2485932 v892362) v8 from mds.0 [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  264. 2023-05-04T12:44:01.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 174654745
  265. 2023-05-04T12:44:01.686+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(174654745/ceph-17 up:active seq=2485932 v892362) v8 noting time
  266. 2023-05-04T12:44:01.686+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e198aa03c0 0x55e1874482c0 mdsbeacon(174654745/ceph-17 up:active seq=2485932 v892362) v8
  267. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.65:0/63 via mon.3 v2:192.168.32.68:3300/0
  268. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  269. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-01' type 16
  270. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18698a000 from v2:192.168.32.68:3300/0
  271. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315376 192.168.32.65:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-01(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315376, , 0) v10
  272. 2023-05-04T12:44:01.846+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  273. 2023-05-04T12:44:01.846+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  274. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315376
  275. 2023-05-04T12:44:01.846+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  276. 2023-05-04T12:44:01.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914] via mon.3 v2:192.168.32.68:3300/0
  277. 2023-05-04T12:44:01.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  278. 2023-05-04T12:44:01.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-24' type 2
  279. 2023-05-04T12:44:01.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186915340 from v2:192.168.32.68:3300/0
  280. 2023-05-04T12:44:01.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(190565023/ceph-24 up:active seq=1272988 v892362) v8 from mds.7 [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914]
  281. 2023-05-04T12:44:01.979+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(190565023/ceph-24 up:active seq=1272988 v892362) v8 from mds.7 [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  282. 2023-05-04T12:44:01.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 190565023
  283. 2023-05-04T12:44:01.979+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(190565023/ceph-24 up:active seq=1272988 v892362) v8 noting time
  284. 2023-05-04T12:44:01.979+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186e611d0 0x55e18a13f600 mdsbeacon(190565023/ceph-24 up:active seq=1272988 v892362) v8
  285. 2023-05-04T12:44:02.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396] via mon.4 v2:192.168.32.69:3300/0
  286. 2023-05-04T12:44:02.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  287. 2023-05-04T12:44:02.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-14' type 2
  288. 2023-05-04T12:44:02.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186a48580 from v2:192.168.32.69:3300/0
  289. 2023-05-04T12:44:02.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(201810535/ceph-14 up:active seq=496708 v892362) v8 from mds.5 [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396]
  290. 2023-05-04T12:44:02.011+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(201810535/ceph-14 up:active seq=496708 v892362) v8 from mds.5 [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  291. 2023-05-04T12:44:02.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 201810535
  292. 2023-05-04T12:44:02.011+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(201810535/ceph-14 up:active seq=496708 v892362) v8 noting time
  293. 2023-05-04T12:44:02.011+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186c04ff0 0x55e18a085080 mdsbeacon(201810535/ceph-14 up:active seq=496708 v892362) v8
  294. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.69:0/63 via mon.4 v2:192.168.32.69:3300/0
  295. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  296. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-26' type 16
  297. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187276500 from v2:192.168.32.69:3300/0
  298. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204935384 192.168.32.69:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-26(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204935384, , 0) v10
  299. 2023-05-04T12:44:02.012+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  300. 2023-05-04T12:44:02.012+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  301. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 204935384
  302. 2023-05-04T12:44:02.012+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  303. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.72:7034/35312,v1:192.168.32.72:7035/35312] via mon.4 v2:192.168.32.69:3300/0
  304. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  305. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.88' type 4
  306. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187bb5500 from v2:192.168.32.69:3300/0
  307. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 preprocess_query log(1 entries from seq 1944 at 2023-05-04T12:44:01.367939+0200) v1 from osd.88 v2:192.168.32.72:7034/35312
  308. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 preprocess_log log(1 entries from seq 1944 at 2023-05-04T12:44:01.367939+0200) v1 from osd.88
  309. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 prepare_update log(1 entries from seq 1944 at 2023-05-04T12:44:01.367939+0200) v1 from osd.88 v2:192.168.32.72:7034/35312
  310. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 prepare_log log(1 entries from seq 1944 at 2023-05-04T12:44:01.367939+0200) v1 from osd.88
  311. 2023-05-04T12:44:02.183+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754289 logging 2023-05-04T12:44:01.367939+0200 osd.88 (osd.88) 1944 : cluster [DBG] purged_snaps scrub ok
  312. 2023-05-04T12:44:02.192+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754289 encode_full log v 41754289
  313. 2023-05-04T12:44:02.192+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754289 encode_pending v41754290
  314. 2023-05-04T12:44:02.203+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  315. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 update_from_paxos
  316. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 update_from_paxos version 41754290 summary v 41754289
  317. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 update_from_paxos latest full 41754289
  318. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754290 update_from_paxos applying incremental log 41754290 2023-05-04T12:44:00.906539+0200 mgr.ceph-03 (mgr.204968658) 117206 : cluster [DBG] pgmap v123473: 25065 pgs: 3 active+clean+scrubbing, 25034 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 170 MiB/s rd, 338 MiB/s wr, 4.10k op/s
  319. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754290 update_from_paxos applying incremental log 41754290 2023-05-04T12:44:01.078818+0200 osd.88 (osd.88) 1943 : cluster [DBG] purged_snaps scrub starts
  320. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754290 update_from_paxos applying incremental log 41754290 2023-05-04T12:44:01.367939+0200 osd.88 (osd.88) 1944 : cluster [DBG] purged_snaps scrub ok
  321. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 check_subs
  322. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  323. 2023-05-04T12:44:02.204+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  324. 2023-05-04T12:44:02.205+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  325. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065853
  326. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065853 service_map e3257846 0 progress events
  327. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  328. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  329. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 create_pending v 41754291
  330. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754290 _updated_log for osd.88 v2:192.168.32.72:7034/35312
  331. 2023-05-04T12:44:02.206+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1868af4a0 0x55e1855afc80 log(last 1943) v1
  332. 2023-05-04T12:44:02.207+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754290 _updated_log for mgr.204968658 192.168.32.67:0/63
  333. 2023-05-04T12:44:02.207+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e185e682d0 0x55e188563200 log(last 117206) v1
  334. 2023-05-04T12:44:02.207+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754290 _updated_log for osd.88 v2:192.168.32.72:7034/35312
  335. 2023-05-04T12:44:02.207+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186944f00 0x55e1869dd080 log(last 1944) v1
  336. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 encode_pending e 1452894
  337. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 1 mon.ceph-01@0(leader).osd e1452893 do_prune osdmap full prune enabled
  338. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 should_prune could only prune 39 epochs (1452354..1452393), which is less than the required minimum (10000)
  339. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 update_pending_pgs
  340. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 1
  341. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 2
  342. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 3
  343. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 7
  344. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 8
  345. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 11
  346. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 12
  347. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 13
  348. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 14
  349. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 17
  350. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 18
  351. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 19
  352. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 20
  353. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 scan_for_creating_pgs already created 21
  354. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 update_pending_pgs 0 pools queued
  355. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 update_pending_pgs 0 pgs removed because they're created
  356. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 update_pending_pgs queue remaining: 0 pools
  357. 2023-05-04T12:44:02.234+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 update_pending_pgs 0/0 pgs added from queued pools
  358. 2023-05-04T12:44:02.235+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452893 encode_pending encoding full map with octopus features 1080873256688364036
  359. 2023-05-04T12:44:02.237+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  360. 2023-05-04T12:44:02.239+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.87:7020/16345,v1:192.168.32.87:7022/16345] via mon.3 v2:192.168.32.68:3300/0
  361. 2023-05-04T12:44:02.239+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  362. 2023-05-04T12:44:02.239+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.1014' type 4
  363. 2023-05-04T12:44:02.239+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186f27340 from v2:192.168.32.68:3300/0
  364. 2023-05-04T12:44:02.239+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 preprocess_query log(1 entries from seq 9157 at 2023-05-04T12:44:01.982749+0200) v1 from osd.1014 v2:192.168.32.87:7020/16345
  365. 2023-05-04T12:44:02.239+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 preprocess_log log(1 entries from seq 9157 at 2023-05-04T12:44:01.982749+0200) v1 from osd.1014
  366. 2023-05-04T12:44:02.240+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 prepare_update log(1 entries from seq 9157 at 2023-05-04T12:44:01.982749+0200) v1 from osd.1014 v2:192.168.32.87:7020/16345
  367. 2023-05-04T12:44:02.240+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 prepare_log log(1 entries from seq 9157 at 2023-05-04T12:44:01.982749+0200) v1 from osd.1014
  368. 2023-05-04T12:44:02.240+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 logging 2023-05-04T12:44:01.982749+0200 osd.1014 (osd.1014) 9157 : cluster [DBG] 13.2f8 scrub starts
  369. 2023-05-04T12:44:02.263+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  370. 2023-05-04T12:44:02.263+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).osd e1452893 update_from_paxos loading creating_pgs last_scan_epoch 1452893 with 0 pgs
  371. 2023-05-04T12:44:02.263+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).osd e1452893 update_from_paxos applying incremental 1452894
  372. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 1 mon.ceph-01@0(leader).osd e1452894 e1452894: 1260 total, 1260 up, 1260 in
  373. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_subs
  374. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e185fdf8c0 next 1452894 (onetime)
  375. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 5 mon.ceph-01@0(leader).osd e1452894 send_incremental [1452894..1452894] to client.?
  376. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 build_incremental [1452894..1452894] with features 3f01cfb8ffecffff
  377. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e186b06c00 next 1452894 (onetime)
  378. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 5 mon.ceph-01@0(leader).osd e1452894 send_incremental [1452894..1452894] to client.?
  379. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 build_incremental [1452894..1452894] with features 3f01cfb8ffecffff
  380. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e187e13800 next 1452894 (onetime)
  381. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 5 mon.ceph-01@0(leader).osd e1452894 send_incremental [1452894..1452894] to client.182014955
  382. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 build_incremental [1452894..1452894] with features 3f01cfb8ffecffff
  383. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 share_map_with_random_osd no up osd on our session map
  384. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 update_logger
  385. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 update_from_paxos
  386. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754290 update_from_paxos version 41754290 summary v 41754290
  387. 2023-05-04T12:44:02.267+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  388. 2023-05-04T12:44:02.268+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  389. 2023-05-04T12:44:02.268+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  390. 2023-05-04T12:44:02.269+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065853
  391. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065853 service_map e3257846 0 progress events
  392. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  393. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  394. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 create_pending e 1452895
  395. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 update_logger
  396. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 0 log_channel(cluster) log [DBG] : osdmap e1452894: 1260 total, 1260 up, 1260 in
  397. 2023-05-04T12:44:02.270+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).osd e1452894 start_mapping started mapping job 0x55e187ebe460 at 2023-05-04T12:44:02.270942+0200
  398. 2023-05-04T12:44:02.270+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 preprocess_query log(1 entries from seq 1354 at 2023-05-04T12:44:02.270924+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  399. 2023-05-04T12:44:02.270+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 preprocess_log log(1 entries from seq 1354 at 2023-05-04T12:44:02.270924+0200) v1 from mon.0
  400. 2023-05-04T12:44:02.270+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 prepare_update log(1 entries from seq 1354 at 2023-05-04T12:44:02.270924+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  401. 2023-05-04T12:44:02.270+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 prepare_log log(1 entries from seq 1354 at 2023-05-04T12:44:02.270924+0200) v1 from mon.0
  402. 2023-05-04T12:44:02.270+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 logging 2023-05-04T12:44:02.270924+0200 mon.ceph-01 (mon.0) 1354 : cluster [DBG] osdmap e1452894: 1260 total, 1260 up, 1260 in
  403. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.80:6954/18347,v1:192.168.32.80:6955/18347] via mon.4 v2:192.168.32.69:3300/0
  404. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  405. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.991' type 4
  406. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186e29500 from v2:192.168.32.69:3300/0
  407. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 preprocess_query log(1 entries from seq 7820 at 2023-05-04T12:44:02.175591+0200) v1 from osd.991 v2:192.168.32.80:6954/18347
  408. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 preprocess_log log(1 entries from seq 7820 at 2023-05-04T12:44:02.175591+0200) v1 from osd.991
  409. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 prepare_update log(1 entries from seq 7820 at 2023-05-04T12:44:02.175591+0200) v1 from osd.991 v2:192.168.32.80:6954/18347
  410. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 prepare_log log(1 entries from seq 7820 at 2023-05-04T12:44:02.175591+0200) v1 from osd.991
  411. 2023-05-04T12:44:02.547+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754290 logging 2023-05-04T12:44:02.175591+0200 osd.991 (osd.991) 7820 : cluster [DBG] 13.926 scrub ok
  412. 2023-05-04T12:44:02.606+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724] via mon.4 v2:192.168.32.69:3300/0
  413. 2023-05-04T12:44:02.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  414. 2023-05-04T12:44:02.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-12' type 2
  415. 2023-05-04T12:44:02.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a085080 from v2:192.168.32.69:3300/0
  416. 2023-05-04T12:44:02.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(165837172/ceph-12 up:standby seq=3084692 v888048) v8 from mds.? [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724]
  417. 2023-05-04T12:44:02.607+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(165837172/ceph-12 up:standby seq=3084692 v888048) v8 from mds.? [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  418. 2023-05-04T12:44:02.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 165837172
  419. 2023-05-04T12:44:02.607+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(165837172/ceph-12 up:standby seq=3084692 v888048) v8 noting time
  420. 2023-05-04T12:44:02.607+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e198aa10e0 0x55e1869fa840 mdsbeacon(165837172/ceph-12 up:standby seq=3084692 v888048) v8
  421. 2023-05-04T12:44:02.732+0200 7ff6b4726700 10 osdmap epoch 1452894 mapping took 0.462037 seconds
  422. 2023-05-04T12:44:02.732+0200 7ff6b4726700 10 mon.ceph-01@0(leader).osd e1452894 update_creating_pgs 0 pgs creating, 0 pools in queue
  423. 2023-05-04T12:44:02.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.80:6800/1180859551,v1:192.168.32.80:6801/1180859551] via mon.4 v2:192.168.32.69:3300/0
  424. 2023-05-04T12:44:02.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  425. 2023-05-04T12:44:02.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-16' type 2
  426. 2023-05-04T12:44:02.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1869fa840 from v2:192.168.32.69:3300/0
  427. 2023-05-04T12:44:02.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(179377603/ceph-16 up:active seq=1877308 v892362) v8 from mds.3 [v2:192.168.32.80:6800/1180859551,v1:192.168.32.80:6801/1180859551]
  428. 2023-05-04T12:44:02.767+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(179377603/ceph-16 up:active seq=1877308 v892362) v8 from mds.3 [v2:192.168.32.80:6800/1180859551,v1:192.168.32.80:6801/1180859551] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  429. 2023-05-04T12:44:02.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 179377603
  430. 2023-05-04T12:44:02.767+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(179377603/ceph-16 up:active seq=1877308 v892362) v8 noting time
  431. 2023-05-04T12:44:02.767+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186a325a0 0x55e1874e0dc0 mdsbeacon(179377603/ceph-16 up:active seq=1877308 v892362) v8
  432. 2023-05-04T12:44:02.970+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  433. 2023-05-04T12:44:02.970+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  434. 2023-05-04T12:44:02.970+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  435. 2023-05-04T12:44:02.970+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e19672e5a0 from v2:192.168.32.68:3300/0
  436. 2023-05-04T12:44:02.970+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request monmgrreport(gid 204968658, 0 checks, 0 progress events) v3
  437. 2023-05-04T12:44:02.970+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgrstat prepare_report 25065 pgs: 28 active+clean+scrubbing+deep, 25035 active+clean, 2 active+clean+scrubbing; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 215 MiB/s rd, 325 MiB/s wr, 3.96k op/s, 0 health checks, 0 progress events
  438. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.68:0/63 via mon.3 v2:192.168.32.68:3300/0
  439. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  440. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-25' type 16
  441. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187c05680 from v2:192.168.32.68:3300/0
  442. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207635505 192.168.32.68:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-25(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207635505, , 0) v10
  443. 2023-05-04T12:44:03.062+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  444. 2023-05-04T12:44:03.062+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  445. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207635505
  446. 2023-05-04T12:44:03.062+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  447. 2023-05-04T12:44:03.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.73:6800/684499163,v1:192.168.32.73:6801/684499163] via mon.3 v2:192.168.32.68:3300/0
  448. 2023-05-04T12:44:03.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  449. 2023-05-04T12:44:03.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-09' type 2
  450. 2023-05-04T12:44:03.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a13f600 from v2:192.168.32.68:3300/0
  451. 2023-05-04T12:44:03.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166232949/ceph-09 up:active seq=3087049 v892362) v8 from mds.4 [v2:192.168.32.73:6800/684499163,v1:192.168.32.73:6801/684499163]
  452. 2023-05-04T12:44:03.064+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166232949/ceph-09 up:active seq=3087049 v892362) v8 from mds.4 [v2:192.168.32.73:6800/684499163,v1:192.168.32.73:6801/684499163] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  453. 2023-05-04T12:44:03.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166232949
  454. 2023-05-04T12:44:03.064+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166232949/ceph-09 up:active seq=3087049 v892362) v8 noting time
  455. 2023-05-04T12:44:03.064+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869c3b30 0x55e187ed0b00 mdsbeacon(166232949/ceph-09 up:active seq=3087049 v892362) v8
  456. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.66:0/63 via mon.4 v2:192.168.32.69:3300/0
  457. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  458. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-02' type 16
  459. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1880c0500 from v2:192.168.32.69:3300/0
  460. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315386 192.168.32.66:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-02(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315386, , 0) v10
  461. 2023-05-04T12:44:03.140+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  462. 2023-05-04T12:44:03.140+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  463. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315386
  464. 2023-05-04T12:44:03.140+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  465. 2023-05-04T12:44:03.185+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e18641e000 (start) method 0 payload 0
  466. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e18641e000 no session
  467. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _ms_dispatch new session 0x55e186e0fb00 MonSession(client.? v1:192.168.32.64:0/2025849277 is open , features 0x3f01cfb8ffedffff (luminous)) features 0x3f01cfb8ffedffff
  468. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 0 34 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/2025849277
  469. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=34
  470. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 _assign_global_id 208539505 (max 208554096)
  471. 2023-05-04T12:44:03.185+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186edcf00 0x55e187ffc1a0 auth_reply(proto 2 0 (0) Success) v1
  472. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 2 36 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/2025849277
  473. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=36
  474. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186e0fb00 con 0x55e18641e000 addr v1:192.168.32.64:0/2025849277 MonSession(client.? v1:192.168.32.64:0/2025849277 is open , features 0x3f01cfb8ffedffff (luminous))
  475. 2023-05-04T12:44:03.185+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186a8f950 0x55e1ae03e1a0 auth_reply(proto 2 0 (0) Success) v1
  476. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e18641e000 v1:192.168.32.64:0/2025849277
  477. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? v1:192.168.32.64:0/2025849277
  478. 2023-05-04T12:44:03.185+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e186e0fb00 client.? v1:192.168.32.64:0/2025849277 features 0x3f01cfb8ffedffff
  479. 2023-05-04T12:44:03.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754290 encode_full log v 41754290
  480. 2023-05-04T12:44:03.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754290 encode_pending v41754291
  481. 2023-05-04T12:44:03.217+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  482. 2023-05-04T12:44:03.217+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 update_from_paxos
  483. 2023-05-04T12:44:03.217+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 update_from_paxos version 41754291 summary v 41754290
  484. 2023-05-04T12:44:03.217+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 update_from_paxos latest full 41754290
  485. 2023-05-04T12:44:03.218+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754291 update_from_paxos applying incremental log 41754291 2023-05-04T12:44:01.982749+0200 osd.1014 (osd.1014) 9157 : cluster [DBG] 13.2f8 scrub starts
  486. 2023-05-04T12:44:03.218+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754291 update_from_paxos applying incremental log 41754291 2023-05-04T12:44:02.175591+0200 osd.991 (osd.991) 7820 : cluster [DBG] 13.926 scrub ok
  487. 2023-05-04T12:44:03.218+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754291 update_from_paxos applying incremental log 41754291 2023-05-04T12:44:02.270924+0200 mon.ceph-01 (mon.0) 1354 : cluster [DBG] osdmap e1452894: 1260 total, 1260 up, 1260 in
  488. 2023-05-04T12:44:03.218+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 check_subs
  489. 2023-05-04T12:44:03.218+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  490. 2023-05-04T12:44:03.218+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  491. 2023-05-04T12:44:03.219+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  492. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065853
  493. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065853 service_map e3257846 0 progress events
  494. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  495. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  496. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 create_pending v 41754292
  497. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754291 _updated_log for osd.1014 v2:192.168.32.87:7020/16345
  498. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186925d10 0x55e186d42300 log(last 9157) v1
  499. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754291 _updated_log for mon.0 v2:192.168.32.65:3300/0
  500. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ec1b30 0x55e1869b3980 log(last 1354) v1
  501. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754291 _updated_log for osd.991 v2:192.168.32.80:6954/18347
  502. 2023-05-04T12:44:03.220+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186bcc0f0 0x55e186b36000 log(last 7820) v1
  503. 2023-05-04T12:44:03.263+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).mgrstat 63065854
  504. 2023-05-04T12:44:03.263+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  505. 2023-05-04T12:44:03.275+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  506. 2023-05-04T12:44:03.275+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 update_from_paxos
  507. 2023-05-04T12:44:03.275+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754291 update_from_paxos version 41754291 summary v 41754291
  508. 2023-05-04T12:44:03.275+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  509. 2023-05-04T12:44:03.275+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  510. 2023-05-04T12:44:03.276+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  511. 2023-05-04T12:44:03.277+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065854
  512. 2023-05-04T12:44:03.277+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065854 service_map e3257846 0 progress events
  513. 2023-05-04T12:44:03.277+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  514. 2023-05-04T12:44:03.277+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  515. 2023-05-04T12:44:03.277+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065854
  516. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mon [v2:192.168.32.68:3300/0,v1:192.168.32.68:6789/0] via mon.3 v2:192.168.32.68:3300/0
  517. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow *
  518. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mon.' type 1
  519. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1884601c0 from v2:192.168.32.68:3300/0
  520. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 preprocess_query log(1 entries from seq 986 at 2023-05-04T12:44:03.467327+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  521. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 preprocess_log log(1 entries from seq 986 at 2023-05-04T12:44:03.467327+0200) v1 from mon.3
  522. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 prepare_update log(1 entries from seq 986 at 2023-05-04T12:44:03.467327+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  523. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 prepare_log log(1 entries from seq 986 at 2023-05-04T12:44:03.467327+0200) v1 from mon.3
  524. 2023-05-04T12:44:03.467+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 logging 2023-05-04T12:44:03.467327+0200 mon.ceph-25 (mon.3) 986 : audit [DBG] from='client.? 192.168.32.64:0/2432085756' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch
  525. 2023-05-04T12:44:03.496+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  526. 2023-05-04T12:44:03.496+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  527. 2023-05-04T12:44:03.496+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  528. 2023-05-04T12:44:03.496+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d51180 from v2:192.168.32.68:3300/0
  529. 2023-05-04T12:44:03.496+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-03(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204968658, [v2:192.168.32.67:6800/63,v1:192.168.32.67:6801/63], 1) v10
  530. 2023-05-04T12:44:03.496+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  531. 2023-05-04T12:44:03.496+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  532. 2023-05-04T12:44:03.496+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  533. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  534. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  535. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  536. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e185c74e00 from v2:192.168.32.68:3300/0
  537. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 preprocess_query log(1 entries from seq 117207 at 2023-05-04T12:44:02.968881+0200) v1 from mgr.204968658 192.168.32.67:0/63
  538. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 preprocess_log log(1 entries from seq 117207 at 2023-05-04T12:44:02.968881+0200) v1 from mgr.204968658
  539. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 prepare_update log(1 entries from seq 117207 at 2023-05-04T12:44:02.968881+0200) v1 from mgr.204968658 192.168.32.67:0/63
  540. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 prepare_log log(1 entries from seq 117207 at 2023-05-04T12:44:02.968881+0200) v1 from mgr.204968658
  541. 2023-05-04T12:44:03.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 logging 2023-05-04T12:44:02.968881+0200 mgr.ceph-03 (mgr.204968658) 117207 : cluster [DBG] pgmap v123475: 25065 pgs: 2 active+clean+scrubbing, 25035 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 215 MiB/s rd, 325 MiB/s wr, 3.96k op/s
  542. 2023-05-04T12:44:03.639+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1863de000 (start) method 0 payload 0
  543. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e1863de000 no session
  544. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _ms_dispatch new session 0x55e1869d4fc0 MonSession(client.? v1:192.168.32.64:0/3986060568 is open , features 0x3f01cfb8ffedffff (luminous)) features 0x3f01cfb8ffedffff
  545. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 0 34 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/3986060568
  546. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=34
  547. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 _assign_global_id 208539510 (max 208554096)
  548. 2023-05-04T12:44:03.639+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186f0e4b0 0x55e186b984e0 auth_reply(proto 2 0 (0) Success) v1
  549. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 2 36 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/3986060568
  550. 2023-05-04T12:44:03.639+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=36
  551. 2023-05-04T12:44:03.640+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e1869d4fc0 con 0x55e1863de000 addr v1:192.168.32.64:0/3986060568 MonSession(client.? v1:192.168.32.64:0/3986060568 is open , features 0x3f01cfb8ffedffff (luminous))
  552. 2023-05-04T12:44:03.640+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186924d20 0x55e187c1d6c0 auth_reply(proto 2 0 (0) Success) v1
  553. 2023-05-04T12:44:03.640+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1863de000 v1:192.168.32.64:0/3986060568
  554. 2023-05-04T12:44:03.640+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? v1:192.168.32.64:0/3986060568
  555. 2023-05-04T12:44:03.640+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e1869d4fc0 client.? v1:192.168.32.64:0/3986060568 features 0x3f01cfb8ffedffff
  556. 2023-05-04T12:44:03.640+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1861c2400 (start) method 2 payload 22
  557. 2023-05-04T12:44:03.640+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1861c2400 (more) method 2 payload 132
  558. 2023-05-04T12:44:03.640+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186ebc000 con 0x55e1861c2400 addr - MonSession(unknown.0 is open , features 0x0 (unknown))
  559. 2023-05-04T12:44:03.640+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1861c2400 -
  560. 2023-05-04T12:44:03.640+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session unknown.0
  561. 2023-05-04T12:44:03.643+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1863ce400 (start) method 2 payload 22
  562. 2023-05-04T12:44:03.643+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader).auth v48228 _assign_global_id 208539515 (max 208554096)
  563. 2023-05-04T12:44:03.644+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1863ce400 (more) method 2 payload 36
  564. 2023-05-04T12:44:03.644+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186943b00 con 0x55e1863ce400 addr - MonSession(unknown.0 is open , features 0x0 (unknown))
  565. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e1863ce400 session 0x55e186943b00 registering session for 192.168.32.64:0/989772230
  566. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_mon_get_map
  567. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({config=0+,monmap=0+}) v3
  568. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config check_sub next 0 have 2783
  569. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config refresh_config crush_location for remote_host gnosis is {}
  570. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config maybe_send_config to client.? (changed)
  571. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config send_config to client.?
  572. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader).monmap v7 check_sub monmap next 0 have 7
  573. 2023-05-04T12:44:03.644+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({mgrmap=0+}) v3
  574. 2023-05-04T12:44:03.645+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({osdmap=0}) v3
  575. 2023-05-04T12:44:03.645+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e185ff0780 next 0 (onetime)
  576. 2023-05-04T12:44:03.654+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186c453b0 0x55e186074820 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1
  577. 2023-05-04T12:44:03.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.72:6800/3709642669,v1:192.168.32.72:6801/3709642669] via mon.4 v2:192.168.32.69:3300/0
  578. 2023-05-04T12:44:03.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  579. 2023-05-04T12:44:03.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-08' type 2
  580. 2023-05-04T12:44:03.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1874e0dc0 from v2:192.168.32.69:3300/0
  581. 2023-05-04T12:44:03.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(165723417/ceph-08 up:standby seq=3088806 v888022) v8 from mds.? [v2:192.168.32.72:6800/3709642669,v1:192.168.32.72:6801/3709642669]
  582. 2023-05-04T12:44:03.657+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(165723417/ceph-08 up:standby seq=3088806 v888022) v8 from mds.? [v2:192.168.32.72:6800/3709642669,v1:192.168.32.72:6801/3709642669] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  583. 2023-05-04T12:44:03.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 165723417
  584. 2023-05-04T12:44:03.657+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(165723417/ceph-08 up:standby seq=3088806 v888022) v8 noting time
  585. 2023-05-04T12:44:03.657+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869452c0 0x55e1873ff600 mdsbeacon(165723417/ceph-08 up:standby seq=3088806 v888022) v8
  586. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.65:0/63 via mon.3 v2:192.168.32.68:3300/0
  587. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  588. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-01' type 16
  589. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1871d2a00 from v2:192.168.32.68:3300/0
  590. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315376 192.168.32.65:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-01(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315376, , 0) v10
  591. 2023-05-04T12:44:03.858+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  592. 2023-05-04T12:44:03.858+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  593. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315376
  594. 2023-05-04T12:44:03.858+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  595. 2023-05-04T12:44:03.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113] via mon.3 v2:192.168.32.68:3300/0
  596. 2023-05-04T12:44:03.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  597. 2023-05-04T12:44:03.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-15' type 2
  598. 2023-05-04T12:44:03.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d60b00 from v2:192.168.32.68:3300/0
  599. 2023-05-04T12:44:03.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166321840/ceph-15 up:active seq=3086800 v892362) v8 from mds.6 [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113]
  600. 2023-05-04T12:44:03.897+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166321840/ceph-15 up:active seq=3086800 v892362) v8 from mds.6 [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  601. 2023-05-04T12:44:03.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166321840
  602. 2023-05-04T12:44:03.897+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166321840/ceph-15 up:active seq=3086800 v892362) v8 noting time
  603. 2023-05-04T12:44:03.897+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ec0870 0x55e1869fab00 mdsbeacon(166321840/ceph-15 up:active seq=3086800 v892362) v8
  604. 2023-05-04T12:44:03.926+0200 7ff6b2722700 0 mon.ceph-01@0(leader) e7 handle_command mon_command({"prefix": "df"} v 0) v1
  605. 2023-05-04T12:44:03.926+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _allowed_command capable
  606. 2023-05-04T12:44:03.926+0200 7ff6b2722700 0 log_channel(audit) log [DBG] : from='client.? 192.168.32.64:0/989772230' entity='client.admin' cmd=[{"prefix": "df"}]: dispatch
  607. 2023-05-04T12:44:03.926+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186a325a0 0x55e1926b7520 mon_command_ack([{"prefix": "df"}]=0 v0) v1
  608. 2023-05-04T12:44:03.926+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 preprocess_query log(1 entries from seq 1355 at 2023-05-04T12:44:03.926974+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  609. 2023-05-04T12:44:03.926+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 preprocess_log log(1 entries from seq 1355 at 2023-05-04T12:44:03.926974+0200) v1 from mon.0
  610. 2023-05-04T12:44:03.926+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 prepare_update log(1 entries from seq 1355 at 2023-05-04T12:44:03.926974+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  611. 2023-05-04T12:44:03.926+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 prepare_log log(1 entries from seq 1355 at 2023-05-04T12:44:03.926974+0200) v1 from mon.0
  612. 2023-05-04T12:44:03.926+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754291 logging 2023-05-04T12:44:03.926974+0200 mon.ceph-01 (mon.0) 1355 : audit [DBG] from='client.? 192.168.32.64:0/989772230' entity='client.admin' cmd=[{"prefix": "df"}]: dispatch
  613. 2023-05-04T12:44:03.928+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1863ce400 192.168.32.64:0/989772230
  614. 2023-05-04T12:44:03.928+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? 192.168.32.64:0/989772230
  615. 2023-05-04T12:44:03.928+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e186943b00 client.? 192.168.32.64:0/989772230 features 0x3f01cfb8ffedffff
  616. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.69:0/63 via mon.4 v2:192.168.32.69:3300/0
  617. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  618. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-26' type 16
  619. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a112000 from v2:192.168.32.69:3300/0
  620. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204935384 192.168.32.69:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-26(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204935384, , 0) v10
  621. 2023-05-04T12:44:04.025+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  622. 2023-05-04T12:44:04.025+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  623. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 204935384
  624. 2023-05-04T12:44:04.025+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  625. 2023-05-04T12:44:04.275+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754291 encode_full log v 41754291
  626. 2023-05-04T12:44:04.275+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754291 encode_pending v41754292
  627. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  628. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 update_from_paxos
  629. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 update_from_paxos version 41754292 summary v 41754291
  630. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 update_from_paxos latest full 41754291
  631. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754292 update_from_paxos applying incremental log 41754292 2023-05-04T12:44:02.968881+0200 mgr.ceph-03 (mgr.204968658) 117207 : cluster [DBG] pgmap v123475: 25065 pgs: 2 active+clean+scrubbing, 25035 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 215 MiB/s rd, 325 MiB/s wr, 3.96k op/s
  632. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754292 update_from_paxos applying incremental log 41754292 2023-05-04T12:44:03.467327+0200 mon.ceph-25 (mon.3) 986 : audit [DBG] from='client.? 192.168.32.64:0/2432085756' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch
  633. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754292 update_from_paxos applying incremental log 41754292 2023-05-04T12:44:03.926974+0200 mon.ceph-01 (mon.0) 1355 : audit [DBG] from='client.? 192.168.32.64:0/989772230' entity='client.admin' cmd=[{"prefix": "df"}]: dispatch
  634. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 check_subs
  635. 2023-05-04T12:44:04.341+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  636. 2023-05-04T12:44:04.342+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  637. 2023-05-04T12:44:04.343+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  638. 2023-05-04T12:44:04.344+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065854
  639. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065854 service_map e3257846 0 progress events
  640. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  641. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  642. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 create_pending v 41754293
  643. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754292 _updated_log for mon.3 v2:192.168.32.68:3300/0
  644. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186945ef0 0x55e186c4b800 log(last 986) v1
  645. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754292 _updated_log for mgr.204968658 192.168.32.67:0/63
  646. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869eb770 0x55e186c5ed80 log(last 117207) v1
  647. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754292 _updated_log for mon.0 v2:192.168.32.65:3300/0
  648. 2023-05-04T12:44:04.345+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186eadb30 0x55e188562f00 log(last 1355) v1
  649. 2023-05-04T12:44:04.378+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({osdmap=1452895}) v3
  650. 2023-05-04T12:44:04.378+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e188f18600 next 1452895 (onetime)
  651. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mon [v2:192.168.32.69:3300/0,v1:192.168.32.69:6789/0] via mon.4 v2:192.168.32.69:3300/0
  652. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow *
  653. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mon.' type 1
  654. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d40fc0 from v2:192.168.32.69:3300/0
  655. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754292 preprocess_query log(1 entries from seq 1340 at 2023-05-04T12:44:04.384710+0200) v1 from mon.4 v2:192.168.32.69:3300/0
  656. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754292 preprocess_log log(1 entries from seq 1340 at 2023-05-04T12:44:04.384710+0200) v1 from mon.4
  657. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754292 prepare_update log(1 entries from seq 1340 at 2023-05-04T12:44:04.384710+0200) v1 from mon.4 v2:192.168.32.69:3300/0
  658. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754292 prepare_log log(1 entries from seq 1340 at 2023-05-04T12:44:04.384710+0200) v1 from mon.4
  659. 2023-05-04T12:44:04.384+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754292 logging 2023-05-04T12:44:04.384710+0200 mon.ceph-26 (mon.4) 1340 : audit [DBG] from='client.? 192.168.32.64:0/177528902' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch
  660. 2023-05-04T12:44:04.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579] via mon.4 v2:192.168.32.69:3300/0
  661. 2023-05-04T12:44:04.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  662. 2023-05-04T12:44:04.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-11' type 2
  663. 2023-05-04T12:44:04.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1873ff600 from v2:192.168.32.69:3300/0
  664. 2023-05-04T12:44:04.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166183211/ceph-11 up:active seq=3084455 v892362) v8 from mds.2 [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579]
  665. 2023-05-04T12:44:04.830+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166183211/ceph-11 up:active seq=3084455 v892362) v8 from mds.2 [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  666. 2023-05-04T12:44:04.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166183211
  667. 2023-05-04T12:44:04.830+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166183211/ceph-11 up:active seq=3084455 v892362) v8 noting time
  668. 2023-05-04T12:44:04.830+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e185e682d0 0x55e18741d080 mdsbeacon(166183211/ceph-11 up:active seq=3084455 v892362) v8
  669. 2023-05-04T12:44:04.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125] via mon.4 v2:192.168.32.69:3300/0
  670. 2023-05-04T12:44:04.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  671. 2023-05-04T12:44:04.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-23' type 2
  672. 2023-05-04T12:44:04.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18741d080 from v2:192.168.32.69:3300/0
  673. 2023-05-04T12:44:04.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(195341627/ceph-23 up:active seq=951817 v892362) v8 from mds.1 [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125]
  674. 2023-05-04T12:44:04.936+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(195341627/ceph-23 up:active seq=951817 v892362) v8 from mds.1 [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  675. 2023-05-04T12:44:04.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 195341627
  676. 2023-05-04T12:44:04.936+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(195341627/ceph-23 up:active seq=951817 v892362) v8 noting time
  677. 2023-05-04T12:44:04.936+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869452c0 0x55e1874e1b80 mdsbeacon(195341627/ceph-23 up:active seq=951817 v892362) v8
  678. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.68:0/63 via mon.3 v2:192.168.32.68:3300/0
  679. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  680. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-25' type 16
  681. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18856cc80 from v2:192.168.32.68:3300/0
  682. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207635505 192.168.32.68:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-25(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207635505, , 0) v10
  683. 2023-05-04T12:44:05.074+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  684. 2023-05-04T12:44:05.074+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  685. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207635505
  686. 2023-05-04T12:44:05.074+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  687. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.66:0/63 via mon.4 v2:192.168.32.69:3300/0
  688. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  689. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-02' type 16
  690. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1874acf00 from v2:192.168.32.69:3300/0
  691. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315386 192.168.32.66:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-02(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315386, , 0) v10
  692. 2023-05-04T12:44:05.152+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  693. 2023-05-04T12:44:05.152+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  694. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315386
  695. 2023-05-04T12:44:05.152+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  696. 2023-05-04T12:44:05.173+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  697. 2023-05-04T12:44:05.173+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  698. 2023-05-04T12:44:05.173+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  699. 2023-05-04T12:44:05.173+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e19a5441e0 from v2:192.168.32.68:3300/0
  700. 2023-05-04T12:44:05.173+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request monmgrreport(gid 204968658, 0 checks, 0 progress events) v3
  701. 2023-05-04T12:44:05.174+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgrstat prepare_report 25065 pgs: 28 active+clean+scrubbing+deep, 25036 active+clean, 1 active+clean+scrubbing; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 285 MiB/s rd, 329 MiB/s wr, 4.05k op/s, 0 health checks, 0 progress events
  702. 2023-05-04T12:44:05.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806] via mon.4 v2:192.168.32.69:3300/0
  703. 2023-05-04T12:44:05.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  704. 2023-05-04T12:44:05.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-13' type 2
  705. 2023-05-04T12:44:05.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1874e1b80 from v2:192.168.32.69:3300/0
  706. 2023-05-04T12:44:05.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(164509948/ceph-13 up:standby seq=3067734 v888115) v8 from mds.? [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806]
  707. 2023-05-04T12:44:05.251+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(164509948/ceph-13 up:standby seq=3067734 v888115) v8 from mds.? [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  708. 2023-05-04T12:44:05.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 164509948
  709. 2023-05-04T12:44:05.251+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(164509948/ceph-13 up:standby seq=3067734 v888115) v8 noting time
  710. 2023-05-04T12:44:05.251+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186925d10 0x55e187449b80 mdsbeacon(164509948/ceph-13 up:standby seq=3067734 v888115) v8
  711. 2023-05-04T12:44:05.341+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).mgrstat 63065855
  712. 2023-05-04T12:44:05.341+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  713. 2023-05-04T12:44:05.343+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754292 encode_full log v 41754292
  714. 2023-05-04T12:44:05.343+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754292 encode_pending v41754293
  715. 2023-05-04T12:44:05.364+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  716. 2023-05-04T12:44:05.364+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 update_from_paxos
  717. 2023-05-04T12:44:05.364+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754292 update_from_paxos version 41754292 summary v 41754292
  718. 2023-05-04T12:44:05.365+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  719. 2023-05-04T12:44:05.365+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  720. 2023-05-04T12:44:05.366+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  721. 2023-05-04T12:44:05.367+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065855
  722. 2023-05-04T12:44:05.367+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065855 service_map e3257846 0 progress events
  723. 2023-05-04T12:44:05.367+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  724. 2023-05-04T12:44:05.367+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  725. 2023-05-04T12:44:05.367+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065855
  726. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  727. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 update_from_paxos
  728. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 update_from_paxos version 41754293 summary v 41754292
  729. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 update_from_paxos latest full 41754292
  730. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754293 update_from_paxos applying incremental log 41754293 2023-05-04T12:44:04.384710+0200 mon.ceph-26 (mon.4) 1340 : audit [DBG] from='client.? 192.168.32.64:0/177528902' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch
  731. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 check_subs
  732. 2023-05-04T12:44:05.394+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  733. 2023-05-04T12:44:05.395+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  734. 2023-05-04T12:44:05.396+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  735. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065855
  736. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065855 service_map e3257846 0 progress events
  737. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  738. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  739. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 create_pending v 41754294
  740. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754293 _updated_log for mon.4 v2:192.168.32.69:3300/0
  741. 2023-05-04T12:44:05.397+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869c3b30 0x55e187bbbb00 log(last 1340) v1
  742. 2023-05-04T12:44:05.398+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765] via mon.4 v2:192.168.32.69:3300/0
  743. 2023-05-04T12:44:05.398+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  744. 2023-05-04T12:44:05.398+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-10' type 2
  745. 2023-05-04T12:44:05.398+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187449b80 from v2:192.168.32.69:3300/0
  746. 2023-05-04T12:44:05.398+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(206920672/ceph-10 up:standby seq=62642 v892263) v8 from mds.? [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765]
  747. 2023-05-04T12:44:05.398+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(206920672/ceph-10 up:standby seq=62642 v892263) v8 from mds.? [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  748. 2023-05-04T12:44:05.398+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 206920672
  749. 2023-05-04T12:44:05.398+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(206920672/ceph-10 up:standby seq=62642 v892263) v8 noting time
  750. 2023-05-04T12:44:05.398+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186bcc0f0 0x55e186b00000 mdsbeacon(206920672/ceph-10 up:standby seq=62642 v892263) v8
  751. 2023-05-04T12:44:05.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  752. 2023-05-04T12:44:05.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  753. 2023-05-04T12:44:05.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  754. 2023-05-04T12:44:05.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1871d3b80 from v2:192.168.32.68:3300/0
  755. 2023-05-04T12:44:05.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-03(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204968658, [v2:192.168.32.67:6800/63,v1:192.168.32.67:6801/63], 1) v10
  756. 2023-05-04T12:44:05.508+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  757. 2023-05-04T12:44:05.508+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  758. 2023-05-04T12:44:05.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  759. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  760. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  761. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  762. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e188539a40 from v2:192.168.32.68:3300/0
  763. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754293 preprocess_query log(1 entries from seq 117208 at 2023-05-04T12:44:05.171824+0200) v1 from mgr.204968658 192.168.32.67:0/63
  764. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754293 preprocess_log log(1 entries from seq 117208 at 2023-05-04T12:44:05.171824+0200) v1 from mgr.204968658
  765. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754293 prepare_update log(1 entries from seq 117208 at 2023-05-04T12:44:05.171824+0200) v1 from mgr.204968658 192.168.32.67:0/63
  766. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754293 prepare_log log(1 entries from seq 117208 at 2023-05-04T12:44:05.171824+0200) v1 from mgr.204968658
  767. 2023-05-04T12:44:05.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754293 logging 2023-05-04T12:44:05.171824+0200 mgr.ceph-03 (mgr.204968658) 117208 : cluster [DBG] pgmap v123476: 25065 pgs: 1 active+clean+scrubbing, 25036 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 285 MiB/s rd, 329 MiB/s wr, 4.05k op/s
  768. 2023-05-04T12:44:05.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521] via mon.2 v2:192.168.32.67:3300/0
  769. 2023-05-04T12:44:05.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  770. 2023-05-04T12:44:05.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-17' type 2
  771. 2023-05-04T12:44:05.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1886df600 from v2:192.168.32.67:3300/0
  772. 2023-05-04T12:44:05.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(174654745/ceph-17 up:active seq=2485933 v892362) v8 from mds.0 [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521]
  773. 2023-05-04T12:44:05.686+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(174654745/ceph-17 up:active seq=2485933 v892362) v8 from mds.0 [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  774. 2023-05-04T12:44:05.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 174654745
  775. 2023-05-04T12:44:05.686+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(174654745/ceph-17 up:active seq=2485933 v892362) v8 noting time
  776. 2023-05-04T12:44:05.686+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186924d20 0x55e187448dc0 mdsbeacon(174654745/ceph-17 up:active seq=2485933 v892362) v8
  777. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.65:0/63 via mon.3 v2:192.168.32.68:3300/0
  778. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  779. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-01' type 16
  780. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18866f680 from v2:192.168.32.68:3300/0
  781. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315376 192.168.32.65:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-01(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315376, , 0) v10
  782. 2023-05-04T12:44:05.870+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  783. 2023-05-04T12:44:05.870+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  784. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315376
  785. 2023-05-04T12:44:05.870+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  786. 2023-05-04T12:44:05.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914] via mon.3 v2:192.168.32.68:3300/0
  787. 2023-05-04T12:44:05.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  788. 2023-05-04T12:44:05.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-24' type 2
  789. 2023-05-04T12:44:05.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a083340 from v2:192.168.32.68:3300/0
  790. 2023-05-04T12:44:05.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(190565023/ceph-24 up:active seq=1272989 v892362) v8 from mds.7 [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914]
  791. 2023-05-04T12:44:05.979+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(190565023/ceph-24 up:active seq=1272989 v892362) v8 from mds.7 [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  792. 2023-05-04T12:44:05.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 190565023
  793. 2023-05-04T12:44:05.979+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(190565023/ceph-24 up:active seq=1272989 v892362) v8 noting time
  794. 2023-05-04T12:44:05.979+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186e7da40 0x55e186d60840 mdsbeacon(190565023/ceph-24 up:active seq=1272989 v892362) v8
  795. 2023-05-04T12:44:06.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396] via mon.4 v2:192.168.32.69:3300/0
  796. 2023-05-04T12:44:06.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  797. 2023-05-04T12:44:06.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-14' type 2
  798. 2023-05-04T12:44:06.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186b00000 from v2:192.168.32.69:3300/0
  799. 2023-05-04T12:44:06.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(201810535/ceph-14 up:active seq=496709 v892362) v8 from mds.5 [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396]
  800. 2023-05-04T12:44:06.011+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(201810535/ceph-14 up:active seq=496709 v892362) v8 from mds.5 [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  801. 2023-05-04T12:44:06.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 201810535
  802. 2023-05-04T12:44:06.011+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(201810535/ceph-14 up:active seq=496709 v892362) v8 noting time
  803. 2023-05-04T12:44:06.011+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869452c0 0x55e189b02dc0 mdsbeacon(201810535/ceph-14 up:active seq=496709 v892362) v8
  804. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.69:0/63 via mon.4 v2:192.168.32.69:3300/0
  805. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  806. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-26' type 16
  807. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1874ad180 from v2:192.168.32.69:3300/0
  808. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204935384 192.168.32.69:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-26(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204935384, , 0) v10
  809. 2023-05-04T12:44:06.037+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  810. 2023-05-04T12:44:06.037+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  811. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 204935384
  812. 2023-05-04T12:44:06.037+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  813. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 e1452894: 1260 total, 1260 up, 1260 in
  814. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 1 mon.ceph-01@0(leader).osd e1452894 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 71303168 full_alloc: 205520896 kv_alloc: 738197504
  815. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 tick balancer inc cache_bytes: 119008 inc comtd_bytes: 71303168 inc used_bytes: 119008 inc num_osdmaps: 420
  816. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 tick balancer full cache_bytes: 136022326 full comtd_bytes: 205520896 full used_bytes: 136022326 full num_osdmaps: 234
  817. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 should_prune could only prune 40 epochs (1452354..1452394), which is less than the required minimum (10000)
  818. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 try_prune_purged_snaps max_prune 100
  819. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 try_prune_purged_snaps actually pruned 0
  820. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 min_last_epoch_clean 1452871
  821. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754293 log
  822. 2023-05-04T12:44:06.204+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).auth v48228 auth
  823. 2023-05-04T12:44:06.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health tick
  824. 2023-05-04T12:44:06.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health check_member_health avail 99% total 1.1 TiB, used 454 MiB, avail 1.1 TiB
  825. 2023-05-04T12:44:06.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health 3645678
  826. 2023-05-04T12:44:06.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  827. 2023-05-04T12:44:06.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).config tick
  828. 2023-05-04T12:44:06.230+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  829. 2023-05-04T12:44:06.230+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 update_from_paxos
  830. 2023-05-04T12:44:06.230+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754293 update_from_paxos version 41754293 summary v 41754293
  831. 2023-05-04T12:44:06.230+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  832. 2023-05-04T12:44:06.231+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  833. 2023-05-04T12:44:06.232+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  834. 2023-05-04T12:44:06.233+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065855
  835. 2023-05-04T12:44:06.233+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065855 service_map e3257846 0 progress events
  836. 2023-05-04T12:44:06.233+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  837. 2023-05-04T12:44:06.233+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  838. 2023-05-04T12:44:06.233+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health 3645678
  839. 2023-05-04T12:44:06.394+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754293 encode_full log v 41754293
  840. 2023-05-04T12:44:06.394+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754293 encode_pending v41754294
  841. 2023-05-04T12:44:06.406+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  842. 2023-05-04T12:44:06.406+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 update_from_paxos
  843. 2023-05-04T12:44:06.406+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 update_from_paxos version 41754294 summary v 41754293
  844. 2023-05-04T12:44:06.406+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 update_from_paxos latest full 41754293
  845. 2023-05-04T12:44:06.406+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754294 update_from_paxos applying incremental log 41754294 2023-05-04T12:44:05.171824+0200 mgr.ceph-03 (mgr.204968658) 117208 : cluster [DBG] pgmap v123476: 25065 pgs: 1 active+clean+scrubbing, 25036 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 285 MiB/s rd, 329 MiB/s wr, 4.05k op/s
  846. 2023-05-04T12:44:06.406+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 check_subs
  847. 2023-05-04T12:44:06.407+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  848. 2023-05-04T12:44:06.407+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  849. 2023-05-04T12:44:06.408+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  850. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065855
  851. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065855 service_map e3257846 0 progress events
  852. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  853. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  854. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 create_pending v 41754295
  855. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754294 _updated_log for mgr.204968658 192.168.32.67:0/63
  856. 2023-05-04T12:44:06.409+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186f0e4b0 0x55e186ea9800 log(last 117208) v1
  857. 2023-05-04T12:44:06.599+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({osdmap=1452895}) v3
  858. 2023-05-04T12:44:06.599+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e185ff03c0 next 1452895 (onetime)
  859. 2023-05-04T12:44:06.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724] via mon.4 v2:192.168.32.69:3300/0
  860. 2023-05-04T12:44:06.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  861. 2023-05-04T12:44:06.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-12' type 2
  862. 2023-05-04T12:44:06.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e189b02dc0 from v2:192.168.32.69:3300/0
  863. 2023-05-04T12:44:06.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(165837172/ceph-12 up:standby seq=3084693 v888048) v8 from mds.? [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724]
  864. 2023-05-04T12:44:06.607+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(165837172/ceph-12 up:standby seq=3084693 v888048) v8 from mds.? [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  865. 2023-05-04T12:44:06.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 165837172
  866. 2023-05-04T12:44:06.607+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(165837172/ceph-12 up:standby seq=3084693 v888048) v8 noting time
  867. 2023-05-04T12:44:06.607+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186974780 0x55e186b00840 mdsbeacon(165837172/ceph-12 up:standby seq=3084693 v888048) v8
  868. 2023-05-04T12:44:06.641+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.96:6885/8466,v1:192.168.32.96:6886/8466] via mon.3 v2:192.168.32.68:3300/0
  869. 2023-05-04T12:44:06.642+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  870. 2023-05-04T12:44:06.642+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.60' type 4
  871. 2023-05-04T12:44:06.642+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1869dd080 from v2:192.168.32.68:3300/0
  872. 2023-05-04T12:44:06.642+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 preprocess_query osd_beacon(pgs [11.2c1,11.2e9,11.2a8,11.2cc,11.1d2,11.12e,11.223,11.84,11.2eb,11.d4,11.3ea,11.2ff,11.34f,11.37d,11.53,11.d,11.2ce,11.7c,11.18a,11.2d9] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:34:03.476486+0200 v1452894) v2 from osd.60 v2:192.168.32.96:6885/8466
  873. 2023-05-04T12:44:06.642+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to osd.60 v2:192.168.32.96:6885/8466 via v2:192.168.32.68:3300/0 for request osd_beacon(pgs [11.2c1,11.2e9,11.2a8,11.2cc,11.1d2,11.12e,11.223,11.84,11.2eb,11.d4,11.3ea,11.2ff,11.34f,11.37d,11.53,11.d,11.2ce,11.7c,11.18a,11.2d9] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:34:03.476486+0200 v1452894) v2
  874. 2023-05-04T12:44:06.642+0200 7ff6b2722700 7 mon.ceph-01@0(leader).osd e1452894 prepare_update osd_beacon(pgs [11.2c1,11.2e9,11.2a8,11.2cc,11.1d2,11.12e,11.223,11.84,11.2eb,11.d4,11.3ea,11.2ff,11.34f,11.37d,11.53,11.d,11.2ce,11.7c,11.18a,11.2d9] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:34:03.476486+0200 v1452894) v2 from osd.60 v2:192.168.32.96:6885/8466
  875. 2023-05-04T12:44:06.642+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 prepare_beacon osd_beacon(pgs [11.2c1,11.2e9,11.2a8,11.2cc,11.1d2,11.12e,11.223,11.84,11.2eb,11.d4,11.3ea,11.2ff,11.34f,11.37d,11.53,11.d,11.2ce,11.7c,11.18a,11.2d9] lec 1452892 last_purged_snaps_scrub 2023-05-04T12:34:03.476486+0200 v1452894) v2 from osd.60
  876. 2023-05-04T12:44:06.722+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({osdmap=1452895}) v3
  877. 2023-05-04T12:44:06.723+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e186b065a0 next 1452895 (onetime)
  878. 2023-05-04T12:44:06.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.80:6800/1180859551,v1:192.168.32.80:6801/1180859551] via mon.4 v2:192.168.32.69:3300/0
  879. 2023-05-04T12:44:06.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  880. 2023-05-04T12:44:06.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-16' type 2
  881. 2023-05-04T12:44:06.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186b00840 from v2:192.168.32.69:3300/0
  882. 2023-05-04T12:44:06.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(179377603/ceph-16 up:active seq=1877309 v892362) v8 from mds.3 [v2:192.168.32.80:6800/1180859551,v1:192.168.32.80:6801/1180859551]
  883. 2023-05-04T12:44:06.767+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(179377603/ceph-16 up:active seq=1877309 v892362) v8 from mds.3 [v2:192.168.32.80:6800/1180859551,v1:192.168.32.80:6801/1180859551] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  884. 2023-05-04T12:44:06.767+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 179377603
  885. 2023-05-04T12:44:06.767+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(179377603/ceph-16 up:active seq=1877309 v892362) v8 noting time
  886. 2023-05-04T12:44:06.767+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186c453b0 0x55e1868918c0 mdsbeacon(179377603/ceph-16 up:active seq=1877309 v892362) v8
  887. 2023-05-04T12:44:07.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.73:6800/684499163,v1:192.168.32.73:6801/684499163] via mon.3 v2:192.168.32.68:3300/0
  888. 2023-05-04T12:44:07.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  889. 2023-05-04T12:44:07.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-09' type 2
  890. 2023-05-04T12:44:07.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d60840 from v2:192.168.32.68:3300/0
  891. 2023-05-04T12:44:07.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166232949/ceph-09 up:active seq=3087050 v892362) v8 from mds.4 [v2:192.168.32.73:6800/684499163,v1:192.168.32.73:6801/684499163]
  892. 2023-05-04T12:44:07.064+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166232949/ceph-09 up:active seq=3087050 v892362) v8 from mds.4 [v2:192.168.32.73:6800/684499163,v1:192.168.32.73:6801/684499163] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  893. 2023-05-04T12:44:07.064+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166232949
  894. 2023-05-04T12:44:07.064+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166232949/ceph-09 up:active seq=3087050 v892362) v8 noting time
  895. 2023-05-04T12:44:07.064+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e198aa1590 0x55e189fca000 mdsbeacon(166232949/ceph-09 up:active seq=3087050 v892362) v8
  896. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.68:0/63 via mon.3 v2:192.168.32.68:3300/0
  897. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  898. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-25' type 16
  899. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1870c9180 from v2:192.168.32.68:3300/0
  900. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207635505 192.168.32.68:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-25(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207635505, , 0) v10
  901. 2023-05-04T12:44:07.086+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  902. 2023-05-04T12:44:07.086+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  903. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207635505
  904. 2023-05-04T12:44:07.086+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  905. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.66:0/63 via mon.4 v2:192.168.32.69:3300/0
  906. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  907. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-02' type 16
  908. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187489b80 from v2:192.168.32.69:3300/0
  909. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315386 192.168.32.66:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-02(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315386, , 0) v10
  910. 2023-05-04T12:44:07.164+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  911. 2023-05-04T12:44:07.164+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  912. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315386
  913. 2023-05-04T12:44:07.164+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  914. 2023-05-04T12:44:07.345+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  915. 2023-05-04T12:44:07.345+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  916. 2023-05-04T12:44:07.345+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  917. 2023-05-04T12:44:07.345+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186e310e0 from v2:192.168.32.68:3300/0
  918. 2023-05-04T12:44:07.345+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request monmgrreport(gid 204968658, 0 checks, 0 progress events) v3
  919. 2023-05-04T12:44:07.346+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgrstat prepare_report 25065 pgs: 28 active+clean+scrubbing+deep, 25036 active+clean, 1 active+clean+scrubbing; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 294 MiB/s rd, 347 MiB/s wr, 3.91k op/s, 0 health checks, 0 progress events
  920. 2023-05-04T12:44:07.406+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).mgrstat 63065856
  921. 2023-05-04T12:44:07.407+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  922. 2023-05-04T12:44:07.431+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  923. 2023-05-04T12:44:07.431+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 update_from_paxos
  924. 2023-05-04T12:44:07.431+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754294 update_from_paxos version 41754294 summary v 41754294
  925. 2023-05-04T12:44:07.431+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  926. 2023-05-04T12:44:07.432+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  927. 2023-05-04T12:44:07.432+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  928. 2023-05-04T12:44:07.433+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065856
  929. 2023-05-04T12:44:07.433+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065856 service_map e3257846 0 progress events
  930. 2023-05-04T12:44:07.433+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  931. 2023-05-04T12:44:07.433+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  932. 2023-05-04T12:44:07.434+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065856
  933. 2023-05-04T12:44:07.520+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  934. 2023-05-04T12:44:07.520+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  935. 2023-05-04T12:44:07.520+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  936. 2023-05-04T12:44:07.520+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186ce2f00 from v2:192.168.32.68:3300/0
  937. 2023-05-04T12:44:07.520+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-03(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204968658, [v2:192.168.32.67:6800/63,v1:192.168.32.67:6801/63], 1) v10
  938. 2023-05-04T12:44:07.520+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  939. 2023-05-04T12:44:07.520+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  940. 2023-05-04T12:44:07.520+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  941. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  942. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  943. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  944. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186e3d500 from v2:192.168.32.68:3300/0
  945. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754294 preprocess_query log(1 entries from seq 117209 at 2023-05-04T12:44:07.344120+0200) v1 from mgr.204968658 192.168.32.67:0/63
  946. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754294 preprocess_log log(1 entries from seq 117209 at 2023-05-04T12:44:07.344120+0200) v1 from mgr.204968658
  947. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754294 prepare_update log(1 entries from seq 117209 at 2023-05-04T12:44:07.344120+0200) v1 from mgr.204968658 192.168.32.67:0/63
  948. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754294 prepare_log log(1 entries from seq 117209 at 2023-05-04T12:44:07.344120+0200) v1 from mgr.204968658
  949. 2023-05-04T12:44:07.560+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754294 logging 2023-05-04T12:44:07.344120+0200 mgr.ceph-03 (mgr.204968658) 117209 : cluster [DBG] pgmap v123477: 25065 pgs: 1 active+clean+scrubbing, 25036 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 294 MiB/s rd, 347 MiB/s wr, 3.91k op/s
  950. 2023-05-04T12:44:07.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.72:6800/3709642669,v1:192.168.32.72:6801/3709642669] via mon.4 v2:192.168.32.69:3300/0
  951. 2023-05-04T12:44:07.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  952. 2023-05-04T12:44:07.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-08' type 2
  953. 2023-05-04T12:44:07.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1868918c0 from v2:192.168.32.69:3300/0
  954. 2023-05-04T12:44:07.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(165723417/ceph-08 up:standby seq=3088807 v888022) v8 from mds.? [v2:192.168.32.72:6800/3709642669,v1:192.168.32.72:6801/3709642669]
  955. 2023-05-04T12:44:07.657+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(165723417/ceph-08 up:standby seq=3088807 v888022) v8 from mds.? [v2:192.168.32.72:6800/3709642669,v1:192.168.32.72:6801/3709642669] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  956. 2023-05-04T12:44:07.657+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 165723417
  957. 2023-05-04T12:44:07.657+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(165723417/ceph-08 up:standby seq=3088807 v888022) v8 noting time
  958. 2023-05-04T12:44:07.657+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e18699fe00 0x55e186b69080 mdsbeacon(165723417/ceph-08 up:standby seq=3088807 v888022) v8
  959. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.65:0/63 via mon.3 v2:192.168.32.68:3300/0
  960. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  961. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-01' type 16
  962. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186ae3900 from v2:192.168.32.68:3300/0
  963. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315376 192.168.32.65:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-01(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315376, , 0) v10
  964. 2023-05-04T12:44:07.882+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  965. 2023-05-04T12:44:07.882+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  966. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315376
  967. 2023-05-04T12:44:07.882+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  968. 2023-05-04T12:44:07.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113] via mon.3 v2:192.168.32.68:3300/0
  969. 2023-05-04T12:44:07.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  970. 2023-05-04T12:44:07.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-15' type 2
  971. 2023-05-04T12:44:07.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1886dedc0 from v2:192.168.32.68:3300/0
  972. 2023-05-04T12:44:07.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166321840/ceph-15 up:active seq=3086801 v892362) v8 from mds.6 [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113]
  973. 2023-05-04T12:44:07.897+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166321840/ceph-15 up:active seq=3086801 v892362) v8 from mds.6 [v2:192.168.32.79:6800/4153389113,v1:192.168.32.79:6801/4153389113] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  974. 2023-05-04T12:44:07.897+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166321840
  975. 2023-05-04T12:44:07.897+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166321840/ceph-15 up:active seq=3086801 v892362) v8 noting time
  976. 2023-05-04T12:44:07.897+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ec1b30 0x55e186d61340 mdsbeacon(166321840/ceph-15 up:active seq=3086801 v892362) v8
  977. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.69:0/63 via mon.4 v2:192.168.32.69:3300/0
  978. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  979. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-26' type 16
  980. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1871d2c80 from v2:192.168.32.69:3300/0
  981. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204935384 192.168.32.69:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-26(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204935384, , 0) v10
  982. 2023-05-04T12:44:08.049+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  983. 2023-05-04T12:44:08.049+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  984. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 204935384
  985. 2023-05-04T12:44:08.049+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  986. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.90:6808/6258,v1:192.168.32.90:6809/6258] via mon.4 v2:192.168.32.69:3300/0
  987. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  988. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.1055' type 4
  989. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187cd3380 from v2:192.168.32.69:3300/0
  990. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 preprocess_query osd_beacon(pgs [2.c88,2.f8,2.121,3.61,2.271,2.621,2.602,2.57a,2.faa,2.ecb,2.d43,2.23,2.bcb,2.f9c,2.534,2.f2d,2.e5d,2.a25,18.75,2.525,2.895,2.645,2.7a6,2.33f,2.29f,3.27,2.207,2.96f,2.92f] lec 1452893 last_purged_snaps_scrub 2023-05-04T11:23:44.023232+0200 v1452894) v2 from osd.1055 v2:192.168.32.90:6808/6258
  991. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to osd.1055 v2:192.168.32.90:6808/6258 via v2:192.168.32.69:3300/0 for request osd_beacon(pgs [2.c88,2.f8,2.121,3.61,2.271,2.621,2.602,2.57a,2.faa,2.ecb,2.d43,2.23,2.bcb,2.f9c,2.534,2.f2d,2.e5d,2.a25,18.75,2.525,2.895,2.645,2.7a6,2.33f,2.29f,3.27,2.207,2.96f,2.92f] lec 1452893 last_purged_snaps_scrub 2023-05-04T11:23:44.023232+0200 v1452894) v2
  992. 2023-05-04T12:44:08.266+0200 7ff6b2722700 7 mon.ceph-01@0(leader).osd e1452894 prepare_update osd_beacon(pgs [2.c88,2.f8,2.121,3.61,2.271,2.621,2.602,2.57a,2.faa,2.ecb,2.d43,2.23,2.bcb,2.f9c,2.534,2.f2d,2.e5d,2.a25,18.75,2.525,2.895,2.645,2.7a6,2.33f,2.29f,3.27,2.207,2.96f,2.92f] lec 1452893 last_purged_snaps_scrub 2023-05-04T11:23:44.023232+0200 v1452894) v2 from osd.1055 v2:192.168.32.90:6808/6258
  993. 2023-05-04T12:44:08.266+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 prepare_beacon osd_beacon(pgs [2.c88,2.f8,2.121,3.61,2.271,2.621,2.602,2.57a,2.faa,2.ecb,2.d43,2.23,2.bcb,2.f9c,2.534,2.f2d,2.e5d,2.a25,18.75,2.525,2.895,2.645,2.7a6,2.33f,2.29f,3.27,2.207,2.96f,2.92f] lec 1452893 last_purged_snaps_scrub 2023-05-04T11:23:44.023232+0200 v1452894) v2 from osd.1055
  994. 2023-05-04T12:44:08.431+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754294 encode_full log v 41754294
  995. 2023-05-04T12:44:08.431+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754294 encode_pending v41754295
  996. 2023-05-04T12:44:08.450+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  997. 2023-05-04T12:44:08.450+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 update_from_paxos
  998. 2023-05-04T12:44:08.450+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 update_from_paxos version 41754295 summary v 41754294
  999. 2023-05-04T12:44:08.450+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 update_from_paxos latest full 41754294
  1000. 2023-05-04T12:44:08.450+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754295 update_from_paxos applying incremental log 41754295 2023-05-04T12:44:07.344120+0200 mgr.ceph-03 (mgr.204968658) 117209 : cluster [DBG] pgmap v123477: 25065 pgs: 1 active+clean+scrubbing, 25036 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 294 MiB/s rd, 347 MiB/s wr, 3.91k op/s
  1001. 2023-05-04T12:44:08.451+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 check_subs
  1002. 2023-05-04T12:44:08.451+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  1003. 2023-05-04T12:44:08.451+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  1004. 2023-05-04T12:44:08.452+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  1005. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065856
  1006. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065856 service_map e3257846 0 progress events
  1007. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  1008. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  1009. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 create_pending v 41754296
  1010. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754295 _updated_log for mgr.204968658 192.168.32.67:0/63
  1011. 2023-05-04T12:44:08.453+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869c34a0 0x55e188059c80 log(last 117209) v1
  1012. 2023-05-04T12:44:08.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579] via mon.4 v2:192.168.32.69:3300/0
  1013. 2023-05-04T12:44:08.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1014. 2023-05-04T12:44:08.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-11' type 2
  1015. 2023-05-04T12:44:08.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186b69080 from v2:192.168.32.69:3300/0
  1016. 2023-05-04T12:44:08.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(166183211/ceph-11 up:active seq=3084456 v892362) v8 from mds.2 [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579]
  1017. 2023-05-04T12:44:08.830+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(166183211/ceph-11 up:active seq=3084456 v892362) v8 from mds.2 [v2:192.168.32.75:6800/4144728579,v1:192.168.32.75:6801/4144728579] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1018. 2023-05-04T12:44:08.830+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 166183211
  1019. 2023-05-04T12:44:08.830+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(166183211/ceph-11 up:active seq=3084456 v892362) v8 noting time
  1020. 2023-05-04T12:44:08.830+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186974780 0x55e186d45080 mdsbeacon(166183211/ceph-11 up:active seq=3084456 v892362) v8
  1021. 2023-05-04T12:44:08.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125] via mon.4 v2:192.168.32.69:3300/0
  1022. 2023-05-04T12:44:08.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1023. 2023-05-04T12:44:08.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-23' type 2
  1024. 2023-05-04T12:44:08.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d45080 from v2:192.168.32.69:3300/0
  1025. 2023-05-04T12:44:08.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(195341627/ceph-23 up:active seq=951818 v892362) v8 from mds.1 [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125]
  1026. 2023-05-04T12:44:08.936+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(195341627/ceph-23 up:active seq=951818 v892362) v8 from mds.1 [v2:192.168.32.87:6800/1264186125,v1:192.168.32.87:6801/1264186125] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1027. 2023-05-04T12:44:08.936+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 195341627
  1028. 2023-05-04T12:44:08.936+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(195341627/ceph-23 up:active seq=951818 v892362) v8 noting time
  1029. 2023-05-04T12:44:08.936+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e18699e5a0 0x55e18a084840 mdsbeacon(195341627/ceph-23 up:active seq=951818 v892362) v8
  1030. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.68:0/63 via mon.3 v2:192.168.32.68:3300/0
  1031. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1032. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-25' type 16
  1033. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1884fd180 from v2:192.168.32.68:3300/0
  1034. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207635505 192.168.32.68:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-25(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207635505, , 0) v10
  1035. 2023-05-04T12:44:09.098+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  1036. 2023-05-04T12:44:09.098+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207635505
  1037. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207635505
  1038. 2023-05-04T12:44:09.098+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  1039. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.66:0/63 via mon.4 v2:192.168.32.69:3300/0
  1040. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1041. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-02' type 16
  1042. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a112c80 from v2:192.168.32.69:3300/0
  1043. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315386 192.168.32.66:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-02(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315386, , 0) v10
  1044. 2023-05-04T12:44:09.176+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  1045. 2023-05-04T12:44:09.176+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315386
  1046. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315386
  1047. 2023-05-04T12:44:09.176+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  1048. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from osd [v2:192.168.32.94:6800/5439,v1:192.168.32.94:6801/5439] via mon.4 v2:192.168.32.69:3300/0
  1049. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile osd
  1050. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'osd.1080' type 4
  1051. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18b8c6000 from v2:192.168.32.69:3300/0
  1052. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 preprocess_query osd_beacon(pgs [2.f10,2.5a8,2.7c0,2.140,2.d41,2.401,2.5b1,2.1d2,2.152,2.36a,2.972,2.e53,2.c5b,2.83b,2.ffb,2.524,2.8a4,2.f3d,2.215,2.625,2.52e,2.8a6,3.1e,2.8de,2.d9e,1.f,2.227,2.98f] lec 1452893 last_purged_snaps_scrub 2023-05-04T12:08:59.570522+0200 v1452894) v2 from osd.1080 v2:192.168.32.94:6800/5439
  1053. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to osd.1080 v2:192.168.32.94:6800/5439 via v2:192.168.32.69:3300/0 for request osd_beacon(pgs [2.f10,2.5a8,2.7c0,2.140,2.d41,2.401,2.5b1,2.1d2,2.152,2.36a,2.972,2.e53,2.c5b,2.83b,2.ffb,2.524,2.8a4,2.f3d,2.215,2.625,2.52e,2.8a6,3.1e,2.8de,2.d9e,1.f,2.227,2.98f] lec 1452893 last_purged_snaps_scrub 2023-05-04T12:08:59.570522+0200 v1452894) v2
  1054. 2023-05-04T12:44:09.177+0200 7ff6b2722700 7 mon.ceph-01@0(leader).osd e1452894 prepare_update osd_beacon(pgs [2.f10,2.5a8,2.7c0,2.140,2.d41,2.401,2.5b1,2.1d2,2.152,2.36a,2.972,2.e53,2.c5b,2.83b,2.ffb,2.524,2.8a4,2.f3d,2.215,2.625,2.52e,2.8a6,3.1e,2.8de,2.d9e,1.f,2.227,2.98f] lec 1452893 last_purged_snaps_scrub 2023-05-04T12:08:59.570522+0200 v1452894) v2 from osd.1080 v2:192.168.32.94:6800/5439
  1055. 2023-05-04T12:44:09.177+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 prepare_beacon osd_beacon(pgs [2.f10,2.5a8,2.7c0,2.140,2.d41,2.401,2.5b1,2.1d2,2.152,2.36a,2.972,2.e53,2.c5b,2.83b,2.ffb,2.524,2.8a4,2.f3d,2.215,2.625,2.52e,2.8a6,3.1e,2.8de,2.d9e,1.f,2.227,2.98f] lec 1452893 last_purged_snaps_scrub 2023-05-04T12:08:59.570522+0200 v1452894) v2 from osd.1080
  1056. 2023-05-04T12:44:09.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806] via mon.4 v2:192.168.32.69:3300/0
  1057. 2023-05-04T12:44:09.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1058. 2023-05-04T12:44:09.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-13' type 2
  1059. 2023-05-04T12:44:09.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18a084840 from v2:192.168.32.69:3300/0
  1060. 2023-05-04T12:44:09.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(164509948/ceph-13 up:standby seq=3067735 v888115) v8 from mds.? [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806]
  1061. 2023-05-04T12:44:09.251+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(164509948/ceph-13 up:standby seq=3067735 v888115) v8 from mds.? [v2:192.168.32.77:6800/3997548806,v1:192.168.32.77:6801/3997548806] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1062. 2023-05-04T12:44:09.251+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 164509948
  1063. 2023-05-04T12:44:09.251+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(164509948/ceph-13 up:standby seq=3067735 v888115) v8 noting time
  1064. 2023-05-04T12:44:09.251+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869eb770 0x55e187410b00 mdsbeacon(164509948/ceph-13 up:standby seq=3067735 v888115) v8
  1065. 2023-05-04T12:44:09.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765] via mon.4 v2:192.168.32.69:3300/0
  1066. 2023-05-04T12:44:09.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1067. 2023-05-04T12:44:09.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-10' type 2
  1068. 2023-05-04T12:44:09.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187410b00 from v2:192.168.32.69:3300/0
  1069. 2023-05-04T12:44:09.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(206920672/ceph-10 up:standby seq=62643 v892263) v8 from mds.? [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765]
  1070. 2023-05-04T12:44:09.388+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(206920672/ceph-10 up:standby seq=62643 v892263) v8 from mds.? [v2:192.168.32.74:6800/3586644765,v1:192.168.32.74:6801/3586644765] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1071. 2023-05-04T12:44:09.388+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 206920672
  1072. 2023-05-04T12:44:09.388+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(206920672/ceph-10 up:standby seq=62643 v892263) v8 noting time
  1073. 2023-05-04T12:44:09.388+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ead770 0x55e188083340 mdsbeacon(206920672/ceph-10 up:standby seq=62643 v892263) v8
  1074. 2023-05-04T12:44:09.504+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  1075. 2023-05-04T12:44:09.504+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1076. 2023-05-04T12:44:09.504+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  1077. 2023-05-04T12:44:09.504+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1902865a0 from v2:192.168.32.68:3300/0
  1078. 2023-05-04T12:44:09.504+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request monmgrreport(gid 204968658, 0 checks, 0 progress events) v3
  1079. 2023-05-04T12:44:09.504+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgrstat prepare_report 25065 pgs: 28 active+clean+scrubbing+deep, 25036 active+clean, 1 active+clean+scrubbing; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 295 MiB/s rd, 364 MiB/s wr, 4.03k op/s, 0 health checks, 0 progress events
  1080. 2023-05-04T12:44:09.531+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  1081. 2023-05-04T12:44:09.531+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1082. 2023-05-04T12:44:09.531+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  1083. 2023-05-04T12:44:09.531+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e18856d180 from v2:192.168.32.68:3300/0
  1084. 2023-05-04T12:44:09.531+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204968658 192.168.32.67:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-03(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204968658, [v2:192.168.32.67:6800/63,v1:192.168.32.67:6801/63], 1) v10
  1085. 2023-05-04T12:44:09.531+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  1086. 2023-05-04T12:44:09.531+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204968658
  1087. 2023-05-04T12:44:09.531+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  1088. 2023-05-04T12:44:09.555+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).mgrstat 63065857
  1089. 2023-05-04T12:44:09.555+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  1090. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  1091. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1092. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  1093. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186eb3a40 from v2:192.168.32.68:3300/0
  1094. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 preprocess_query log(1 entries from seq 117210 at 2023-05-04T12:44:09.502924+0200) v1 from mgr.204968658 192.168.32.67:0/63
  1095. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 preprocess_log log(1 entries from seq 117210 at 2023-05-04T12:44:09.502924+0200) v1 from mgr.204968658
  1096. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 prepare_update log(1 entries from seq 117210 at 2023-05-04T12:44:09.502924+0200) v1 from mgr.204968658 192.168.32.67:0/63
  1097. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 prepare_log log(1 entries from seq 117210 at 2023-05-04T12:44:09.502924+0200) v1 from mgr.204968658
  1098. 2023-05-04T12:44:09.559+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 logging 2023-05-04T12:44:09.502924+0200 mgr.ceph-03 (mgr.204968658) 117210 : cluster [DBG] pgmap v123478: 25065 pgs: 1 active+clean+scrubbing, 25036 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 295 MiB/s rd, 364 MiB/s wr, 4.03k op/s
  1099. 2023-05-04T12:44:09.577+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e186408800 (start) method 0 payload 0
  1100. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e186408800 no session
  1101. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _ms_dispatch new session 0x55e187589d40 MonSession(client.? v1:192.168.32.64:0/2403974933 is open , features 0x3f01cfb8ffedffff (luminous)) features 0x3f01cfb8ffedffff
  1102. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 0 34 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/2403974933
  1103. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=34
  1104. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 _assign_global_id 208539520 (max 208554096)
  1105. 2023-05-04T12:44:09.577+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186c453b0 0x55e18824a4e0 auth_reply(proto 2 0 (0) Success) v1
  1106. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 2 36 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/2403974933
  1107. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=36
  1108. 2023-05-04T12:44:09.577+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e187589d40 con 0x55e186408800 addr v1:192.168.32.64:0/2403974933 MonSession(client.? v1:192.168.32.64:0/2403974933 is open , features 0x3f01cfb8ffedffff (luminous))
  1109. 2023-05-04T12:44:09.577+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869452c0 0x55e186b224e0 auth_reply(proto 2 0 (0) Success) v1
  1110. 2023-05-04T12:44:09.577+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  1111. 2023-05-04T12:44:09.577+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 update_from_paxos
  1112. 2023-05-04T12:44:09.577+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754295 update_from_paxos version 41754295 summary v 41754295
  1113. 2023-05-04T12:44:09.577+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  1114. 2023-05-04T12:44:09.577+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e18641e000 (start) method 2 payload 22
  1115. 2023-05-04T12:44:09.577+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e18641e000 (more) method 2 payload 132
  1116. 2023-05-04T12:44:09.577+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e1869c1d40 con 0x55e18641e000 addr - MonSession(unknown.0 is open , features 0x0 (unknown))
  1117. 2023-05-04T12:44:09.577+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  1118. 2023-05-04T12:44:09.578+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  1119. 2023-05-04T12:44:09.579+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065857
  1120. 2023-05-04T12:44:09.579+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065857 service_map e3257846 0 progress events
  1121. 2023-05-04T12:44:09.579+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  1122. 2023-05-04T12:44:09.579+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  1123. 2023-05-04T12:44:09.579+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065857
  1124. 2023-05-04T12:44:09.579+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({config=0+,monmap=0+}) v3
  1125. 2023-05-04T12:44:09.579+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config check_sub next 0 have 2783
  1126. 2023-05-04T12:44:09.579+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config refresh_config crush_location for remote_host gnosis is {}
  1127. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config maybe_send_config to client.? (changed)
  1128. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config send_config to client.?
  1129. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).monmap v7 check_sub monmap next 0 have 7
  1130. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e186408800 v1:192.168.32.64:0/2403974933
  1131. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? v1:192.168.32.64:0/2403974933
  1132. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e187589d40 client.? v1:192.168.32.64:0/2403974933 features 0x3f01cfb8ffedffff
  1133. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e18641e000 session 0x55e1869c1d40 registering session for 192.168.32.64:0/2403974933
  1134. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_mon_get_map
  1135. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({config=0+,monmap=0+}) v3
  1136. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config check_sub next 0 have 2783
  1137. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config refresh_config crush_location for remote_host gnosis is {}
  1138. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config maybe_send_config to client.? (changed)
  1139. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config send_config to client.?
  1140. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader).monmap v7 check_sub monmap next 0 have 7
  1141. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e18641e000 192.168.32.64:0/2403974933
  1142. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? 192.168.32.64:0/2403974933
  1143. 2023-05-04T12:44:09.580+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e1869c1d40 client.? 192.168.32.64:0/2403974933 features 0x3f01cfb8ffedffff
  1144. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  1145. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1146. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  1147. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186e25200 from v2:192.168.32.68:3300/0
  1148. 2023-05-04T12:44:09.593+0200 7ff6b2722700 0 mon.ceph-01@0(leader) e7 handle_command mon_command({"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"} v 0) v1
  1149. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _allowed_command capable
  1150. 2023-05-04T12:44:09.593+0200 7ff6b2722700 0 log_channel(audit) log [INF] : from='mgr.204968658 ' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"}]: dispatch
  1151. 2023-05-04T12:44:09.593+0200 7ff6b2722700 7 mon.ceph-01@0(leader).config prepare_update mon_command({"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"} v 0) v1 from mgr.204968658 192.168.32.67:0/63
  1152. 2023-05-04T12:44:09.593+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ec1b30 0x55e18687d040 mon_command_ack([{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"}]=0 v2783) v1
  1153. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mon [v2:192.168.32.68:3300/0,v1:192.168.32.68:6789/0] via mon.3 v2:192.168.32.68:3300/0
  1154. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow *
  1155. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mon.' type 1
  1156. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186d2b500 from v2:192.168.32.68:3300/0
  1157. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 preprocess_query log(1 entries from seq 987 at 2023-05-04T12:44:09.594011+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  1158. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 preprocess_log log(1 entries from seq 987 at 2023-05-04T12:44:09.594011+0200) v1 from mon.3
  1159. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 prepare_update log(1 entries from seq 987 at 2023-05-04T12:44:09.594011+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  1160. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 prepare_log log(1 entries from seq 987 at 2023-05-04T12:44:09.594011+0200) v1 from mon.3
  1161. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 logging 2023-05-04T12:44:09.594011+0200 mon.ceph-25 (mon.3) 987 : audit [INF] from='mgr.204968658 192.168.32.67:0/63' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"}]: dispatch
  1162. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 preprocess_query log(1 entries from seq 1356 at 2023-05-04T12:44:09.594473+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  1163. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 preprocess_log log(1 entries from seq 1356 at 2023-05-04T12:44:09.594473+0200) v1 from mon.0
  1164. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 prepare_update log(1 entries from seq 1356 at 2023-05-04T12:44:09.594473+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  1165. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 prepare_log log(1 entries from seq 1356 at 2023-05-04T12:44:09.594473+0200) v1 from mon.0
  1166. 2023-05-04T12:44:09.593+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754295 logging 2023-05-04T12:44:09.594473+0200 mon.ceph-01 (mon.0) 1356 : audit [INF] from='mgr.204968658 ' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"}]: dispatch
  1167. 2023-05-04T12:44:09.609+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754295 encode_full log v 41754295
  1168. 2023-05-04T12:44:09.610+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754295 encode_pending v41754296
  1169. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader) e7 refresh_from_paxos
  1170. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754296 update_from_paxos
  1171. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754296 update_from_paxos version 41754296 summary v 41754295
  1172. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754296 update_from_paxos latest full 41754295
  1173. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754296 update_from_paxos applying incremental log 41754296 2023-05-04T12:44:09.502924+0200 mgr.ceph-03 (mgr.204968658) 117210 : cluster [DBG] pgmap v123478: 25065 pgs: 1 active+clean+scrubbing, 25036 active+clean, 28 active+clean+scrubbing+deep; 3.3 PiB data, 4.1 PiB used, 9.0 PiB / 13 PiB avail; 295 MiB/s rd, 364 MiB/s wr, 4.03k op/s
  1174. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754296 update_from_paxos applying incremental log 41754296 2023-05-04T12:44:09.594011+0200 mon.ceph-25 (mon.3) 987 : audit [INF] from='mgr.204968658 192.168.32.67:0/63' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"}]: dispatch
  1175. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754296 update_from_paxos applying incremental log 41754296 2023-05-04T12:44:09.594473+0200 mon.ceph-01 (mon.0) 1356 : audit [INF] from='mgr.204968658 ' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/mirror_snapshot_schedule"}]: dispatch
  1176. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754296 check_subs
  1177. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).auth v48228 update_from_paxos
  1178. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).config load_config got 78 keys
  1179. 2023-05-04T12:44:09.620+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgr e2589 prime_mgr_client
  1180. 2023-05-04T12:44:09.621+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat 63065857
  1181. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat update_from_paxos v63065857 service_map e3257846 0 progress events
  1182. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).mgrstat check_subs
  1183. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).health update_from_paxos
  1184. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 10 mon.ceph-01@0(leader).log v41754296 create_pending v 41754297
  1185. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mgr.204968658 192.168.32.67:0/63
  1186. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186974780 0x55e1869acc00 log(last 117210) v1
  1187. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mon.3 v2:192.168.32.68:3300/0
  1188. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186e600f0 0x55e1869dcd80 log(last 987) v1
  1189. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mon.0 v2:192.168.32.65:3300/0
  1190. 2023-05-04T12:44:09.622+0200 7ff6b0f1f700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e18699fe00 0x55e187243e00 log(last 1356) v1
  1191. 2023-05-04T12:44:09.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521] via mon.2 v2:192.168.32.67:3300/0
  1192. 2023-05-04T12:44:09.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1193. 2023-05-04T12:44:09.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-17' type 2
  1194. 2023-05-04T12:44:09.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187448dc0 from v2:192.168.32.67:3300/0
  1195. 2023-05-04T12:44:09.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(174654745/ceph-17 up:active seq=2485934 v892362) v8 from mds.0 [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521]
  1196. 2023-05-04T12:44:09.686+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(174654745/ceph-17 up:active seq=2485934 v892362) v8 from mds.0 [v2:192.168.32.81:6800/4017975521,v1:192.168.32.81:6801/4017975521] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1197. 2023-05-04T12:44:09.686+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 174654745
  1198. 2023-05-04T12:44:09.686+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(174654745/ceph-17 up:active seq=2485934 v892362) v8 noting time
  1199. 2023-05-04T12:44:09.686+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869ea0f0 0x55e18a13fb80 mdsbeacon(174654745/ceph-17 up:active seq=2485934 v892362) v8
  1200. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mon [v2:192.168.32.68:3300/0,v1:192.168.32.68:6789/0] via mon.3 v2:192.168.32.68:3300/0
  1201. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow *
  1202. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mon.' type 1
  1203. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186f06000 from v2:192.168.32.68:3300/0
  1204. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_query log(1 entries from seq 988 at 2023-05-04T12:44:09.863348+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  1205. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_log log(1 entries from seq 988 at 2023-05-04T12:44:09.863348+0200) v1 from mon.3
  1206. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_update log(1 entries from seq 988 at 2023-05-04T12:44:09.863348+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  1207. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_log log(1 entries from seq 988 at 2023-05-04T12:44:09.863348+0200) v1 from mon.3
  1208. 2023-05-04T12:44:09.862+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 logging 2023-05-04T12:44:09.863348+0200 mon.ceph-25 (mon.3) 988 : audit [DBG] from='client.? 192.168.32.64:0/1617926726' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch
  1209. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.65:0/63 via mon.3 v2:192.168.32.68:3300/0
  1210. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1211. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-01' type 16
  1212. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e187924280 from v2:192.168.32.68:3300/0
  1213. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.207315376 192.168.32.65:0/63 via v2:192.168.32.68:3300/0 for request mgrbeacon mgr.ceph-01(e4ece518-f2cb-4708-b00f-b6bf511e91d9,207315376, , 0) v10
  1214. 2023-05-04T12:44:09.893+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  1215. 2023-05-04T12:44:09.893+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 207315376
  1216. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 207315376
  1217. 2023-05-04T12:44:09.893+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  1218. 2023-05-04T12:44:09.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914] via mon.3 v2:192.168.32.68:3300/0
  1219. 2023-05-04T12:44:09.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1220. 2023-05-04T12:44:09.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-24' type 2
  1221. 2023-05-04T12:44:09.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186b68dc0 from v2:192.168.32.68:3300/0
  1222. 2023-05-04T12:44:09.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(190565023/ceph-24 up:active seq=1272990 v892362) v8 from mds.7 [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914]
  1223. 2023-05-04T12:44:09.979+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(190565023/ceph-24 up:active seq=1272990 v892362) v8 from mds.7 [v2:192.168.32.88:6800/3216233914,v1:192.168.32.88:6801/3216233914] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1224. 2023-05-04T12:44:09.979+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 190565023
  1225. 2023-05-04T12:44:09.979+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(190565023/ceph-24 up:active seq=1272990 v892362) v8 noting time
  1226. 2023-05-04T12:44:09.979+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e198aa1590 0x55e186a49080 mdsbeacon(190565023/ceph-24 up:active seq=1272990 v892362) v8
  1227. 2023-05-04T12:44:10.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396] via mon.4 v2:192.168.32.69:3300/0
  1228. 2023-05-04T12:44:10.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1229. 2023-05-04T12:44:10.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-14' type 2
  1230. 2023-05-04T12:44:10.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e188083340 from v2:192.168.32.69:3300/0
  1231. 2023-05-04T12:44:10.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(201810535/ceph-14 up:active seq=496710 v892362) v8 from mds.5 [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396]
  1232. 2023-05-04T12:44:10.011+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(201810535/ceph-14 up:active seq=496710 v892362) v8 from mds.5 [v2:192.168.32.78:6800/182056396,v1:192.168.32.78:6801/182056396] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1233. 2023-05-04T12:44:10.011+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 201810535
  1234. 2023-05-04T12:44:10.011+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(201810535/ceph-14 up:active seq=496710 v892362) v8 noting time
  1235. 2023-05-04T12:44:10.011+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186c453b0 0x55e186891600 mdsbeacon(201810535/ceph-14 up:active seq=496710 v892362) v8
  1236. 2023-05-04T12:44:10.042+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1863ca400 (start) method 0 payload 0
  1237. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e1863ca400 no session
  1238. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _ms_dispatch new session 0x55e186c41440 MonSession(client.? v1:192.168.32.64:0/2693386286 is open , features 0x3f01cfb8ffedffff (luminous)) features 0x3f01cfb8ffedffff
  1239. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 0 34 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/2693386286
  1240. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=34
  1241. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 _assign_global_id 208539525 (max 208554096)
  1242. 2023-05-04T12:44:10.042+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869c34a0 0x55e18607c4e0 auth_reply(proto 2 0 (0) Success) v1
  1243. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 preprocess_query auth(proto 2 36 bytes epoch 0) v1 from client.? v1:192.168.32.64:0/2693386286
  1244. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 prep_auth() blob_size=36
  1245. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186c41440 con 0x55e1863ca400 addr v1:192.168.32.64:0/2693386286 MonSession(client.? v1:192.168.32.64:0/2693386286 is open , features 0x3f01cfb8ffedffff (luminous))
  1246. 2023-05-04T12:44:10.042+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186944f00 0x55e186b741a0 auth_reply(proto 2 0 (0) Success) v1
  1247. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1863ca400 v1:192.168.32.64:0/2693386286
  1248. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? v1:192.168.32.64:0/2693386286
  1249. 2023-05-04T12:44:10.042+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e186c41440 client.? v1:192.168.32.64:0/2693386286 features 0x3f01cfb8ffedffff
  1250. 2023-05-04T12:44:10.042+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1861c2400 (start) method 2 payload 22
  1251. 2023-05-04T12:44:10.042+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1861c2400 (more) method 2 payload 132
  1252. 2023-05-04T12:44:10.043+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186c81680 con 0x55e1861c2400 addr - MonSession(unknown.0 is open , features 0x0 (unknown))
  1253. 2023-05-04T12:44:10.043+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1861c2400 -
  1254. 2023-05-04T12:44:10.043+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session unknown.0
  1255. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.69:0/63 via mon.4 v2:192.168.32.69:3300/0
  1256. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1257. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-26' type 16
  1258. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1874c7b80 from v2:192.168.32.69:3300/0
  1259. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 no_reply to mgr.204935384 192.168.32.69:0/63 via v2:192.168.32.69:3300/0 for request mgrbeacon mgr.ceph-26(e4ece518-f2cb-4708-b00f-b6bf511e91d9,204935384, , 0) v10
  1260. 2023-05-04T12:44:10.060+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  1261. 2023-05-04T12:44:10.060+0200 7ff6b2722700 4 mon.ceph-01@0(leader).mgr e2589 beacon from 204935384
  1262. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 from existing standby 204935384
  1263. 2023-05-04T12:44:10.060+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mgr e2589 no change
  1264. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mon [v2:192.168.32.67:3300/0,v1:192.168.32.67:6789/0] via mon.2 v2:192.168.32.67:3300/0
  1265. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow *
  1266. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mon.' type 1
  1267. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e188d7da40 from v2:192.168.32.67:3300/0
  1268. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_query log(1 entries from seq 1185 at 2023-05-04T12:44:10.329507+0200) v1 from mon.2 v2:192.168.32.67:3300/0
  1269. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_log log(1 entries from seq 1185 at 2023-05-04T12:44:10.329507+0200) v1 from mon.2
  1270. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_update log(1 entries from seq 1185 at 2023-05-04T12:44:10.329507+0200) v1 from mon.2 v2:192.168.32.67:3300/0
  1271. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_log log(1 entries from seq 1185 at 2023-05-04T12:44:10.329507+0200) v1 from mon.2
  1272. 2023-05-04T12:44:10.329+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 logging 2023-05-04T12:44:10.329507+0200 mon.ceph-03 (mon.2) 1185 : audit [DBG] from='client.? 192.168.32.64:0/2447007496' entity='client.admin' cmd=[{"prefix": "df"}]: dispatch
  1273. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mgr 192.168.32.67:0/63 via mon.3 v2:192.168.32.68:3300/0
  1274. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mgr
  1275. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mgr.ceph-03' type 16
  1276. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e1869acc00 from v2:192.168.32.68:3300/0
  1277. 2023-05-04T12:44:10.481+0200 7ff6b2722700 0 mon.ceph-01@0(leader) e7 handle_command mon_command({"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/trash_purge_schedule"} v 0) v1
  1278. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _allowed_command capable
  1279. 2023-05-04T12:44:10.481+0200 7ff6b2722700 0 log_channel(audit) log [INF] : from='mgr.204968658 ' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/trash_purge_schedule"}]: dispatch
  1280. 2023-05-04T12:44:10.481+0200 7ff6b2722700 7 mon.ceph-01@0(leader).config prepare_update mon_command({"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/trash_purge_schedule"} v 0) v1 from mgr.204968658 192.168.32.67:0/63
  1281. 2023-05-04T12:44:10.481+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186acda40 0x55e1873a0000 mon_command_ack([{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/trash_purge_schedule"}]=0 v2783) v1
  1282. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mon [v2:192.168.32.68:3300/0,v1:192.168.32.68:6789/0] via mon.3 v2:192.168.32.68:3300/0
  1283. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow *
  1284. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mon.' type 1
  1285. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186f26fc0 from v2:192.168.32.68:3300/0
  1286. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_query log(1 entries from seq 989 at 2023-05-04T12:44:10.481716+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  1287. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_log log(1 entries from seq 989 at 2023-05-04T12:44:10.481716+0200) v1 from mon.3
  1288. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_update log(1 entries from seq 989 at 2023-05-04T12:44:10.481716+0200) v1 from mon.3 v2:192.168.32.68:3300/0
  1289. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_log log(1 entries from seq 989 at 2023-05-04T12:44:10.481716+0200) v1 from mon.3
  1290. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 logging 2023-05-04T12:44:10.481716+0200 mon.ceph-25 (mon.3) 989 : audit [INF] from='mgr.204968658 192.168.32.67:0/63' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/trash_purge_schedule"}]: dispatch
  1291. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_query log(1 entries from seq 1357 at 2023-05-04T12:44:10.482285+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  1292. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 preprocess_log log(1 entries from seq 1357 at 2023-05-04T12:44:10.482285+0200) v1 from mon.0
  1293. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_update log(1 entries from seq 1357 at 2023-05-04T12:44:10.482285+0200) v1 from mon.0 v2:192.168.32.65:3300/0
  1294. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 prepare_log log(1 entries from seq 1357 at 2023-05-04T12:44:10.482285+0200) v1 from mon.0
  1295. 2023-05-04T12:44:10.481+0200 7ff6b2722700 10 mon.ceph-01@0(leader).log v41754296 logging 2023-05-04T12:44:10.482285+0200 mon.ceph-01 (mon.0) 1357 : audit [INF] from='mgr.204968658 ' entity='mgr.ceph-03' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/ceph-03/trash_purge_schedule"}]: dispatch
  1296. 2023-05-04T12:44:10.508+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1863ce400 (start) method 2 payload 22
  1297. 2023-05-04T12:44:10.508+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader).auth v48228 _assign_global_id 208539530 (max 208554096)
  1298. 2023-05-04T12:44:10.508+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e1863ce400 (more) method 2 payload 36
  1299. 2023-05-04T12:44:10.508+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186b4e900 con 0x55e1863ce400 addr - MonSession(unknown.0 is open , features 0x0 (unknown))
  1300. 2023-05-04T12:44:10.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1863ce400 -
  1301. 2023-05-04T12:44:10.508+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session unknown.0
  1302. 2023-05-04T12:44:10.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 received forwarded message from mds [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724] via mon.4 v2:192.168.32.69:3300/0
  1303. 2023-05-04T12:44:10.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 caps are allow profile mds
  1304. 2023-05-04T12:44:10.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 entity name 'mds.ceph-12' type 2
  1305. 2023-05-04T12:44:10.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 mesg 0x55e186891600 from v2:192.168.32.69:3300/0
  1306. 2023-05-04T12:44:10.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_query mdsbeacon(165837172/ceph-12 up:standby seq=3084694 v888048) v8 from mds.? [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724]
  1307. 2023-05-04T12:44:10.607+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 preprocess_beacon mdsbeacon(165837172/ceph-12 up:standby seq=3084694 v888048) v8 from mds.? [v2:192.168.32.76:6800/2103064724,v1:192.168.32.76:6801/2103064724] compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
  1308. 2023-05-04T12:44:10.607+0200 7ff6b2722700 10 mon.ceph-01@0(leader).mds e892362 preprocess_beacon: GID exists in map: 165837172
  1309. 2023-05-04T12:44:10.607+0200 7ff6b2722700 5 mon.ceph-01@0(leader).mds e892362 _note_beacon mdsbeacon(165837172/ceph-12 up:standby seq=3084694 v888048) v8 noting time
  1310. 2023-05-04T12:44:10.607+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186b28ff0 0x55e1858d4840 mdsbeacon(165837172/ceph-12 up:standby seq=3084694 v888048) v8
  1311. 2023-05-04T12:44:10.619+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754296 encode_full log v 41754296
  1312. 2023-05-04T12:44:10.619+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).log v41754296 encode_pending v41754297
  1313. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 e1452894: 1260 total, 1260 up, 1260 in
  1314. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 1 mon.ceph-01@0(leader).osd e1452894 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 71303168 full_alloc: 205520896 kv_alloc: 738197504
  1315. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 tick balancer inc cache_bytes: 119008 inc comtd_bytes: 71303168 inc used_bytes: 119008 inc num_osdmaps: 420
  1316. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 tick balancer full cache_bytes: 136022326 full comtd_bytes: 205520896 full used_bytes: 136022326 full num_osdmaps: 234
  1317. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 should_prune could only prune 40 epochs (1452354..1452394), which is less than the required minimum (10000)
  1318. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 try_prune_purged_snaps max_prune 100
  1319. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 try_prune_purged_snaps actually pruned 0
  1320. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 min_last_epoch_clean 1452871
  1321. 2023-05-04T12:44:11.205+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).auth v48228 auth
  1322. 2023-05-04T12:44:11.206+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health tick
  1323. 2023-05-04T12:44:11.206+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health check_member_health avail 99% total 1.1 TiB, used 454 MiB, avail 1.1 TiB
  1324. 2023-05-04T12:44:11.206+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).health 3645679
  1325. 2023-05-04T12:44:11.206+0200 7ff6b4f27700 10 mon.ceph-01@0(leader) e7 log_health updated 0 previous 0
  1326. 2023-05-04T12:44:11.206+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).config tick
  1327. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e1863c5c00 192.168.48.16:0/4276478727
  1328. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.182014955 192.168.48.16:0/4276478727
  1329. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e186bf9d40 client.182014955 192.168.48.16:0/4276478727 features 0x3f01cfb8ffecffff
  1330. 2023-05-04T12:44:15.561+0200 7ff6b1720700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e186408800 (start) method 2 payload 27
  1331. 2023-05-04T12:44:15.561+0200 7ff6b1720700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e186408800 (more) method 2 payload 148
  1332. 2023-05-04T12:44:15.561+0200 7ff6b1720700 10 mon.ceph-01@0(leader) e7 ms_handle_authentication session 0x55e186c3c900 con 0x55e186408800 addr - MonSession(unknown.0 is open , features 0x0 (unknown))
  1333. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e186408800 session 0x55e186c3c900 registering session for 192.168.48.16:0/4276478727
  1334. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_mon_get_map
  1335. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_subscribe mon_subscribe({config=0+,mgrmap=0+,monmap=8+,osdmap=1452895}) v3
  1336. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config check_sub next 0 have 2783
  1337. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config refresh_config crush_location for remote_host rit-pone14 is {}
  1338. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config maybe_send_config to client.182014955 (changed)
  1339. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader).config send_config to client.182014955
  1340. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader).monmap v7 check_sub monmap next 8 have 7
  1341. 2023-05-04T12:44:15.561+0200 7ff6b2722700 10 mon.ceph-01@0(leader).osd e1452894 check_osdmap_sub 0x55e192601da0 next 1452895 (onetime)
  1342. 2023-05-04T12:44:15.968+0200 7ff6b6f2b700 10 mon.ceph-01@0(leader) e7 handle_auth_request con 0x55e18641e000 (start) method 0 payload 0
  1343. 2023-05-04T12:44:15.968+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_accept con 0x55e18641e000 no session
  1344. 2023-05-04T12:44:15.968+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _ms_dispatch new session 0x55e186bf9d40 MonSession(client.? v1:192.168.32.64:0/1781445554 is open , features 0x3f01cfb8ffedffff (luminous)) features 0x3f01cfb8ffedffff
  1345. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 e1452894: 1260 total, 1260 up, 1260 in
  1346. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 1 mon.ceph-01@0(leader).osd e1452894 _set_new_cache_sizes cache_size:1020054731 inc_alloc: 71303168 full_alloc: 205520896 kv_alloc: 738197504
  1347. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 tick balancer inc cache_bytes: 119008 inc comtd_bytes: 71303168 inc used_bytes: 119008 inc num_osdmaps: 420
  1348. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 tick balancer full cache_bytes: 136022326 full comtd_bytes: 205520896 full used_bytes: 136022326 full num_osdmaps: 234
  1349. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 should_prune could only prune 40 epochs (1452354..1452394), which is less than the required minimum (10000)
  1350. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).osd e1452894 min_last_epoch_clean 1452871
  1351. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).auth v48228 auth
  1352. 2023-05-04T12:44:16.207+0200 7ff6b4f27700 10 mon.ceph-01@0(leader).config tick
  1353. 2023-05-04T12:44:18.968+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 ms_handle_reset 0x55e18641e000 v1:192.168.32.64:0/1781445554
  1354. 2023-05-04T12:44:18.968+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 reset/close on session client.? v1:192.168.32.64:0/1781445554
  1355. 2023-05-04T12:44:18.968+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 remove_session 0x55e186bf9d40 client.? v1:192.168.32.64:0/1781445554 features 0x3f01cfb8ffedffff
  1356. 2023-05-04T12:44:19.623+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_probe mon_probe(probe e4ece518-f2cb-4708-b00f-b6bf511e91d9 name ceph-02 mon_release octopus) v7
  1357. 2023-05-04T12:44:19.623+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_probe_probe mon.1 v2:192.168.32.66:3300/0mon_probe(probe e4ece518-f2cb-4708-b00f-b6bf511e91d9 name ceph-02 mon_release octopus) v7 features 4540138292840890367
  1358. 2023-05-04T12:44:19.623+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_probe mon_probe(probe e4ece518-f2cb-4708-b00f-b6bf511e91d9 name ceph-25 mon_release octopus) v7
  1359. 2023-05-04T12:44:19.623+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_probe_probe mon.3 v2:192.168.32.68:3300/0mon_probe(probe e4ece518-f2cb-4708-b00f-b6bf511e91d9 name ceph-25 mon_release octopus) v7 features 4540138292840890367
  1360. 2023-05-04T12:44:19.623+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_probe mon_probe(probe e4ece518-f2cb-4708-b00f-b6bf511e91d9 name ceph-26 mon_release octopus) v7
  1361. 2023-05-04T12:44:19.623+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 handle_probe_probe mon.4 v2:192.168.32.69:3300/0mon_probe(probe e4ece518-f2cb-4708-b00f-b6bf511e91d9 name ceph-26 mon_release octopus) v7 features 4540138292840890367
  1362. 2023-05-04T12:44:19.626+0200 7ff6b2722700 5 mon.ceph-01@0(leader).elector(4044) handle_propose from mon.1
  1363. 2023-05-04T12:44:19.626+0200 7ff6b2722700 10 mon.ceph-01@0(leader).elector(4044) handle_propose required features 2449958747315978244 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), peer features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus])
  1364. 2023-05-04T12:44:19.626+0200 7ff6b2722700 10 paxos.0).electionLogic(4044) bump_epoch4044 to 4045
  1365. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 join_election
  1366. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 _reset
  1367. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader).auth v48228 _set_mon_num_rank num 0 rank 0
  1368. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 cancel_probe_timeout (none scheduled)
  1369. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 timecheck_finish
  1370. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 scrub_event_cancel
  1371. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(leader) e7 scrub_reset
  1372. 2023-05-04T12:44:19.627+0200 7ff6b2722700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mon.3 v2:192.168.32.68:3300/0
  1373. 2023-05-04T12:44:19.627+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1868f81e0 0x55e188f7af00 log(last 988) v1
  1374. 2023-05-04T12:44:19.627+0200 7ff6b2722700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mon.2 v2:192.168.32.67:3300/0
  1375. 2023-05-04T12:44:19.627+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869743c0 0x55e186c89380 log(last 1185) v1
  1376. 2023-05-04T12:44:19.627+0200 7ff6b2722700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mon.3 v2:192.168.32.68:3300/0
  1377. 2023-05-04T12:44:19.627+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e186ead770 0x55e186f32600 log(last 989) v1
  1378. 2023-05-04T12:44:19.627+0200 7ff6b2722700 7 mon.ceph-01@0(leader).log v41754296 _updated_log for mon.0 v2:192.168.32.65:3300/0
  1379. 2023-05-04T12:44:19.627+0200 7ff6b2722700 2 mon.ceph-01@0(leader) e7 send_reply 0x55e1869eb770 0x55e187ccfc80 log(last 1357) v1
  1380. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 start_election
  1381. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 _reset
  1382. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing).auth v48228 _set_mon_num_rank num 0 rank 0
  1383. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 cancel_probe_timeout (none scheduled)
  1384. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 timecheck_finish
  1385. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 scrub_event_cancel
  1386. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 scrub_reset
  1387. 2023-05-04T12:44:19.627+0200 7ff6b2722700 0 log_channel(cluster) log [INF] : mon.ceph-01 calling monitor election
  1388. 2023-05-04T12:44:19.627+0200 7ff6b2722700 5 paxos.0).electionLogic(4045) start -- can i be leader?
  1389. 2023-05-04T12:44:19.627+0200 7ff6b2722700 1 paxos.0).electionLogic(4045) init, last seen epoch 4045, mid-election, bumping
  1390. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 paxos.0).electionLogic(4046) bump_epoch4046 to 4047
  1391. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 join_election
  1392. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 _reset
  1393. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing).auth v48228 _set_mon_num_rank num 0 rank 0
  1394. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 cancel_probe_timeout (none scheduled)
  1395. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 timecheck_finish
  1396. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 scrub_event_cancel
  1397. 2023-05-04T12:44:19.627+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 scrub_reset
  1398. 2023-05-04T12:44:19.641+0200 7ff6b2722700 1 mon.ceph-01@0(electing) e7 collect_metadata : no unique device id for : fallback method has no model nor serial'
  1399. 2023-05-04T12:44:19.641+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) handle_propose from mon.4
  1400. 2023-05-04T12:44:19.641+0200 7ff6b2722700 10 mon.ceph-01@0(electing).elector(4047) handle_propose required features 2449958747315978244 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), peer features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus])
  1401. 2023-05-04T12:44:19.641+0200 7ff6b2722700 5 paxos.0).electionLogic(4047) ignoring old propose
  1402. 2023-05-04T12:44:19.641+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) handle_propose from mon.3
  1403. 2023-05-04T12:44:19.641+0200 7ff6b2722700 10 mon.ceph-01@0(electing).elector(4047) handle_propose required features 2449958747315978244 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), peer features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus])
  1404. 2023-05-04T12:44:19.641+0200 7ff6b2722700 5 paxos.0).electionLogic(4047) ignoring old propose
  1405. 2023-05-04T12:44:19.641+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) handle_ack from mon.4
  1406. 2023-05-04T12:44:19.641+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) so far i have { mon.0: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]) }
  1407. 2023-05-04T12:44:19.642+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) handle_ack from mon.3
  1408. 2023-05-04T12:44:19.642+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) so far i have { mon.0: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), mon.4: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]) }
  1409. 2023-05-04T12:44:19.667+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) handle_ack from mon.2
  1410. 2023-05-04T12:44:19.667+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) so far i have { mon.0: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), mon.3: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), mon.4: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]) }
  1411. 2023-05-04T12:44:21.968+0200 7ff6b6f2b700 10 mon.ceph-01@0(electing) e7 handle_auth_request con 0x55e1863c5000 (start) method 0 payload 0
  1412. 2023-05-04T12:44:21.968+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 ms_handle_accept con 0x55e1863c5000 no session
  1413. 2023-05-04T12:44:21.968+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 _ms_dispatch new session 0x55e186be5200 MonSession(client.? v1:192.168.32.64:0/1781445554 is open , features 0x3f01cfb8ffedffff (luminous)) features 0x3f01cfb8ffedffff
  1414. 2023-05-04T12:44:21.968+0200 7ff6b2722700 5 mon.ceph-01@0(electing) e7 waitlisting message auth(proto 0 34 bytes epoch 0) v1
  1415. 2023-05-04T12:44:24.091+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) handle_ack from mon.1
  1416. 2023-05-04T12:44:24.091+0200 7ff6b2722700 5 mon.ceph-01@0(electing).elector(4047) so far i have { mon.0: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), mon.2: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), mon.3: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]), mon.4: features 4540138292840890367 mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]) }
  1417. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 paxos.0).electionLogic(4047) bump_epoch4047 to 4048
  1418. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 join_election
  1419. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 _reset
  1420. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing).auth v48228 _set_mon_num_rank num 0 rank 0
  1421. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 cancel_probe_timeout (none scheduled)
  1422. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 timecheck_finish
  1423. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 scrub_event_cancel
  1424. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 scrub_reset
  1425. 2023-05-04T12:44:24.091+0200 7ff6b2722700 10 mon.ceph-01@0(electing) e7 win_election epoch 4048 quorum 0,1,2,3,4 features 4540138292840890367 mon_features mon_feature_t([kraken,luminous,mimic,osdmap-prune,nautilus,octopus]) min_mon_release octopus
  1426. 2023-05-04T12:44:24.091+0200 7ff6b2722700 0 log_channel(cluster) log [INF] : mon.ceph-01 is new leader, mons ceph-01,ceph-02,ceph-03,ceph-25,ceph-26 in quorum (ranks 0,1,2,3,4)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!