API tools faq
paste
prabhasathesh

Ceph osd df tree and iostat

prabhasathesh
Nov 1st, 2023
360
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 15.32 KB | None | 0 0
raw download clone embed print report
  1. root@meghdootctr1:/home/cloud# ceph osd df tree
  2. ID CLASS WEIGHT REWEIGHT SIZE RAW USE DATA OMAP META AVAIL %USE VAR PGS STATUS TYPE NAME
  3. -1 179.46222 - 25 TiB 16 TiB 16 TiB 5.4 MiB 27 GiB 9.0 TiB 0 0 - root default
  4. -3 34.91994 - 35 TiB 23 TiB 23 TiB 7.9 MiB 38 GiB 12 TiB 65.37 1.01 - host meghdootctr1
  5. 0 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.2 TiB 1.2 MiB 5.5 GiB 1.7 TiB 65.17 1.01 45 up osd.0
  6. 11 hdd 4.98999 1.00000 5.0 TiB 3.5 TiB 3.5 TiB 1.3 MiB 5.9 GiB 1.5 TiB 69.46 1.07 46 up osd.11
  7. 12 hdd 4.98000 1.00000 5.0 TiB 3.1 TiB 3.1 TiB 1.2 MiB 5.2 GiB 1.9 TiB 62.30 0.96 46 up osd.12
  8. 18 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.1 MiB 5.6 GiB 1.7 TiB 66.62 1.03 46 up osd.18
  9. 25 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.0 MiB 5.4 GiB 1.7 TiB 65.24 1.01 44 up osd.25
  10. 28 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.1 MiB 5.3 GiB 1.7 TiB 65.11 1.01 46 up osd.28
  11. 29 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.0 MiB 5.3 GiB 1.8 TiB 63.68 0.98 46 up osd.29
  12. -5 14.95998 - 15 TiB 9.7 TiB 9.7 TiB 3.6 MiB 16 GiB 5.3 TiB 64.72 1.00 - host meghdootctr2
  13. 1 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.2 TiB 1.3 MiB 5.5 GiB 1.7 TiB 65.19 1.01 46 up osd.1
  14. 10 hdd 4.98000 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 991 KiB 5.3 GiB 1.8 TiB 63.93 0.99 46 up osd.10
  15. 17 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.3 MiB 5.5 GiB 1.7 TiB 65.05 1.01 44 up osd.17
  16. -7 19.95996 - 20 TiB 13 TiB 13 TiB 4.6 MiB 22 GiB 7.3 TiB 63.68 0.98 - host meghdootctr3
  17. 2 hdd 4.98999 1.00000 5.0 TiB 3.0 TiB 3.0 TiB 1.1 MiB 5.2 GiB 2.0 TiB 60.68 0.94 43 up osd.2
  18. 13 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.1 MiB 5.6 GiB 1.7 TiB 66.63 1.03 46 up osd.13
  19. 22 hdd 4.98999 1.00000 5.0 TiB 3.0 TiB 3.0 TiB 1.1 MiB 5.3 GiB 2.0 TiB 60.73 0.94 45 up osd.22
  20. 31 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.3 MiB 5.4 GiB 1.7 TiB 66.67 1.03 46 up osd.31
  21. -9 9.87999 - 9.9 TiB 6.2 TiB 6.2 TiB 2.2 MiB 10 GiB 3.7 TiB 62.90 0.97 - host meghdootnode1
  22. 3 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.1 MiB 5.3 GiB 1.8 TiB 63.76 0.99 47 up osd.3
  23. 9 hdd 4.89000 1.00000 4.9 TiB 3.0 TiB 3.0 TiB 1.1 MiB 5.1 GiB 1.9 TiB 62.03 0.96 43 up osd.9
  24. -17 39.90044 - 40 TiB 26 TiB 26 TiB 9.7 MiB 43 GiB 14 TiB 65.17 1.01 - host meghdootnode3
  25. 8 hdd 4.98050 1.00000 5.0 TiB 3.4 TiB 3.4 TiB 1.2 MiB 5.6 GiB 1.6 TiB 68.34 1.06 46 up osd.8
  26. 15 hdd 4.98000 1.00000 5.0 TiB 3.0 TiB 3.0 TiB 1.3 MiB 5.0 GiB 2.0 TiB 60.81 0.94 45 up osd.15
  27. 16 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.3 MiB 5.5 GiB 1.7 TiB 65.08 1.01 46 up osd.16
  28. 21 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.3 MiB 5.4 GiB 1.8 TiB 63.74 0.98 45 up osd.21
  29. 24 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.2 TiB 1.1 MiB 5.5 GiB 1.7 TiB 65.16 1.01 45 up osd.24
  30. 26 hdd 4.98999 1.00000 5.0 TiB 3.4 TiB 3.4 TiB 1.1 MiB 5.6 GiB 1.6 TiB 68.03 1.05 46 up osd.26
  31. 30 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.1 MiB 5.4 GiB 1.7 TiB 66.60 1.03 45 up osd.30
  32. 32 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.4 MiB 5.3 GiB 1.8 TiB 63.64 0.98 45 up osd.32
  33. -11 9.96100 - 10 TiB 6.6 TiB 6.6 TiB 2.5 MiB 11 GiB 3.4 TiB 65.97 1.02 - host meghnode1
  34. 6 hdd 4.98050 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.3 MiB 5.4 GiB 1.7 TiB 65.25 1.01 44 up osd.6
  35. 7 hdd 4.98050 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.1 MiB 5.5 GiB 1.7 TiB 66.70 1.03 45 up osd.7
  36. -19 0 - 0 B 0 B 0 B 0 B 0 B 0 B 0 0 - host meghnode2
  37. -15 4.98050 - 5.0 TiB 3.3 TiB 3.2 TiB 1.1 MiB 5.3 GiB 1.7 TiB 65.31 1.01 - host meghnode3
  38. 5 hdd 4.98050 1.00000 5.0 TiB 3.3 TiB 3.2 TiB 1.1 MiB 5.3 GiB 1.7 TiB 65.31 1.01 46 up osd.5
  39. -13 19.95047 - 20 TiB 13 TiB 13 TiB 4.5 MiB 22 GiB 7.0 TiB 64.80 1.00 - host meghnode4
  40. 4 hdd 4.98050 1.00000 5.0 TiB 3.1 TiB 3.1 TiB 1.2 MiB 5.2 GiB 1.9 TiB 62.36 0.96 46 up osd.4
  41. 19 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.2 TiB 1.2 MiB 5.5 GiB 1.7 TiB 65.16 1.01 45 up osd.19
  42. 20 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.0 MiB 5.6 GiB 1.7 TiB 66.62 1.03 46 up osd.20
  43. 23 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.1 MiB 5.4 GiB 1.7 TiB 65.07 1.01 46 up osd.23
  44. -21 4.98999 - 5.0 TiB 3.1 TiB 3.1 TiB 1.1 MiB 5.4 GiB 1.9 TiB 62.23 0.96 - host meghnode7
  45. 27 hdd 4.98999 1.00000 5.0 TiB 3.1 TiB 3.1 TiB 1.1 MiB 5.4 GiB 1.9 TiB 62.23 0.96 46 up osd.27
  46. -23 19.95996 - 20 TiB 13 TiB 13 TiB 4.3 MiB 21 GiB 7.1 TiB 64.34 0.99 - host meghnode8
  47. 14 hdd 4.98999 1.00000 5.0 TiB 3.3 TiB 3.3 TiB 1.1 MiB 5.5 GiB 1.7 TiB 66.63 1.03 46 up osd.14
  48. 33 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.1 MiB 5.3 GiB 1.8 TiB 63.49 0.98 44 up osd.33
  49. 34 hdd 4.98999 1.00000 5.0 TiB 3.2 TiB 3.2 TiB 1.0 MiB 5.5 GiB 1.7 TiB 65.05 1.01 45 up osd.34
  50. 35 hdd 4.98999 1.00000 5.0 TiB 3.1 TiB 3.1 TiB 1.1 MiB 5.1 GiB 1.9 TiB 62.18 0.96 45 up osd.35
  51. TOTAL 179 TiB 116 TiB 116 TiB 41 MiB 194 GiB 63 TiB 64.71
  52. MIN/MAX VAR: 0.94/1.07 STDDEV: 2.11
  53.  
  54. TOTAL 179 TiB 116 TiB 116 TiB 41 MiB 197 GiB 63 TiB 64.72
  55. MIN/MAX VAR: 0.94/1.07 STDDEV: 2.11
  56.  
  57. root@meghdootctr1:/home/cloud# iostat -x
  58. Linux 4.19.0-12-amd64 (meghdootctr1) 11/02/2023 _x86_64_ (160 CPU)
  59.  
  60. avg-cpu: %user %nice %system %iowait %steal %idle
  61. 2.98 0.03 0.85 2.03 0.00 94.11
  62.  
  63. Device r/s w/s rkB/s wkB/s rrqm/s wrqm/s %rrqm %wrqm r_await w_await aqu-sz rareq-sz wareq-sz svctm %util
  64. sda 15.34 328.12 1287.78 7691.92 0.02 190.83 0.10 36.77 1.45 0.07 1.02 83.97 23.44 2.90 99.58
  65. sdc 12.26 50.84 426.96 1088.14 0.00 0.00 0.00 0.00 5.05 1.62 0.14 34.81 21.40 1.29 8.13
  66. sdd 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 2.15 0.00 0.00 26.10 0.00 1.79 0.00
  67. sde 37.68 7.03 2360.65 145.30 0.00 0.00 0.00 0.00 5.45 1.71 0.22 62.66 20.66 0.50 2.23
  68. sdf 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.57 0.00 0.00 5.60 0.00 1.60 0.00
  69. sdg 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 2.32 0.00 0.00 5.60 0.00 2.37 0.00
  70. sdh 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.53 0.00 0.00 6.82 0.00 0.50 0.00
  71. sdi 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.60 0.00 0.00 12.61 0.00 0.50 0.00
  72. sdj 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.50 0.00 0.00 12.61 0.00 0.39 0.00
  73. sdk 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.12 0.00 0.00 5.05 0.00 1.08 0.00
  74. sdl 0.30 0.95 37.78 71.40 0.00 0.00 0.00 0.00 5.05 4.12 0.01 125.14 74.81 1.53 0.19
  75. sdm 225.13 53.84 13982.18 1212.68 0.00 0.00 0.00 0.00 0.68 15.00 0.96 62.11 22.52 1.22 33.95
  76. sdn 10.30 37.87 360.78 829.79 0.00 0.00 0.00 0.00 21.33 10.52 0.62 35.02 21.91 5.16 24.87
  77. sdo 10.86 44.99 352.50 995.19 0.00 0.00 0.00 0.00 26.68 15.98 1.01 32.46 22.12 5.89 32.90
  78. sdp 12.36 48.16 425.66 1076.20 0.00 0.00 0.00 0.00 25.62 15.72 1.07 34.45 22.34 6.02 36.41
  79. sdq 10.94 47.73 347.22 1077.02 0.00 0.00 0.00 0.00 29.25 17.65 1.16 31.73 22.56 6.56 38.51
  80. sdr 14.16 46.96 557.09 1036.90 0.00 0.00 0.00 0.00 24.78 16.28 1.12 39.35 22.08 6.19 37.84
  81. sds 12.27 50.84 426.22 1087.70 0.00 0.00 0.00 0.00 5.02 1.62 0.14 34.75 21.39 1.28 8.09
  82. sdt 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.67 0.00 0.00 27.16 0.00 0.46 0.00
  83. sdu 37.66 7.03 2360.00 145.23 0.00 0.00 0.00 0.00 5.44 1.72 0.22 62.66 20.66 0.50 2.22
  84. sdv 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 1.14 0.00 0.00 4.93 0.00 1.20 0.00
  85. sdw 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.49 0.00 0.00 4.93 0.00 0.63 0.00
  86. sdx 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.44 0.00 0.00 6.40 0.00 0.39 0.00
  87. sdy 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.62 0.00 0.00 13.92 0.00 0.70 0.00
  88. sdz 0.00 0.00 0.02 0.00 0.00 0.00 0.00 0.00 24.03 0.00 0.00 317.95 0.00 16.11 0.00
  89. sdaa 0.00 0.00 0.04 0.00 0.00 0.00 0.00 0.00 24.57 0.00 0.00 544.78 0.00 15.01 0.00
  90. sdab 0.30 0.95 37.84 71.34 0.00 0.00 0.00 0.00 5.05 4.10 0.01 125.31 74.76 1.53 0.19
  91. sdac 144.43 35.58 8942.92 786.56 0.00 0.00 0.00 0.00 6.43 4.63 1.09 61.92 22.10 1.04 18.64
  92. sdad 15.29 54.57 579.23 1200.07 0.00 0.00 0.00 0.00 29.00 19.52 0.01 37.88 21.99 5.86 40.97
  93. sdae 14.73 54.36 534.72 1205.50 0.00 0.00 0.00 0.00 29.07 21.27 0.08 36.29 22.17 6.01 41.54
  94. sdaf 12.36 48.16 426.04 1075.86 0.00 0.00 0.00 0.00 25.66 15.68 1.07 34.47 22.34 6.01 36.40
  95. sdag 10.94 47.73 347.37 1077.13 0.00 0.00 0.00 0.00 29.22 17.64 1.16 31.74 22.57 6.56 38.49
  96. sdah 14.16 46.95 557.60 1037.96 0.00 0.00 0.00 0.00 24.78 16.26 1.12 39.38 22.11 6.18 37.79
  97. dm-0 24.53 101.68 853.13 2175.84 0.59 0.57 2.35 0.56 5.07 1.65 0.29 34.78 21.40 1.11 14.07
  98. dm-1 0.60 1.91 75.56 142.73 0.00 0.18 0.01 8.52 5.06 4.19 0.01 125.18 74.79 0.92 0.23
  99. dm-2 444.90 103.48 27645.75 2289.77 0.63 0.59 0.14 0.57 0.57 9.69 1.01 62.14 22.13 0.84 45.98
  100. dm-3 25.59 92.44 940.00 2029.86 0.68 0.47 2.58 0.50 25.99 15.88 0.63 36.73 21.96 4.44 52.45
  101. dm-4 25.59 99.35 887.22 2200.69 0.50 0.53 1.92 0.53 28.31 3.78 1.10 34.67 22.15 4.32 53.92
  102. dm-5 24.72 96.32 851.70 2152.06 0.61 0.57 2.39 0.58 25.68 0.11 0.65 34.46 22.34 4.11 49.70
  103. dm-6 21.89 95.46 694.60 2154.15 0.42 0.59 1.89 0.61 29.29 1.92 0.83 31.73 22.57 4.49 52.70
  104. dm-7 28.32 93.92 1114.69 2074.87 0.85 0.53 2.93 0.57 24.82 0.29 0.73 39.37 22.09 4.22 51.61
  105. dm-8 25.13 102.25 853.12 2175.84 0.00 0.00 0.00 0.00 6.22 1.75 0.34 33.95 21.28 1.10 14.04
  106. dm-9 445.54 104.07 27645.74 2289.77 0.00 0.00 0.00 0.00 0.65 10.32 1.37 62.05 22.00 0.84 45.98
  107. dm-10 26.28 92.91 940.00 2029.86 0.00 0.00 0.00 0.00 27.68 0.55 0.78 35.77 21.85 4.40 52.44
  108. dm-11 26.10 99.88 887.22 2200.69 0.00 0.00 0.00 0.00 29.62 4.83 1.26 34.00 22.03 4.28 53.89
  109. dm-12 25.33 96.89 851.69 2152.06 0.00 0.00 0.00 0.00 26.73 0.99 0.77 33.63 22.21 4.07 49.68
  110. dm-13 22.31 96.04 694.59 2154.15 0.00 0.00 0.00 0.00 30.32 2.99 0.97 31.13 22.43 4.45 52.68
  111. dm-14 29.18 94.45 1114.68 2074.87 0.00 0.00 0.00 0.00 26.08 1.13 0.87 38.20 21.97 4.17 51.58
  112. rbd0 0.01 1.12 0.42 17.33 0.00 0.00 0.43 0.01 20.28 394.36 0.38 53.61 15.46 171.28 19.33
  113. rbd1 0.01 1.13 0.41 16.15 0.00 0.00 0.17 0.01 137.51 434.37 0.42 37.35 14.32 168.57 19.20
  114. rbd2 0.01 0.00 0.27 0.02 0.00 0.00 0.35 0.17 16.38 148.15 0.00 46.60 46.01 3.71 0.00
  115. rbd9 0.02 2.69 0.73 27.40 0.00 0.00 0.00 0.02 30.20 397.27 0.93 36.14 10.20 90.07 24.38
  116. rbd11 3.30 8.03 404.40 290.57 0.00 0.02 0.00 0.24 115.95 179.35 0.04 122.59 36.20 47.77 54.10
  117. rbd16 0.23 0.53 5.21 10.24 0.00 0.00 0.12 0.02 44.47 852.86 0.43 22.52 19.26 149.68 11.43
  118. rbd17 0.11 0.00 90.37 0.01 0.01 0.00 10.32 0.04 220.39 827.13 0.02 833.44 15.39 65.23 0.71
  119. rbd10 1.02 1.80 108.68 358.84 0.00 0.06 0.01 3.45 76.98 542.47 0.91 106.65 199.76 90.07 25.36
  120. sdai 6.01 1.00 743.82 92.57 0.03 0.01 0.55 0.55 24.55 13.90 0.15 123.69 92.82 11.33 7.94
  121. rbd7 0.06 1.51 1.95 16.59 0.00 0.00 0.00 0.02 30.19 541.51 0.72 35.03 11.02 129.36 20.20
  122. rbd12 2.03 0.25 133.30 4.32 0.01 0.00 0.40 0.01 70.29 489.61 0.15 65.73 17.62 30.80 7.00
  123. rbd13 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 2.23 0.00 0.00 14.39 0.00 2.11 0.00
  124. rbd14 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 5.62 0.00 0.00 15.35 0.00 3.47 0.00
  125. rbd15 1.08 0.38 261.48 7.61 0.02 0.00 1.99 0.06 76.30 614.13 0.21 242.79 20.15 60.46 8.79
  126. rbd8 0.01 0.23 0.26 2.02 0.00 0.00 0.00 0.00 89.51 762.07 0.14 37.42 8.84 70.65 1.66
  127. rbd18 0.01 0.18 0.37 2.13 0.00 0.00 0.00 0.00 102.84 817.76 0.13 43.64 11.53 95.45 1.84
  128. rbd5 0.01 0.00 0.43 0.10 0.00 0.00 0.00 0.00 36.80 348.18 0.00 41.77 32.21 86.90 0.12
  129. rbd6 0.00 0.00 0.14 0.01 0.00 0.00 0.00 0.00 16.51 175.57 0.00 34.81 28.87 24.95 0.01
  130. rbd3 0.09 0.03 2.11 0.58 0.00 0.00 0.00 0.00 5.03 52.50 0.00 23.71 18.27 16.37 0.20
  131. rbd4 0.00 0.00 0.00 0.07 0.00 0.00 0.00 0.00
  132.  
  133.  
  134.  
  135.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!