API tools faq
paste
galileo_pkm

RAID10F2

galileo_pkm
Jun 13th, 2024
96
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 19.46 KB | None | 0 0
raw download clone embed print report
  1.  
  2. | fio iodepth=256, numjobs=4 | IOPS | BW | lat (usec) avg |
  3. |--------------------------------------------------|:-----:|:---------:|:--------------:|
  4. | Sequential 4k read, single disk | 828k | 3233MiB/s | 1236 |
  5. | Sequential 4k read, 4 disk RAID0, 64k chunk | 666k | 2602MiB/s | 1536 |
  6. | Sequential 512k read, single disk | 13.6k | 6798MiB/s | 75300 |
  7. | Sequential 512k read, 4 disk RAID0, 64k chunk | 47.1k | 23GiB/s | 21745 |
  8. | Sequential 4k read, 2 disk RAID10F2, 64k chunk | 523k | 2044MiB/s | 1956 |
  9. | Sequential 512k read, 2 disk RAID10F2, 64k chunk | 27.2k | 13.3GiB/s | 37675 |
  10.  
  11.  
  12.  
  13. Sequential 4k read, single disk
  14. ==============================================================================================
  15. fio --filename=/dev/nvme2n1 --direct=1 --rw=read --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=single_disk --readonly
  16.  
  17.  
  18. Jobs: 4 (f=4): [R(4)][100.0%][r=3350MiB/s][r=858k IOPS][eta 00m:00s]
  19. single_disk: (groupid=0, jobs=4): err= 0: pid=4005: Thu Jun 13 18:40:24 2024
  20. read: IOPS=828k, BW=3233MiB/s (3390MB/s)(379GiB/120001msec)
  21. slat (usec): min=2, max=9996, avg= 3.66, stdev= 2.68
  22. clat (usec): min=12, max=11928, avg=1233.18, stdev=68.70
  23. lat (usec): min=14, max=11932, avg=1236.84, stdev=68.95
  24. clat percentiles (usec):
  25. | 1.00th=[ 1156], 5.00th=[ 1172], 10.00th=[ 1172], 20.00th=[ 1188],
  26. | 30.00th=[ 1205], 40.00th=[ 1205], 50.00th=[ 1221], 60.00th=[ 1237],
  27. | 70.00th=[ 1254], 80.00th=[ 1287], 90.00th=[ 1303], 95.00th=[ 1303],
  28. | 99.00th=[ 1434], 99.50th=[ 1549], 99.90th=[ 1745], 99.95th=[ 1860],
  29. | 99.99th=[ 2147]
  30. bw ( MiB/s): min= 2976, max= 3415, per=100.00%, avg=3234.48, stdev=23.76, samples=956
  31. iops : min=762068, max=874374, avg=828026.06, stdev=6081.90, samples=956
  32. lat (usec) : 20=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
  33. lat (usec) : 750=0.01%, 1000=0.01%
  34. lat (msec) : 2=99.98%, 4=0.02%, 10=0.01%, 20=0.01%
  35. cpu : usr=12.64%, sys=62.93%, ctx=7874, majf=0, minf=45399
  36. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  37. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  38. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  39. issued rwts: total=99324711,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  40. latency : target=0, window=0, percentile=100.00%, depth=256
  41.  
  42. Run status group 0 (all jobs):
  43. READ: bw=3233MiB/s (3390MB/s), 3233MiB/s-3233MiB/s (3390MB/s-3390MB/s), io=379GiB (407GB), run=120001-120001msec
  44.  
  45. Disk stats (read/write):
  46. nvme2n1: ios=99219512/0, merge=0/0, ticks=1739335/0, in_queue=1739335, util=99.97%
  47.  
  48.  
  49. avg-cpu: %user %nice %system %iowait %steal %idle
  50. 0.79 0.00 5.50 0.00 0.00 93.71
  51.  
  52. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  53. |---------|:---------:|:-------:|:------:|:-----:|:-------:|:--------:|:------:|:------:|
  54. | nvme2n1 | 822081.20 | 3211.26 | 0.00 | 0.00 | 0.02 | 4.00 | 14.12 | 100.00 |
  55.  
  56.  
  57. Sequential 4k read, 4 disk RAID0, 64k chunk
  58. ==============================================================================================
  59. fio --filename=/dev/md/raid0 --direct=1 --rw=read --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=RAID0_64K --readonly
  60.  
  61.  
  62. Jobs: 4 (f=4): [R(4)][100.0%][r=2579MiB/s][r=660k IOPS][eta 00m:00s]
  63. RAID0_64K: (groupid=0, jobs=4): err= 0: pid=4092: Thu Jun 13 18:49:38 2024
  64. read: IOPS=666k, BW=2602MiB/s (2729MB/s)(305GiB/120001msec)
  65. slat (usec): min=2, max=10011, avg= 4.91, stdev= 2.51
  66. clat (usec): min=31, max=11956, avg=1531.85, stdev=102.56
  67. lat (usec): min=35, max=11962, avg=1536.76, stdev=102.74
  68. clat percentiles (usec):
  69. | 1.00th=[ 1418], 5.00th=[ 1450], 10.00th=[ 1450], 20.00th=[ 1467],
  70. | 30.00th=[ 1483], 40.00th=[ 1500], 50.00th=[ 1516], 60.00th=[ 1549],
  71. | 70.00th=[ 1565], 80.00th=[ 1582], 90.00th=[ 1598], 95.00th=[ 1631],
  72. | 99.00th=[ 1958], 99.50th=[ 2008], 99.90th=[ 2180], 99.95th=[ 2278],
  73. | 99.99th=[ 2769]
  74. bw ( MiB/s): min= 2441, max= 2766, per=100.00%, avg=2602.65, stdev=18.09, samples=956
  75. iops : min=625076, max=708260, avg=666279.56, stdev=4630.61, samples=956
  76. lat (usec) : 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  77. lat (usec) : 1000=0.01%
  78. lat (msec) : 2=99.40%, 4=0.59%, 10=0.01%, 20=0.01%
  79. cpu : usr=9.45%, sys=63.33%, ctx=8895, majf=0, minf=56546
  80. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  81. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  82. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  83. issued rwts: total=79944700,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  84. latency : target=0, window=0, percentile=100.00%, depth=256
  85.  
  86.  
  87.  
  88.  
  89.  
  90. avg-cpu: %user %nice %system %iowait %steal %idle
  91. 0.59 0.00 5.71 0.00 0.00 93.70
  92.  
  93.  
  94. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  95. |---------|:---------:|:-------:|:------:|:-----:|:-------:|:--------:|:------:|:------:|
  96. | md127 | 672083.40 | 2625.33 | 0.00 | 0.00 | 0.01 | 4.00 | 8.31 | 100.00 |
  97. | nvme0n1 | 168022.00 | 656.34 | 0.00 | 0.00 | 0.01 | 4.00 | 2.02 | 100.00 |
  98. | nvme1n1 | 168022.00 | 656.34 | 0.00 | 0.00 | 0.01 | 4.00 | 2.03 | 100.02 |
  99. | nvme3n1 | 168019.20 | 656.33 | 0.00 | 0.00 | 0.01 | 4.00 | 2.02 | 100.00 |
  100. | nvme6n1 | 168020.20 | 656.33 | 0.00 | 0.00 | 0.01 | 4.00 | 2.03 | 100.00 |
  101.  
  102.  
  103.  
  104.  
  105. Sequential 4k read, 4 disk RAID0, 64k chunk, fresh array (nvme format)
  106. ==============================================================================================
  107. Node Generic SN Model Namespace Usage Format FW Rev
  108. --------------------- --------------------- -------------------- ---------------------------------------- ---------- -------------------------- ---------------- --------
  109. /dev/nvme0n1 /dev/ng0n1 S6WRNJ0WA04045P Samsung SSD 980 PRO with Heatsink 2TB 0x1 0.00 B / 2.00 TB 512 B + 0 B 5B2QGXA7
  110. /dev/nvme1n1 /dev/ng1n1 S6WRNJ0WA04048B Samsung SSD 980 PRO with Heatsink 2TB 0x1 0.00 B / 2.00 TB 512 B + 0 B 5B2QGXA7
  111. /dev/nvme2n1 /dev/ng2n1 S6WRNJ0WA04050H Samsung SSD 980 PRO with Heatsink 2TB 0x1 0.00 B / 2.00 TB 512 B + 0 B 5B2QGXA7
  112. /dev/nvme3n1 /dev/ng3n1 S6WRNJ0W808149N Samsung SSD 980 PRO with Heatsink 2TB 0x1 0.00 B / 2.00 TB 512 B + 0 B 5B2QGXA7
  113. /dev/nvme4n1 /dev/ng4n1 PHBT909504AH016N INTEL MEMPEK1J016GAL 0x1 14.40 GB / 14.40 GB 512 B + 0 B K4110420
  114. /dev/nvme5n1 /dev/ng5n1 1460A0F9TSTJ Dell DC NVMe CD8 U.2 960GB 0x1 79.15 GB / 960.20 GB 512 B + 0 B 2.0.0
  115. /dev/nvme6n1 /dev/ng6n1 S6WRNJ0WA04036R Samsung SSD 980 PRO with Heatsink 2TB 0x1 0.00 B / 2.00 TB 512 B + 0 B 5B2QGXA7
  116.  
  117. mdadm --create --assume-clean --verbose /dev/md/raid0 --name=raid0 --level=0 --chunk=64K --raid-devices=4 /dev/nvme[0-1,3,6]n1
  118. fio --filename=/dev/md/raid0 --direct=1 --rw=read --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=RAID0_64K --readonly
  119.  
  120. Jobs: 4 (f=4): [R(4)][100.0%][r=2430MiB/s][r=622k IOPS][eta 00m:00s]
  121. RAID0_64K: (groupid=0, jobs=4): err= 0: pid=4245: Thu Jun 13 19:10:36 2024
  122. read: IOPS=654k, BW=2555MiB/s (2680MB/s)(299GiB/120001msec)
  123. slat (usec): min=2, max=17009, avg= 4.98, stdev= 3.81
  124. clat (usec): min=21, max=19341, avg=1559.98, stdev=129.37
  125. lat (usec): min=27, max=19346, avg=1564.96, stdev=129.71
  126. clat percentiles (usec):
  127. | 1.00th=[ 1418], 5.00th=[ 1450], 10.00th=[ 1450], 20.00th=[ 1467],
  128. | 30.00th=[ 1483], 40.00th=[ 1483], 50.00th=[ 1516], 60.00th=[ 1598],
  129. | 70.00th=[ 1631], 80.00th=[ 1647], 90.00th=[ 1680], 95.00th=[ 1713],
  130. | 99.00th=[ 1975], 99.50th=[ 2089], 99.90th=[ 2245], 99.95th=[ 2409],
  131. | 99.99th=[ 2900]
  132. bw ( MiB/s): min= 2328, max= 2787, per=100.00%, avg=2556.30, stdev=27.79, samples=956
  133. iops : min=596206, max=713650, avg=654412.54, stdev=7113.46, samples=956
  134. lat (usec) : 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%, 750=0.01%
  135. lat (usec) : 1000=0.01%
  136. lat (msec) : 2=99.08%, 4=0.91%, 10=0.01%, 20=0.01%
  137. cpu : usr=9.63%, sys=62.92%, ctx=8805, majf=0, minf=59498
  138. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  139. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  140. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  141. issued rwts: total=78503395,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  142. latency : target=0, window=0, percentile=100.00%, depth=256
  143.  
  144.  
  145. avg-cpu: %user %nice %system %iowait %steal %idle
  146. 0.62 0.00 5.69 0.00 0.00 93.70
  147.  
  148. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  149. |---------|:---------:|:-------:|:------:|:-----:|:-------:|:--------:|:------:|:------:|
  150. | md127 | 654414.00 | 2556.30 | 0.00 | 0.00 | 0.01 | 4.00 | 8.31 | 100.00 |
  151. | nvme0n1 | 163607.80 | 639.09 | 0.00 | 0.00 | 0.01 | 4.00 | 2.04 | 100.00 |
  152. | nvme1n1 | 163602.80 | 639.07 | 0.00 | 0.00 | 0.01 | 4.00 | 2.05 | 100.00 |
  153. | nvme3n1 | 163600.00 | 639.06 | 0.00 | 0.00 | 0.01 | 4.00 | 2.04 | 100.00 |
  154. | nvme6n1 | 163600.00 | 639.06 | 0.00 | 0.00 | 0.01 | 4.00 | 2.05 | 100.00 |
  155.  
  156.  
  157.  
  158. Sequential 512k read, single disk
  159. ==============================================================================================
  160. fio --filename=/dev/nvme2n1 --direct=1 --rw=read --bs=512k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=single_disk --readonly
  161.  
  162. Jobs: 4 (f=4): [R(4)][100.0%][r=6799MiB/s][r=13.6k IOPS][eta 00m:00s]
  163. single_disk: (groupid=0, jobs=4): err= 0: pid=4364: Thu Jun 13 19:19:37 2024
  164. read: IOPS=13.6k, BW=6798MiB/s (7128MB/s)(797GiB/120074msec)
  165. slat (usec): min=16, max=2876, avg=285.15, stdev=274.65
  166. clat (msec): min=4, max=148, avg=75.01, stdev= 5.51
  167. lat (msec): min=4, max=148, avg=75.30, stdev= 5.54
  168. clat percentiles (msec):
  169. | 1.00th=[ 54], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75],
  170. | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 75],
  171. | 70.00th=[ 75], 80.00th=[ 75], 90.00th=[ 75], 95.00th=[ 77],
  172. | 99.00th=[ 91], 99.50th=[ 92], 99.90th=[ 102], 99.95th=[ 117],
  173. | 99.99th=[ 136]
  174. bw ( MiB/s): min= 6148, max= 8066, per=100.00%, avg=6803.71, stdev=51.60, samples=956
  175. iops : min=12296, max=16132, avg=13607.30, stdev=103.19, samples=956
  176. lat (msec) : 10=0.11%, 20=0.17%, 50=0.63%, 100=98.98%, 250=0.12%
  177. cpu : usr=0.26%, sys=7.17%, ctx=847327, majf=0, minf=133917
  178. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  179. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  180. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  181. issued rwts: total=1632579,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  182. latency : target=0, window=0, percentile=100.00%, depth=256
  183.  
  184.  
  185. avg-cpu: %user %nice %system %iowait %steal %idle
  186. 0.04 0.00 0.74 5.39 0.00 93.83
  187.  
  188. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  189. |---------|:--------:|:-------:|:------:|:-----:|:-------:|:--------:|:-------:|:------:|
  190. | nvme2n1 | 54365.60 | 6795.70 | 0.00 | 0.00 | 74.98 | 128.00 | 4076.40 | 100.00 |
  191.  
  192.  
  193.  
  194. Sequential 512k read, 4 disk RAID0, 64k chunk
  195. ==============================================================================================
  196. fio --filename=/dev/md/raid0 --direct=1 --rw=read --bs=512k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=RAID0_64K --readonly
  197.  
  198.  
  199. Jobs: 4 (f=4): [R(4)][100.0%][r=22.8GiB/s][r=46.7k IOPS][eta 00m:00s]
  200. RAID0_64K: (groupid=0, jobs=4): err= 0: pid=4436: Thu Jun 13 19:26:34 2024
  201. read: IOPS=47.1k, BW=23.0GiB/s (24.7GB/s)(2759GiB/120018msec)
  202. slat (usec): min=29, max=11028, avg=61.28, stdev=16.62
  203. clat (usec): min=1466, max=61139, avg=21683.99, stdev=9670.73
  204. lat (usec): min=1531, max=61689, avg=21745.28, stdev=9670.88
  205. clat percentiles (usec):
  206. | 1.00th=[ 3982], 5.00th=[ 5407], 10.00th=[ 7504], 20.00th=[11994],
  207. | 30.00th=[16450], 40.00th=[19268], 50.00th=[21890], 60.00th=[24773],
  208. | 70.00th=[27919], 80.00th=[31065], 90.00th=[34341], 95.00th=[36439],
  209. | 99.00th=[40109], 99.50th=[41157], 99.90th=[43254], 99.95th=[44303],
  210. | 99.99th=[47449]
  211. bw ( MiB/s): min=21236, max=25712, per=100.00%, avg=23541.23, stdev=176.38, samples=956
  212. iops : min=42472, max=51424, avg=47082.47, stdev=352.76, samples=956
  213. lat (msec) : 2=0.06%, 4=0.96%, 10=14.61%, 20=27.23%, 50=57.13%
  214. lat (msec) : 100=0.01%
  215. cpu : usr=1.36%, sys=54.64%, ctx=1909375, majf=0, minf=611969
  216. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  217. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  218. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  219. issued rwts: total=5649981,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  220. latency : target=0, window=0, percentile=100.00%, depth=256
  221.  
  222.  
  223. avg-cpu: %user %nice %system %iowait %steal %idle
  224. 0.10 0.00 5.61 0.00 0.00 94.29
  225.  
  226. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  227. |---------|:---------:|:--------:|:------:|:-----:|:-------:|:--------:|:-------:|:------:|
  228. | md127 | 378682.80 | 23667.67 | 0.00 | 0.00 | 8.73 | 64.00 | 3305.59 | 100.00 |
  229. | nvme0n1 | 94667.80 | 5916.74 | 0.00 | 0.00 | 0.05 | 64.00 | 4.46 | 100.00 |
  230. | nvme1n1 | 94675.80 | 5917.24 | 0.00 | 0.00 | 20.31 | 64.00 | 1923.30 | 100.00 |
  231. | nvme3n1 | 94667.40 | 5916.71 | 0.00 | 0.00 | 0.05 | 64.00 | 4.43 | 100.00 |
  232. | nvme6n1 | 94685.40 | 5917.84 | 0.00 | 0.00 | 14.50 | 64.00 | 1372.53 | 100.00 |
  233.  
  234.  
  235.  
  236. Sequential 4k read, 2 disk RAID10F2, 64k chunk
  237. ==============================================================================================
  238. mdadm --create --assume-clean --verbose /dev/md/raid10 --name=raid10 --level=10 --chunk=64K --raid-devices=2 --layout=f2 /dev/nvme[0-1]n1
  239.  
  240. fio --filename=/dev/md/raid10 --direct=1 --rw=read --bs=4k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=RAID10_64K --readonly
  241.  
  242.  
  243. Jobs: 4 (f=4): [R(4)][100.0%][r=1911MiB/s][r=489k IOPS][eta 00m:00s]
  244. RAID10_64K: (groupid=0, jobs=4): err= 0: pid=4584: Thu Jun 13 19:47:57 2024
  245. read: IOPS=523k, BW=2044MiB/s (2143MB/s)(240GiB/120001msec)
  246. slat (usec): min=3, max=13007, avg= 6.32, stdev= 4.37
  247. clat (usec): min=15, max=15457, avg=1950.29, stdev=245.73
  248. lat (usec): min=22, max=15465, avg=1956.61, stdev=246.41
  249. clat percentiles (usec):
  250. | 1.00th=[ 1631], 5.00th=[ 1663], 10.00th=[ 1696], 20.00th=[ 1745],
  251. | 30.00th=[ 1827], 40.00th=[ 1876], 50.00th=[ 1909], 60.00th=[ 1942],
  252. | 70.00th=[ 1975], 80.00th=[ 2089], 90.00th=[ 2376], 95.00th=[ 2409],
  253. | 99.00th=[ 2540], 99.50th=[ 2638], 99.90th=[ 3032], 99.95th=[ 3195],
  254. | 99.99th=[ 4424]
  255. bw ( MiB/s): min= 1640, max= 2290, per=100.00%, avg=2044.74, stdev=36.02, samples=956
  256. iops : min=419962, max=586444, avg=523454.38, stdev=9220.15, samples=956
  257. lat (usec) : 20=0.01%, 50=0.01%, 100=0.01%, 250=0.01%, 500=0.01%
  258. lat (usec) : 750=0.01%, 1000=0.01%
  259. lat (msec) : 2=73.86%, 4=26.12%, 10=0.01%, 20=0.01%
  260. cpu : usr=8.72%, sys=60.71%, ctx=8913, majf=0, minf=63220
  261. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  262. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  263. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  264. issued rwts: total=62789560,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  265. latency : target=0, window=0, percentile=100.00%, depth=256
  266.  
  267.  
  268.  
  269. avg-cpu: %user %nice %system %iowait %steal %idle
  270. 0.56 0.00 5.73 0.00 0.00 93.71
  271.  
  272. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  273. |---------|:---------:|:-------:|:------:|:-----:|:-------:|:--------:|:------:|:------:|
  274. | md127 | 526040.80 | 2054.85 | 0.00 | 0.00 | 0.01 | 4.00 | 5.99 | 100.00 |
  275. | nvme0n1 | 263332.40 | 1028.64 | 0.00 | 0.00 | 0.01 | 4.00 | 3.02 | 100.00 |
  276. | nvme1n1 | 262707.80 | 1026.20 | 0.00 | 0.00 | 0.01 | 4.00 | 3.02 | 100.00 |
  277.  
  278.  
  279.  
  280. Sequential 512k read, 2 disk RAID10F2, 64k chunk
  281. ==============================================================================================
  282. fio --filename=/dev/md/raid10 --direct=1 --rw=read --bs=512k --ioengine=libaio --iodepth=256 --runtime=120 --numjobs=4 --time_based --group_reporting --name=RAID10_64K --readonly
  283.  
  284. Jobs: 4 (f=4): [R(4)][100.0%][r=13.3GiB/s][r=27.2k IOPS][eta 00m:00s]
  285. RAID10_64K: (groupid=0, jobs=4): err= 0: pid=4656: Thu Jun 13 19:52:15 2024
  286. read: IOPS=27.2k, BW=13.3GiB/s (14.2GB/s)(1593GiB/120036msec)
  287. slat (usec): min=32, max=3125, avg=84.77, stdev=89.43
  288. clat (usec): min=1533, max=93914, avg=37590.81, stdev=18175.37
  289. lat (usec): min=1612, max=93995, avg=37675.58, stdev=18197.44
  290. clat percentiles (usec):
  291. | 1.00th=[ 3818], 5.00th=[ 6587], 10.00th=[10552], 20.00th=[18744],
  292. | 30.00th=[26608], 40.00th=[33424], 50.00th=[39584], 60.00th=[45351],
  293. | 70.00th=[50594], 80.00th=[55313], 90.00th=[60556], 95.00th=[63701],
  294. | 99.00th=[69731], 99.50th=[70779], 99.90th=[73925], 99.95th=[76022],
  295. | 99.99th=[79168]
  296. bw ( MiB/s): min=12071, max=15236, per=100.00%, avg=13585.63, stdev=145.83, samples=960
  297. iops : min=24142, max=30472, avg=27171.25, stdev=291.67, samples=960
  298. lat (msec) : 2=0.03%, 4=1.29%, 10=7.95%, 20=12.46%, 50=47.30%
  299. lat (msec) : 100=30.98%
  300. cpu : usr=0.73%, sys=37.77%, ctx=2064872, majf=0, minf=215573
  301. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
  302. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  303. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
  304. issued rwts: total=3261564,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  305. latency : target=0, window=0, percentile=100.00%, depth=256
  306.  
  307.  
  308. avg-cpu: %user %nice %system %iowait %steal %idle
  309. 0.07 0.00 4.16 0.70 0.00 95.06
  310.  
  311. | Device | r/s | rMB/s | rrqm/s | %rrqm | r_await | rareq-sz | aqu-sz | %util |
  312. |---------|:---------:|:--------:|:------:|:-----:|:-------:|:--------:|:-------:|:------:|
  313. | md127 | 217524.00 | 13595.25 | 0.00 | 0.00 | 35.97 | 64.00 | 7824.71 | 100.00 |
  314. | nvme0n1 | 108736.60 | 6796.04 | 0.00 | 0.00 | 35.98 | 64.00 | 3912.09 | 100.00 |
  315. | nvme1n1 | 108744.00 | 6796.50 | 0.00 | 0.00 | 35.97 | 64.00 | 3911.82 | 100.00 |
  316.  
  317.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!