API tools faq
paste
Guest User

2x4DiskZFSRaidZ1.txt

a guest
Jun 14th, 2024
68
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 24.44 KB | None | 0 0
raw download clone embed print report
  1. pool: tank
  2. state: ONLINE
  3. config:
  4.  
  5. NAME STATE READ WRITE CKSUM
  6. tank ONLINE 0 0 0
  7. raidz1-0 ONLINE 0 0 0
  8. nvme0n1 ONLINE 0 0 0
  9. nvme1n1 ONLINE 0 0 0
  10. nvme2n1 ONLINE 0 0 0
  11. nvme3n1 ONLINE 0 0 0
  12. raidz1-1 ONLINE 0 0 0
  13. nvme4n1 ONLINE 0 0 0
  14. nvme5n1 ONLINE 0 0 0
  15. nvme6n1 ONLINE 0 0 0
  16. nvme7n1 ONLINE 0 0 0
  17.  
  18. errors: No known data errors
  19. NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
  20. tank 14.0T 1.05M 14.0T - - 0% 0% 1.00x ONLINE -
  21. Version 2.00a ------Sequential Output------ --Sequential Input- --Random-
  22. -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
  23. Name:Size etc /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
  24. rescue 16G::4 1.7g 90 1.6g 95 4.2g 99 +++++ +++
  25. Latency 6263us 762us 77us 1113us
  26. Version 2.00a ------Sequential Create------ --------Random Create--------
  27. rescue -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
  28. files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
  29. 1 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
  30. Latency 183us 5us 168us 159us 4us 84us
  31. 1.98,2.00a,rescue,4,1718573910,16G,,8192,5,,,1758080,90,1710100,95,,,4429902,99,+++++,+++,1,,,,,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,,6263us,762us,,77us,1113us,183us,5us,168us,159us,4us,84us
  32. sync_randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
  33. fio-3.33
  34. Starting 1 process
  35. sync_randwrite: Laying out IO file (1 file / 1024MiB)
  36.  
  37. sync_randwrite: (groupid=0, jobs=1): err= 0: pid=203989: Fri Jun 14 15:36:01 2024
  38. write: IOPS=9323, BW=36.4MiB/s (38.2MB/s)(1024MiB/28117msec); 0 zone resets
  39. clat (usec): min=42, max=18563, avg=105.35, stdev=142.98
  40. lat (usec): min=42, max=18563, avg=105.40, stdev=143.07
  41. clat percentiles (usec):
  42. | 1.00th=[ 53], 5.00th=[ 56], 10.00th=[ 58], 20.00th=[ 60],
  43. | 30.00th=[ 62], 40.00th=[ 64], 50.00th=[ 67], 60.00th=[ 75],
  44. | 70.00th=[ 83], 80.00th=[ 92], 90.00th=[ 127], 95.00th=[ 461],
  45. | 99.00th=[ 635], 99.50th=[ 676], 99.90th=[ 775], 99.95th=[ 824],
  46. | 99.99th=[ 1188]
  47. bw ( KiB/s): min= 6496, max=64552, per=99.79%, avg=37214.57, stdev=21346.51, samples=56
  48. iops : min= 1624, max=16138, avg=9303.64, stdev=5336.63, samples=56
  49. lat (usec) : 50=0.17%, 100=84.38%, 250=8.63%, 500=2.67%, 750=4.01%
  50. lat (usec) : 1000=0.12%
  51. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
  52. cpu : usr=2.31%, sys=27.66%, ctx=263734, majf=0, minf=10
  53. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  54. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  55. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  56. issued rwts: total=0,262144,0,0 short=0,0,0,0 dropped=0,0,0,0
  57. latency : target=0, window=0, percentile=100.00%, depth=1
  58.  
  59. Run status group 0 (all jobs):
  60. WRITE: bw=36.4MiB/s (38.2MB/s), 36.4MiB/s-36.4MiB/s (38.2MB/s-38.2MB/s), io=1024MiB (1074MB), run=28117-28117msec
  61. sync_randread: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
  62. fio-3.33
  63. Starting 1 process
  64. sync_randread: Laying out IO file (1 file / 1024MiB)
  65.  
  66. sync_randread: (groupid=0, jobs=1): err= 0: pid=204151: Fri Jun 14 15:36:36 2024
  67. read: IOPS=77.4k, BW=302MiB/s (317MB/s)(10.0GiB/33854msec)
  68. clat (nsec): min=1056, max=128205, avg=12702.71, stdev=7426.02
  69. lat (nsec): min=1073, max=129060, avg=12729.08, stdev=7426.85
  70. clat percentiles (nsec):
  71. | 1.00th=[ 1512], 5.00th=[ 1864], 10.00th=[ 1976], 20.00th=[ 2128],
  72. | 30.00th=[ 2384], 40.00th=[17024], 50.00th=[17280], 60.00th=[17536],
  73. | 70.00th=[17792], 80.00th=[18048], 90.00th=[18560], 95.00th=[19072],
  74. | 99.00th=[21120], 99.50th=[22144], 99.90th=[23680], 99.95th=[24448],
  75. | 99.99th=[28032]
  76. bw ( KiB/s): min=277800, max=491776, per=99.55%, avg=308354.15, stdev=49009.02, samples=67
  77. iops : min=69450, max=122944, avg=77088.51, stdev=12252.26, samples=67
  78. lat (usec) : 2=11.33%, 4=21.22%, 10=0.03%, 20=65.76%, 50=1.65%
  79. lat (usec) : 100=0.01%, 250=0.01%
  80. cpu : usr=2.44%, sys=97.55%, ctx=12, majf=0, minf=9
  81. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  82. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  83. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  84. issued rwts: total=2621440,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  85. latency : target=0, window=0, percentile=100.00%, depth=1
  86.  
  87. Run status group 0 (all jobs):
  88. READ: bw=302MiB/s (317MB/s), 302MiB/s-302MiB/s (317MB/s-317MB/s), io=10.0GiB (10.7GB), run=33854-33854msec
  89. sync_seqwrite: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1
  90. fio-3.33
  91. Starting 1 process
  92. sync_seqwrite: Laying out IO file (1 file / 5120MiB)
  93.  
  94. sync_seqwrite: (groupid=0, jobs=1): err= 0: pid=204251: Fri Jun 14 15:36:39 2024
  95. write: IOPS=458, BW=1833MiB/s (1922MB/s)(5120MiB/2793msec); 0 zone resets
  96. clat (usec): min=944, max=3891, avg=1296.07, stdev=528.37
  97. lat (usec): min=944, max=3892, avg=1296.28, stdev=528.60
  98. clat percentiles (usec):
  99. | 1.00th=[ 963], 5.00th=[ 988], 10.00th=[ 1012], 20.00th=[ 1037],
  100. | 30.00th=[ 1045], 40.00th=[ 1057], 50.00th=[ 1090], 60.00th=[ 1139],
  101. | 70.00th=[ 1205], 80.00th=[ 1319], 90.00th=[ 2180], 95.00th=[ 2606],
  102. | 99.00th=[ 3359], 99.50th=[ 3523], 99.90th=[ 3654], 99.95th=[ 3884],
  103. | 99.99th=[ 3884]
  104. bw ( MiB/s): min= 894, max= 2176, per=97.65%, avg=1790.04, stdev=533.05, samples=5
  105. iops : min= 223, max= 544, avg=447.40, stdev=133.49, samples=5
  106. lat (usec) : 1000=7.19%
  107. lat (msec) : 2=81.95%, 4=10.86%
  108. cpu : usr=39.51%, sys=29.37%, ctx=3586, majf=0, minf=12
  109. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  110. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  111. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  112. issued rwts: total=0,1280,0,0 short=0,0,0,0 dropped=0,0,0,0
  113. latency : target=0, window=0, percentile=100.00%, depth=1
  114.  
  115. Run status group 0 (all jobs):
  116. WRITE: bw=1833MiB/s (1922MB/s), 1833MiB/s-1833MiB/s (1922MB/s-1922MB/s), io=5120MiB (5369MB), run=2793-2793msec
  117. sync_seqread: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1
  118. fio-3.33
  119. Starting 1 process
  120. sync_seqread: Laying out IO file (1 file / 1024MiB)
  121.  
  122. sync_seqread: (groupid=0, jobs=1): err= 0: pid=204356: Fri Jun 14 15:36:42 2024
  123. read: IOPS=1262, BW=5052MiB/s (5297MB/s)(10.0GiB/2027msec)
  124. clat (usec): min=358, max=3169, avg=784.78, stdev=210.26
  125. lat (usec): min=358, max=3170, avg=784.84, stdev=210.27
  126. clat percentiles (usec):
  127. | 1.00th=[ 359], 5.00th=[ 363], 10.00th=[ 461], 20.00th=[ 498],
  128. | 30.00th=[ 709], 40.00th=[ 725], 50.00th=[ 930], 60.00th=[ 938],
  129. | 70.00th=[ 947], 80.00th=[ 947], 90.00th=[ 963], 95.00th=[ 971],
  130. | 99.00th=[ 996], 99.50th=[ 1004], 99.90th=[ 1037], 99.95th=[ 1037],
  131. | 99.99th=[ 3163]
  132. bw ( MiB/s): min= 4624, max= 6072, per=98.94%, avg=4998.00, stdev=716.21, samples=4
  133. iops : min= 1156, max= 1518, avg=1249.50, stdev=179.05, samples=4
  134. lat (usec) : 500=20.23%, 750=24.84%, 1000=54.22%
  135. lat (msec) : 2=0.66%, 4=0.04%
  136. cpu : usr=0.15%, sys=99.70%, ctx=2, majf=0, minf=1036
  137. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  138. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  139. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  140. issued rwts: total=2560,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  141. latency : target=0, window=0, percentile=100.00%, depth=1
  142.  
  143. Run status group 0 (all jobs):
  144. READ: bw=5052MiB/s (5297MB/s), 5052MiB/s-5052MiB/s (5297MB/s-5297MB/s), io=10.0GiB (10.7GB), run=2027-2027msec
  145. async_uncached_randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  146. ...
  147. fio-3.33
  148. Starting 4 processes
  149. async_uncached_randwrite: Laying out IO file (1 file / 1024MiB)
  150.  
  151. async_uncached_randwrite: (groupid=0, jobs=4): err= 0: pid=204413: Fri Jun 14 15:36:48 2024
  152. write: IOPS=174k, BW=678MiB/s (711MB/s)(4096MiB/6037msec); 0 zone resets
  153. slat (usec): min=2, max=12715, avg=20.30, stdev=29.84
  154. clat (nsec): min=713, max=17992k, avg=698557.41, stdev=376852.08
  155. lat (usec): min=4, max=18072, avg=718.85, stdev=387.44
  156. clat percentiles (usec):
  157. | 1.00th=[ 208], 5.00th=[ 285], 10.00th=[ 347], 20.00th=[ 404],
  158. | 30.00th=[ 453], 40.00th=[ 506], 50.00th=[ 594], 60.00th=[ 717],
  159. | 70.00th=[ 857], 80.00th=[ 1020], 90.00th=[ 1205], 95.00th=[ 1319],
  160. | 99.00th=[ 1565], 99.50th=[ 1680], 99.90th=[ 2040], 99.95th=[ 2868],
  161. | 99.99th=[13829]
  162. bw ( KiB/s): min=591312, max=846416, per=99.09%, avg=688452.61, stdev=20153.91, samples=45
  163. iops : min=147828, max=211604, avg=172113.15, stdev=5038.48, samples=45
  164. lat (nsec) : 750=0.01%
  165. lat (usec) : 2=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.01%
  166. lat (usec) : 250=3.10%, 500=35.77%, 750=23.57%, 1000=16.28%
  167. lat (msec) : 2=21.16%, 4=0.08%, 10=0.01%, 20=0.01%
  168. cpu : usr=9.65%, sys=89.52%, ctx=1792, majf=0, minf=44
  169. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  170. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  171. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  172. issued rwts: total=0,1048576,0,0 short=0,0,0,0 dropped=0,0,0,0
  173. latency : target=0, window=0, percentile=100.00%, depth=32
  174.  
  175. Run status group 0 (all jobs):
  176. WRITE: bw=678MiB/s (711MB/s), 678MiB/s-678MiB/s (711MB/s-711MB/s), io=4096MiB (4295MB), run=6037-6037msec
  177. async_cached_randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  178. ...
  179. fio-3.33
  180. Starting 4 processes
  181. async_cached_randwrite: Laying out IO file (1 file / 1024MiB)
  182.  
  183. async_cached_randwrite: (groupid=0, jobs=4): err= 0: pid=204480: Fri Jun 14 15:36:55 2024
  184. write: IOPS=178k, BW=696MiB/s (730MB/s)(4096MiB/5883msec); 0 zone resets
  185. slat (usec): min=2, max=11475, avg=19.99, stdev=21.73
  186. clat (nsec): min=1109, max=12997k, avg=690949.91, stdev=341747.63
  187. lat (usec): min=8, max=13035, avg=710.94, stdev=351.72
  188. clat percentiles (usec):
  189. | 1.00th=[ 265], 5.00th=[ 322], 10.00th=[ 351], 20.00th=[ 396],
  190. | 30.00th=[ 437], 40.00th=[ 490], 50.00th=[ 578], 60.00th=[ 709],
  191. | 70.00th=[ 857], 80.00th=[ 1020], 90.00th=[ 1205], 95.00th=[ 1319],
  192. | 99.00th=[ 1516], 99.50th=[ 1582], 99.90th=[ 1876], 99.95th=[ 2180],
  193. | 99.99th=[ 3884]
  194. bw ( KiB/s): min=621656, max=780576, per=97.86%, avg=697709.09, stdev=12933.17, samples=44
  195. iops : min=155414, max=195144, avg=174427.45, stdev=3233.25, samples=44
  196. lat (usec) : 2=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=0.69%
  197. lat (usec) : 500=40.95%, 750=21.36%, 1000=15.65%
  198. lat (msec) : 2=21.27%, 4=0.06%, 10=0.01%, 20=0.01%
  199. cpu : usr=9.73%, sys=89.79%, ctx=1718, majf=0, minf=44
  200. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  201. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  202. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  203. issued rwts: total=0,1048576,0,0 short=0,0,0,0 dropped=0,0,0,0
  204. latency : target=0, window=0, percentile=100.00%, depth=32
  205.  
  206. Run status group 0 (all jobs):
  207. WRITE: bw=696MiB/s (730MB/s), 696MiB/s-696MiB/s (730MB/s-730MB/s), io=4096MiB (4295MB), run=5883-5883msec
  208. async_uncached_randread: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  209. ...
  210. fio-3.33
  211. Starting 4 processes
  212. async_uncached_randread: Laying out IO file (1 file / 1024MiB)
  213.  
  214. async_uncached_randread: (groupid=0, jobs=4): err= 0: pid=204542: Fri Jun 14 15:37:37 2024
  215. read: IOPS=256k, BW=1001MiB/s (1049MB/s)(40.0GiB/40927msec)
  216. slat (nsec): min=1292, max=256430, avg=15172.33, stdev=7919.98
  217. clat (nsec): min=628, max=1295.3k, avg=483012.29, stdev=77550.72
  218. lat (usec): min=2, max=1369, avg=498.18, stdev=79.66
  219. clat percentiles (usec):
  220. | 1.00th=[ 194], 5.00th=[ 330], 10.00th=[ 388], 20.00th=[ 437],
  221. | 30.00th=[ 465], 40.00th=[ 486], 50.00th=[ 498], 60.00th=[ 515],
  222. | 70.00th=[ 529], 80.00th=[ 537], 90.00th=[ 562], 95.00th=[ 578],
  223. | 99.00th=[ 603], 99.50th=[ 611], 99.90th=[ 627], 99.95th=[ 644],
  224. | 99.99th=[ 807]
  225. bw ( KiB/s): min=949864, max=1511544, per=99.98%, avg=1024632.69, stdev=27312.16, samples=324
  226. iops : min=237466, max=377886, avg=256158.20, stdev=6828.04, samples=324
  227. lat (nsec) : 750=0.01%, 1000=0.01%
  228. lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  229. lat (usec) : 100=0.02%, 250=2.10%, 500=48.46%, 750=49.40%, 1000=0.02%
  230. lat (msec) : 2=0.01%
  231. cpu : usr=2.54%, sys=97.43%, ctx=2948, majf=0, minf=168
  232. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  233. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  234. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  235. issued rwts: total=10485760,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  236. latency : target=0, window=0, percentile=100.00%, depth=32
  237.  
  238. Run status group 0 (all jobs):
  239. READ: bw=1001MiB/s (1049MB/s), 1001MiB/s-1001MiB/s (1049MB/s-1049MB/s), io=40.0GiB (42.9GB), run=40927-40927msec
  240. async_cached_randread: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  241. ...
  242. fio-3.33
  243. Starting 4 processes
  244. async_cached_randread: Laying out IO file (1 file / 1024MiB)
  245.  
  246. async_cached_randread: (groupid=0, jobs=4): err= 0: pid=204688: Fri Jun 14 15:38:21 2024
  247. read: IOPS=248k, BW=970MiB/s (1017MB/s)(40.0GiB/42230msec)
  248. slat (nsec): min=1292, max=119927, avg=15305.26, stdev=8020.60
  249. clat (nsec): min=542, max=1338.3k, avg=487204.24, stdev=79482.79
  250. lat (usec): min=2, max=1390, avg=502.51, stdev=81.66
  251. clat percentiles (usec):
  252. | 1.00th=[ 196], 5.00th=[ 334], 10.00th=[ 388], 20.00th=[ 441],
  253. | 30.00th=[ 469], 40.00th=[ 490], 50.00th=[ 502], 60.00th=[ 519],
  254. | 70.00th=[ 529], 80.00th=[ 545], 90.00th=[ 570], 95.00th=[ 586],
  255. | 99.00th=[ 611], 99.50th=[ 619], 99.90th=[ 644], 99.95th=[ 652],
  256. | 99.99th=[ 783]
  257. bw ( KiB/s): min=944139, max=1467928, per=100.00%, avg=1015582.75, stdev=27220.78, samples=328
  258. iops : min=236035, max=366982, avg=253895.51, stdev=6805.23, samples=328
  259. lat (nsec) : 750=0.01%, 1000=0.01%
  260. lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  261. lat (usec) : 100=0.02%, 250=2.05%, 500=45.49%, 750=52.42%, 1000=0.01%
  262. lat (msec) : 2=0.01%
  263. cpu : usr=2.61%, sys=97.37%, ctx=2879, majf=0, minf=170
  264. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  265. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  266. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  267. issued rwts: total=10485760,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  268. latency : target=0, window=0, percentile=100.00%, depth=32
  269.  
  270. Run status group 0 (all jobs):
  271. READ: bw=970MiB/s (1017MB/s), 970MiB/s-970MiB/s (1017MB/s-1017MB/s), io=40.0GiB (42.9GB), run=42230-42230msec
  272. async_uncached_seqwrite: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  273. ...
  274. fio-3.33
  275. Starting 4 processes
  276. async_uncached_seqwrite: Laying out IO file (1 file / 2048MiB)
  277.  
  278. async_uncached_seqwrite: (groupid=0, jobs=4): err= 0: pid=204806: Fri Jun 14 15:38:23 2024
  279. write: IOPS=1912, BW=7649MiB/s (8020MB/s)(8192MiB/1071msec); 0 zone resets
  280. slat (usec): min=323, max=7749, avg=645.83, stdev=335.28
  281. clat (usec): min=2, max=89259, avg=58494.39, stdev=15879.26
  282. lat (usec): min=481, max=90561, avg=59140.23, stdev=15950.61
  283. clat percentiles (usec):
  284. | 1.00th=[ 7635], 5.00th=[34866], 10.00th=[35390], 20.00th=[47449],
  285. | 30.00th=[54789], 40.00th=[55837], 50.00th=[56886], 60.00th=[61080],
  286. | 70.00th=[71828], 80.00th=[72877], 90.00th=[77071], 95.00th=[80217],
  287. | 99.00th=[84411], 99.50th=[87557], 99.90th=[88605], 99.95th=[88605],
  288. | 99.99th=[89654]
  289. bw ( MiB/s): min= 7473, max= 7563, per=98.30%, avg=7518.69, stdev=31.85, samples=5
  290. iops : min= 1867, max= 1890, avg=1878.50, stdev= 8.13, samples=5
  291. lat (usec) : 4=0.20%
  292. lat (msec) : 2=0.15%, 4=0.24%, 10=0.68%, 20=1.12%, 50=19.38%
  293. lat (msec) : 100=78.22%
  294. cpu : usr=66.85%, sys=30.54%, ctx=1372, majf=0, minf=48
  295. IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=93.9%, >=64=0.0%
  296. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  297. complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
  298. issued rwts: total=0,2048,0,0 short=0,0,0,0 dropped=0,0,0,0
  299. latency : target=0, window=0, percentile=100.00%, depth=32
  300.  
  301. Run status group 0 (all jobs):
  302. WRITE: bw=7649MiB/s (8020MB/s), 7649MiB/s-7649MiB/s (8020MB/s-8020MB/s), io=8192MiB (8590MB), run=1071-1071msec
  303. async_cached_seqwrite: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  304. ...
  305. fio-3.33
  306. Starting 4 processes
  307. async_cached_seqwrite: Laying out IO file (1 file / 2048MiB)
  308.  
  309. async_cached_seqwrite: (groupid=0, jobs=4): err= 0: pid=204876: Fri Jun 14 15:38:24 2024
  310. write: IOPS=2052, BW=8208MiB/s (8607MB/s)(8192MiB/998msec); 0 zone resets
  311. slat (usec): min=325, max=3341, avg=628.02, stdev=237.54
  312. clat (nsec): min=1981, max=82251k, avg=55333276.83, stdev=15540331.49
  313. lat (usec): min=447, max=82929, avg=55961.30, stdev=15606.40
  314. clat percentiles (usec):
  315. | 1.00th=[ 6718], 5.00th=[35390], 10.00th=[37487], 20.00th=[43254],
  316. | 30.00th=[45876], 40.00th=[53740], 50.00th=[54789], 60.00th=[55837],
  317. | 70.00th=[62653], 80.00th=[73925], 90.00th=[77071], 95.00th=[78119],
  318. | 99.00th=[80217], 99.50th=[80217], 99.90th=[81265], 99.95th=[81265],
  319. | 99.99th=[82314]
  320. bw ( MiB/s): min= 7028, max= 7028, per=85.62%, avg=7028.28, stdev= 0.00, samples=4
  321. iops : min= 1757, max= 1757, avg=1757.00, stdev= 0.00, samples=4
  322. lat (usec) : 2=0.05%, 4=0.15%
  323. lat (msec) : 2=0.20%, 4=0.24%, 10=0.83%, 20=1.27%, 50=32.32%
  324. lat (msec) : 100=64.94%
  325. cpu : usr=66.12%, sys=27.16%, ctx=2589, majf=0, minf=42
  326. IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=93.9%, >=64=0.0%
  327. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  328. complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
  329. issued rwts: total=0,2048,0,0 short=0,0,0,0 dropped=0,0,0,0
  330. latency : target=0, window=0, percentile=100.00%, depth=32
  331.  
  332. Run status group 0 (all jobs):
  333. WRITE: bw=8208MiB/s (8607MB/s), 8208MiB/s-8208MiB/s (8607MB/s-8607MB/s), io=8192MiB (8590MB), run=998-998msec
  334. async_uncached_seqread: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  335. ...
  336. fio-3.33
  337. Starting 4 processes
  338. async_uncached_seqread: Laying out IO file (1 file / 1024MiB)
  339.  
  340. async_uncached_seqread: (groupid=0, jobs=4): err= 0: pid=204935: Fri Jun 14 15:38:33 2024
  341. read: IOPS=6403, BW=25.0GiB/s (26.9GB/s)(200GiB/7996msec)
  342. slat (usec): min=324, max=2311, avg=600.81, stdev=84.45
  343. clat (nsec): min=1352, max=66144k, avg=17410799.85, stdev=4210654.80
  344. lat (usec): min=347, max=68311, avg=18011.61, stdev=4255.36
  345. clat percentiles (usec):
  346. | 1.00th=[ 1045], 5.00th=[ 6718], 10.00th=[13698], 20.00th=[17171],
  347. | 30.00th=[18482], 40.00th=[18482], 50.00th=[18482], 60.00th=[18482],
  348. | 70.00th=[18744], 80.00th=[18744], 90.00th=[19530], 95.00th=[19792],
  349. | 99.00th=[25297], 99.50th=[32900], 99.90th=[40633], 99.95th=[48497],
  350. | 99.99th=[58983]
  351. bw ( MiB/s): min=21312, max=27264, per=100.00%, avg=26094.93, stdev=405.22, samples=60
  352. iops : min= 5328, max= 6816, avg=6523.73, stdev=101.31, samples=60
  353. lat (usec) : 2=0.25%, 4=0.14%, 500=0.01%, 750=0.39%, 1000=0.01%
  354. lat (msec) : 2=0.79%, 4=1.39%, 10=4.38%, 20=90.29%, 50=2.33%
  355. lat (msec) : 100=0.04%
  356. cpu : usr=0.19%, sys=98.19%, ctx=118889, majf=0, minf=131118
  357. IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=87.9%, >=64=0.0%
  358. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  359. complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.4%, 64=0.0%, >=64=0.0%
  360. issued rwts: total=51200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  361. latency : target=0, window=0, percentile=100.00%, depth=32
  362.  
  363. Run status group 0 (all jobs):
  364. READ: bw=25.0GiB/s (26.9GB/s), 25.0GiB/s-25.0GiB/s (26.9GB/s-26.9GB/s), io=200GiB (215GB), run=7996-7996msec
  365. async_cached_seqread: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  366. ...
  367. fio-3.33
  368. Starting 4 processes
  369. async_cached_seqread: Laying out IO file (1 file / 1024MiB)
  370.  
  371. async_cached_seqread: (groupid=0, jobs=4): err= 0: pid=205004: Fri Jun 14 15:38:42 2024
  372. read: IOPS=6361, BW=24.8GiB/s (26.7GB/s)(200GiB/8049msec)
  373. slat (usec): min=353, max=2358, avg=617.21, stdev=93.39
  374. clat (nsec): min=1475, max=69232k, avg=17862471.99, stdev=4288518.16
  375. lat (usec): min=477, max=71533, avg=18479.68, stdev=4335.65
  376. clat percentiles (usec):
  377. | 1.00th=[ 1090], 5.00th=[ 6849], 10.00th=[14091], 20.00th=[17957],
  378. | 30.00th=[18744], 40.00th=[18744], 50.00th=[19006], 60.00th=[19006],
  379. | 70.00th=[19006], 80.00th=[19268], 90.00th=[20317], 95.00th=[20579],
  380. | 99.00th=[22152], 99.50th=[22152], 99.90th=[48497], 99.95th=[57410],
  381. | 99.99th=[67634]
  382. bw ( MiB/s): min=19616, max=26560, per=99.81%, avg=25396.00, stdev=400.66, samples=64
  383. iops : min= 4904, max= 6640, avg=6349.00, stdev=100.17, samples=64
  384. lat (usec) : 2=0.25%, 4=0.14%, 500=0.01%, 750=0.38%, 1000=0.01%
  385. lat (msec) : 2=0.77%, 4=1.38%, 10=4.26%, 20=76.38%, 50=16.33%
  386. lat (msec) : 100=0.09%
  387. cpu : usr=0.21%, sys=98.11%, ctx=126832, majf=0, minf=131116
  388. IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=87.9%, >=64=0.0%
  389. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  390. complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.4%, 64=0.0%, >=64=0.0%
  391. issued rwts: total=51200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  392. latency : target=0, window=0, percentile=100.00%, depth=32
  393.  
  394. Run status group 0 (all jobs):
  395. READ: bw=24.8GiB/s (26.7GB/s), 24.8GiB/s-24.8GiB/s (26.7GB/s-26.7GB/s), io=200GiB (215GB), run=8049-8049msec
  396. Linux 6.7.4 (rescue) 06/14/2024 _x86_64_ (48 CPU)
  397.  
  398. avg-cpu: %user %nice %system %iowait %steal %idle
  399. 0.14 0.00 1.35 0.01 0.00 98.50
  400.  
  401. Device tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd
  402. loop0 0.34 7.70 0.00 0.00 440805 0 0
  403. nvme0n1 467.18 9.03 25244.28 0.00 516784 1444452908 0
  404. nvme1n1 429.67 7.75 23365.79 0.00 443514 1336967730 0
  405. nvme2n1 403.23 7.28 21561.21 0.00 416551 1233711480 0
  406. nvme3n1 339.11 6.47 18467.46 0.00 370267 1056690064 0
  407. nvme4n1 306.08 5.29 14329.63 0.00 302405 819927210 0
  408. nvme5n1 207.77 4.29 11046.92 0.00 245442 632094131 0
  409. nvme6n1 137.66 2.67 6865.07 0.00 153026 392812467 0
  410. nvme7n1 85.61 1.69 4076.86 0.00 96943 233274184 0
  411. sda 0.00 0.04 0.00 0.00 2434 0 0
  412.  
  413.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!