API tools faq
paste
Guest User

1DiskZFS.txt

a guest
Jun 14th, 2024
102
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 23.85 KB | None | 0 0
raw download clone embed print report
  1. state: ONLINE
  2. config:
  3.  
  4. NAME STATE READ WRITE CKSUM
  5. tank ONLINE 0 0 0
  6. nvme0n1 ONLINE 0 0 0
  7.  
  8. errors: No known data errors
  9. NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
  10. tank 1.73T 456K 1.73T - - 0% 0% 1.00x ONLINE -
  11. Version 2.00a ------Sequential Output------ --Sequential Input- --Random-
  12. -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- --Seeks--
  13. Name:Size etc /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
  14. rescue 16G::4 1.9g 92 1.6g 95 4.2g 99 +++++ +++
  15. Latency 8157us 617us 71us 931us
  16. Version 2.00a ------Sequential Create------ --------Random Create--------
  17. rescue -Create-- --Read--- -Delete-- -Create-- --Read--- -Delete--
  18. files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP
  19. 1 +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++ +++++ +++
  20. Latency 627us 4us 159us 113us 2us 72us
  21. 1.98,2.00a,rescue,4,1718509076,16G,,8192,5,,,1995933,92,1643314,95,,,4448589,99,+++++,+++,1,,,,,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,+++++,+++,,8157us,617us,,71us,931us,627us,4us,159us,113us,2us,72us
  22. sync_randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
  23. fio-3.33
  24. Starting 1 process
  25. sync_randwrite: Laying out IO file (1 file / 1024MiB)
  26.  
  27. sync_randwrite: (groupid=0, jobs=1): err= 0: pid=147822: Fri Jun 14 12:44:37 2024
  28. write: IOPS=13.3k, BW=52.1MiB/s (54.6MB/s)(1024MiB/19669msec); 0 zone resets
  29. clat (usec): min=34, max=15514, avg=73.34, stdev=96.34
  30. lat (usec): min=34, max=15514, avg=73.37, stdev=96.35
  31. clat percentiles (usec):
  32. | 1.00th=[ 46], 5.00th=[ 49], 10.00th=[ 50], 20.00th=[ 51],
  33. | 30.00th=[ 55], 40.00th=[ 57], 50.00th=[ 60], 60.00th=[ 65],
  34. | 70.00th=[ 74], 80.00th=[ 82], 90.00th=[ 99], 95.00th=[ 116],
  35. | 99.00th=[ 392], 99.50th=[ 457], 99.90th=[ 594], 99.95th=[ 627],
  36. | 99.99th=[ 988]
  37. bw ( KiB/s): min= 7832, max=75848, per=99.67%, avg=53134.56, stdev=11911.25, samples=39
  38. iops : min= 1958, max=18962, avg=13283.69, stdev=2977.76, samples=39
  39. lat (usec) : 50=13.19%, 100=77.47%, 250=7.89%, 500=1.14%, 750=0.30%
  40. lat (usec) : 1000=0.01%
  41. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%
  42. cpu : usr=3.11%, sys=34.87%, ctx=263182, majf=0, minf=12
  43. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  44. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  45. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  46. issued rwts: total=0,262144,0,0 short=0,0,0,0 dropped=0,0,0,0
  47. latency : target=0, window=0, percentile=100.00%, depth=1
  48.  
  49. Run status group 0 (all jobs):
  50. WRITE: bw=52.1MiB/s (54.6MB/s), 52.1MiB/s-52.1MiB/s (54.6MB/s-54.6MB/s), io=1024MiB (1074MB), run=19669-19669msec
  51. sync_randread: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=1
  52. fio-3.33
  53. Starting 1 process
  54. sync_randread: Laying out IO file (1 file / 1024MiB)
  55.  
  56. sync_randread: (groupid=0, jobs=1): err= 0: pid=147945: Fri Jun 14 12:45:13 2024
  57. read: IOPS=77.6k, BW=303MiB/s (318MB/s)(10.0GiB/33802msec)
  58. clat (nsec): min=1042, max=131576, avg=12681.35, stdev=7349.72
  59. lat (nsec): min=1062, max=132532, avg=12707.94, stdev=7350.57
  60. clat percentiles (nsec):
  61. | 1.00th=[ 1512], 5.00th=[ 1864], 10.00th=[ 1976], 20.00th=[ 2128],
  62. | 30.00th=[ 2416], 40.00th=[16768], 50.00th=[17280], 60.00th=[17280],
  63. | 70.00th=[17536], 80.00th=[17792], 90.00th=[18560], 95.00th=[19072],
  64. | 99.00th=[21376], 99.50th=[22144], 99.90th=[23424], 99.95th=[23936],
  65. | 99.99th=[27008]
  66. bw ( KiB/s): min=275800, max=499576, per=99.56%, avg=308838.57, stdev=50049.96, samples=67
  67. iops : min=68950, max=124894, avg=77209.73, stdev=12512.60, samples=67
  68. lat (usec) : 2=11.67%, 4=20.50%, 10=0.03%, 20=65.88%, 50=1.93%
  69. lat (usec) : 100=0.01%, 250=0.01%
  70. cpu : usr=2.07%, sys=97.92%, ctx=6, majf=0, minf=13
  71. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  72. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  73. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  74. issued rwts: total=2621440,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  75. latency : target=0, window=0, percentile=100.00%, depth=1
  76.  
  77. Run status group 0 (all jobs):
  78. READ: bw=303MiB/s (318MB/s), 303MiB/s-303MiB/s (318MB/s-318MB/s), io=10.0GiB (10.7GB), run=33802-33802msec
  79. sync_seqwrite: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1
  80. fio-3.33
  81. Starting 1 process
  82. sync_seqwrite: Laying out IO file (1 file / 5120MiB)
  83.  
  84. sync_seqwrite: (groupid=0, jobs=1): err= 0: pid=148031: Fri Jun 14 12:45:17 2024
  85. write: IOPS=325, BW=1302MiB/s (1365MB/s)(5120MiB/3933msec); 0 zone resets
  86. clat (usec): min=1486, max=3693, avg=1913.54, stdev=391.38
  87. lat (usec): min=1486, max=3694, avg=1913.76, stdev=391.56
  88. clat percentiles (usec):
  89. | 1.00th=[ 1500], 5.00th=[ 1516], 10.00th=[ 1532], 20.00th=[ 1647],
  90. | 30.00th=[ 1745], 40.00th=[ 1827], 50.00th=[ 1860], 60.00th=[ 1876],
  91. | 70.00th=[ 1893], 80.00th=[ 1942], 90.00th=[ 2343], 95.00th=[ 3032],
  92. | 99.00th=[ 3359], 99.50th=[ 3490], 99.90th=[ 3589], 99.95th=[ 3687],
  93. | 99.99th=[ 3687]
  94. bw ( MiB/s): min= 840, max= 1440, per=98.94%, avg=1288.00, stdev=215.41, samples=7
  95. iops : min= 210, max= 360, avg=322.00, stdev=53.85, samples=7
  96. lat (msec) : 2=82.34%, 4=17.66%
  97. cpu : usr=36.57%, sys=19.94%, ctx=3821, majf=0, minf=10
  98. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  99. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  100. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  101. issued rwts: total=0,1280,0,0 short=0,0,0,0 dropped=0,0,0,0
  102. latency : target=0, window=0, percentile=100.00%, depth=1
  103.  
  104. Run status group 0 (all jobs):
  105. WRITE: bw=1302MiB/s (1365MB/s), 1302MiB/s-1302MiB/s (1365MB/s-1365MB/s), io=5120MiB (5369MB), run=3933-3933msec
  106. sync_seqread: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=1
  107. fio-3.33
  108. Starting 1 process
  109. sync_seqread: Laying out IO file (1 file / 1024MiB)
  110.  
  111. sync_seqread: (groupid=0, jobs=1): err= 0: pid=148096: Fri Jun 14 12:45:20 2024
  112. read: IOPS=1294, BW=5177MiB/s (5428MB/s)(10.0GiB/1978msec)
  113. clat (usec): min=366, max=5423, avg=766.22, stdev=227.69
  114. lat (usec): min=366, max=5424, avg=766.27, stdev=227.70
  115. clat percentiles (usec):
  116. | 1.00th=[ 367], 5.00th=[ 371], 10.00th=[ 379], 20.00th=[ 474],
  117. | 30.00th=[ 717], 40.00th=[ 734], 50.00th=[ 742], 60.00th=[ 930],
  118. | 70.00th=[ 947], 80.00th=[ 955], 90.00th=[ 971], 95.00th=[ 988],
  119. | 99.00th=[ 1156], 99.50th=[ 1221], 99.90th=[ 1270], 99.95th=[ 1401],
  120. | 99.99th=[ 5407]
  121. bw ( MiB/s): min= 4496, max= 5568, per=94.32%, avg=4882.67, stdev=595.14, samples=3
  122. iops : min= 1124, max= 1392, avg=1220.67, stdev=148.79, samples=3
  123. lat (usec) : 500=20.31%, 750=34.18%, 1000=41.56%
  124. lat (msec) : 2=3.91%, 10=0.04%
  125. cpu : usr=0.15%, sys=99.70%, ctx=2, majf=0, minf=1034
  126. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  127. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  128. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  129. issued rwts: total=2560,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  130. latency : target=0, window=0, percentile=100.00%, depth=1
  131.  
  132. Run status group 0 (all jobs):
  133. READ: bw=5177MiB/s (5428MB/s), 5177MiB/s-5177MiB/s (5428MB/s-5428MB/s), io=10.0GiB (10.7GB), run=1978-1978msec
  134. async_uncached_randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  135. ...
  136. fio-3.33
  137. Starting 4 processes
  138. async_uncached_randwrite: Laying out IO file (1 file / 1024MiB)
  139.  
  140. async_uncached_randwrite: (groupid=0, jobs=4): err= 0: pid=148151: Fri Jun 14 12:45:24 2024
  141. write: IOPS=325k, BW=1269MiB/s (1331MB/s)(4096MiB/3228msec); 0 zone resets
  142. slat (usec): min=2, max=7974, avg=10.43, stdev=20.40
  143. clat (nsec): min=758, max=9717.9k, avg=375455.13, stdev=227489.15
  144. lat (usec): min=3, max=9773, avg=385.89, stdev=233.75
  145. clat percentiles (usec):
  146. | 1.00th=[ 206], 5.00th=[ 255], 10.00th=[ 262], 20.00th=[ 269],
  147. | 30.00th=[ 277], 40.00th=[ 289], 50.00th=[ 310], 60.00th=[ 338],
  148. | 70.00th=[ 363], 80.00th=[ 404], 90.00th=[ 562], 95.00th=[ 791],
  149. | 99.00th=[ 1139], 99.50th=[ 1352], 99.90th=[ 2671], 99.95th=[ 3621],
  150. | 99.99th=[ 5669]
  151. bw ( MiB/s): min= 696, max= 1647, per=100.00%, avg=1271.21, stdev=86.29, samples=24
  152. iops : min=178282, max=421632, avg=325429.00, stdev=22089.33, samples=24
  153. lat (nsec) : 1000=0.01%
  154. lat (usec) : 10=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=3.26%
  155. lat (usec) : 500=84.25%, 750=6.90%, 1000=3.54%
  156. lat (msec) : 2=1.84%, 4=0.16%, 10=0.04%
  157. cpu : usr=12.61%, sys=85.61%, ctx=4720, majf=0, minf=40
  158. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  159. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  160. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  161. issued rwts: total=0,1048576,0,0 short=0,0,0,0 dropped=0,0,0,0
  162. latency : target=0, window=0, percentile=100.00%, depth=32
  163.  
  164. Run status group 0 (all jobs):
  165. WRITE: bw=1269MiB/s (1331MB/s), 1269MiB/s-1269MiB/s (1331MB/s-1331MB/s), io=4096MiB (4295MB), run=3228-3228msec
  166. async_cached_randwrite: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  167. ...
  168. fio-3.33
  169. Starting 4 processes
  170. async_cached_randwrite: Laying out IO file (1 file / 1024MiB)
  171.  
  172. async_cached_randwrite: (groupid=0, jobs=4): err= 0: pid=148275: Fri Jun 14 12:45:28 2024
  173. write: IOPS=314k, BW=1225MiB/s (1285MB/s)(4096MiB/3343msec); 0 zone resets
  174. slat (usec): min=3, max=3254, avg=10.67, stdev=15.22
  175. clat (nsec): min=828, max=7629.2k, avg=385208.21, stdev=195717.51
  176. lat (usec): min=5, max=7655, avg=395.87, stdev=201.34
  177. clat percentiles (usec):
  178. | 1.00th=[ 223], 5.00th=[ 253], 10.00th=[ 269], 20.00th=[ 281],
  179. | 30.00th=[ 297], 40.00th=[ 326], 50.00th=[ 338], 60.00th=[ 351],
  180. | 70.00th=[ 371], 80.00th=[ 408], 90.00th=[ 562], 95.00th=[ 775],
  181. | 99.00th=[ 1090], 99.50th=[ 1221], 99.90th=[ 2245], 99.95th=[ 2900],
  182. | 99.99th=[ 4424]
  183. bw ( MiB/s): min= 735, max= 1528, per=99.54%, avg=1219.60, stdev=64.60, samples=24
  184. iops : min=188238, max=391408, avg=312218.67, stdev=16536.97, samples=24
  185. lat (nsec) : 1000=0.01%
  186. lat (usec) : 2=0.01%, 10=0.01%, 20=0.01%, 50=0.01%, 100=0.01%
  187. lat (usec) : 250=4.63%, 500=82.69%, 750=7.38%, 1000=3.43%
  188. lat (msec) : 2=1.73%, 4=0.11%, 10=0.02%
  189. cpu : usr=12.78%, sys=85.86%, ctx=4646, majf=0, minf=44
  190. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  191. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  192. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  193. issued rwts: total=0,1048576,0,0 short=0,0,0,0 dropped=0,0,0,0
  194. latency : target=0, window=0, percentile=100.00%, depth=32
  195.  
  196. Run status group 0 (all jobs):
  197. WRITE: bw=1225MiB/s (1285MB/s), 1225MiB/s-1225MiB/s (1285MB/s-1285MB/s), io=4096MiB (4295MB), run=3343-3343msec
  198. async_uncached_randread: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  199. ...
  200. fio-3.33
  201. Starting 4 processes
  202. async_uncached_randread: Laying out IO file (1 file / 1024MiB)
  203.  
  204. async_uncached_randread: (groupid=0, jobs=4): err= 0: pid=148336: Fri Jun 14 12:46:12 2024
  205. read: IOPS=247k, BW=966MiB/s (1013MB/s)(40.0GiB/42383msec)
  206. slat (nsec): min=1279, max=163059, avg=15554.88, stdev=8082.67
  207. clat (nsec): min=619, max=1306.7k, avg=495252.84, stdev=78708.06
  208. lat (usec): min=2, max=1400, avg=510.81, stdev=80.84
  209. clat percentiles (usec):
  210. | 1.00th=[ 196], 5.00th=[ 343], 10.00th=[ 400], 20.00th=[ 453],
  211. | 30.00th=[ 478], 40.00th=[ 498], 50.00th=[ 510], 60.00th=[ 529],
  212. | 70.00th=[ 537], 80.00th=[ 553], 90.00th=[ 570], 95.00th=[ 586],
  213. | 99.00th=[ 611], 99.50th=[ 627], 99.90th=[ 644], 99.95th=[ 652],
  214. | 99.99th=[ 676]
  215. bw ( KiB/s): min=939504, max=1440400, per=100.00%, avg=999532.21, stdev=25708.44, samples=333
  216. iops : min=234874, max=360100, avg=249883.10, stdev=6427.10, samples=333
  217. lat (nsec) : 750=0.01%, 1000=0.01%
  218. lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  219. lat (usec) : 100=0.02%, 250=2.08%, 500=40.14%, 750=57.76%, 1000=0.01%
  220. lat (msec) : 2=0.01%
  221. cpu : usr=2.47%, sys=97.51%, ctx=2863, majf=0, minf=175
  222. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  223. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  224. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  225. issued rwts: total=10485760,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  226. latency : target=0, window=0, percentile=100.00%, depth=32
  227.  
  228. Run status group 0 (all jobs):
  229. READ: bw=966MiB/s (1013MB/s), 966MiB/s-966MiB/s (1013MB/s-1013MB/s), io=40.0GiB (42.9GB), run=42383-42383msec
  230. async_cached_randread: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  231. ...
  232. fio-3.33
  233. Starting 4 processes
  234. async_cached_randread: Laying out IO file (1 file / 1024MiB)
  235.  
  236. async_cached_randread: (groupid=0, jobs=4): err= 0: pid=148401: Fri Jun 14 12:46:56 2024
  237. read: IOPS=252k, BW=983MiB/s (1031MB/s)(40.0GiB/41677msec)
  238. slat (nsec): min=1275, max=198194, avg=15421.45, stdev=8016.75
  239. clat (nsec): min=606, max=1338.0k, avg=491017.84, stdev=78628.79
  240. lat (usec): min=2, max=1404, avg=506.44, stdev=80.77
  241. clat percentiles (usec):
  242. | 1.00th=[ 194], 5.00th=[ 338], 10.00th=[ 396], 20.00th=[ 449],
  243. | 30.00th=[ 474], 40.00th=[ 494], 50.00th=[ 506], 60.00th=[ 523],
  244. | 70.00th=[ 537], 80.00th=[ 545], 90.00th=[ 570], 95.00th=[ 586],
  245. | 99.00th=[ 611], 99.50th=[ 619], 99.90th=[ 644], 99.95th=[ 652],
  246. | 99.99th=[ 685]
  247. bw ( KiB/s): min=904808, max=1514760, per=100.00%, avg=1008271.61, stdev=27029.84, samples=330
  248. iops : min=226202, max=378690, avg=252067.90, stdev=6757.46, samples=330
  249. lat (nsec) : 750=0.01%, 1000=0.01%
  250. lat (usec) : 2=0.01%, 4=0.01%, 10=0.01%, 20=0.01%, 50=0.01%
  251. lat (usec) : 100=0.02%, 250=2.10%, 500=42.60%, 750=55.27%, 1000=0.01%
  252. lat (msec) : 2=0.01%
  253. cpu : usr=2.61%, sys=97.36%, ctx=2998, majf=0, minf=167
  254. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  255. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  256. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  257. issued rwts: total=10485760,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  258. latency : target=0, window=0, percentile=100.00%, depth=32
  259.  
  260. Run status group 0 (all jobs):
  261. READ: bw=983MiB/s (1031MB/s), 983MiB/s-983MiB/s (1031MB/s-1031MB/s), io=40.0GiB (42.9GB), run=41677-41677msec
  262. async_uncached_seqwrite: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  263. ...
  264. fio-3.33
  265. Starting 4 processes
  266. async_uncached_seqwrite: Laying out IO file (1 file / 2048MiB)
  267.  
  268. async_uncached_seqwrite: (groupid=0, jobs=4): err= 0: pid=148499: Fri Jun 14 12:46:58 2024
  269. write: IOPS=2351, BW=9405MiB/s (9862MB/s)(8192MiB/871msec); 0 zone resets
  270. slat (usec): min=310, max=2644, avg=590.80, stdev=217.26
  271. clat (usec): min=2, max=83963, avg=49202.14, stdev=12273.68
  272. lat (usec): min=398, max=85689, avg=49792.94, stdev=12362.50
  273. clat percentiles (usec):
  274. | 1.00th=[ 7177], 5.00th=[40633], 10.00th=[41157], 20.00th=[43254],
  275. | 30.00th=[43254], 40.00th=[45351], 50.00th=[45876], 60.00th=[47973],
  276. | 70.00th=[53216], 80.00th=[56361], 90.00th=[63177], 95.00th=[73925],
  277. | 99.00th=[83362], 99.50th=[83362], 99.90th=[84411], 99.95th=[84411],
  278. | 99.99th=[84411]
  279. bw ( MiB/s): min= 8100, max= 8100, per=86.12%, avg=8100.04, stdev= 0.00, samples=4
  280. iops : min= 2025, max= 2025, avg=2025.00, stdev= 0.00, samples=4
  281. lat (usec) : 4=0.20%
  282. lat (msec) : 2=0.20%, 4=0.20%, 10=0.73%, 20=1.27%, 50=63.23%
  283. lat (msec) : 100=34.18%
  284. cpu : usr=63.99%, sys=31.07%, ctx=2215, majf=0, minf=56
  285. IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=93.9%, >=64=0.0%
  286. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  287. complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
  288. issued rwts: total=0,2048,0,0 short=0,0,0,0 dropped=0,0,0,0
  289. latency : target=0, window=0, percentile=100.00%, depth=32
  290.  
  291. Run status group 0 (all jobs):
  292. WRITE: bw=9405MiB/s (9862MB/s), 9405MiB/s-9405MiB/s (9862MB/s-9862MB/s), io=8192MiB (8590MB), run=871-871msec
  293. async_cached_seqwrite: (g=0): rw=write, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  294. ...
  295. fio-3.33
  296. Starting 4 processes
  297. async_cached_seqwrite: Laying out IO file (1 file / 2048MiB)
  298.  
  299. async_cached_seqwrite: (groupid=0, jobs=4): err= 0: pid=148577: Fri Jun 14 12:46:59 2024
  300. write: IOPS=1729, BW=6919MiB/s (7255MB/s)(8192MiB/1184msec); 0 zone resets
  301. slat (usec): min=409, max=1819, avg=817.88, stdev=318.92
  302. clat (usec): min=2, max=80221, avg=60831.05, stdev=13512.84
  303. lat (usec): min=644, max=81236, avg=61648.93, stdev=13569.77
  304. clat percentiles (usec):
  305. | 1.00th=[ 9503], 5.00th=[46400], 10.00th=[47973], 20.00th=[51643],
  306. | 30.00th=[54264], 40.00th=[56886], 50.00th=[57410], 60.00th=[63177],
  307. | 70.00th=[73925], 80.00th=[73925], 90.00th=[77071], 95.00th=[77071],
  308. | 99.00th=[79168], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217],
  309. | 99.99th=[80217]
  310. bw ( MiB/s): min= 6934, max= 7796, per=100.00%, avg=7365.54, stdev=192.57, samples=6
  311. iops : min= 1733, max= 1949, avg=1841.00, stdev=48.30, samples=6
  312. lat (usec) : 4=0.15%, 10=0.05%
  313. lat (msec) : 2=0.10%, 4=0.20%, 10=0.59%, 20=0.88%, 50=11.82%
  314. lat (msec) : 100=86.23%
  315. cpu : usr=58.59%, sys=28.83%, ctx=3499, majf=0, minf=44
  316. IO depths : 1=0.2%, 2=0.4%, 4=0.8%, 8=1.6%, 16=3.1%, 32=93.9%, >=64=0.0%
  317. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  318. complete : 0=0.0%, 4=99.8%, 8=0.0%, 16=0.0%, 32=0.2%, 64=0.0%, >=64=0.0%
  319. issued rwts: total=0,2048,0,0 short=0,0,0,0 dropped=0,0,0,0
  320. latency : target=0, window=0, percentile=100.00%, depth=32
  321.  
  322. Run status group 0 (all jobs):
  323. WRITE: bw=6919MiB/s (7255MB/s), 6919MiB/s-6919MiB/s (7255MB/s-7255MB/s), io=8192MiB (8590MB), run=1184-1184msec
  324. async_uncached_seqread: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  325. ...
  326. fio-3.33
  327. Starting 4 processes
  328. async_uncached_seqread: Laying out IO file (1 file / 1024MiB)
  329.  
  330. async_uncached_seqread: (groupid=0, jobs=4): err= 0: pid=148637: Fri Jun 14 12:47:09 2024
  331. read: IOPS=6415, BW=25.1GiB/s (26.9GB/s)(200GiB/7981msec)
  332. slat (usec): min=324, max=2310, avg=611.59, stdev=83.89
  333. clat (nsec): min=1421, max=65546k, avg=17743682.00, stdev=4212009.94
  334. lat (usec): min=509, max=67856, avg=18355.28, stdev=4253.56
  335. clat percentiles (usec):
  336. | 1.00th=[ 1172], 5.00th=[ 6718], 10.00th=[13960], 20.00th=[17695],
  337. | 30.00th=[18482], 40.00th=[18482], 50.00th=[18482], 60.00th=[18744],
  338. | 70.00th=[19530], 80.00th=[19792], 90.00th=[20055], 95.00th=[20841],
  339. | 99.00th=[21365], 99.50th=[21627], 99.90th=[44303], 99.95th=[53216],
  340. | 99.99th=[62129]
  341. bw ( MiB/s): min=21376, max=27392, per=100.00%, avg=25668.27, stdev=356.65, samples=60
  342. iops : min= 5344, max= 6848, avg=6417.07, stdev=89.16, samples=60
  343. lat (usec) : 2=0.23%, 4=0.16%, 10=0.01%, 750=0.39%, 1000=0.01%
  344. lat (msec) : 2=0.77%, 4=1.39%, 10=4.21%, 20=83.18%, 50=9.60%
  345. lat (msec) : 100=0.07%
  346. cpu : usr=0.18%, sys=97.68%, ctx=138822, majf=0, minf=131130
  347. IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=87.9%, >=64=0.0%
  348. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  349. complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.4%, 64=0.0%, >=64=0.0%
  350. issued rwts: total=51200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  351. latency : target=0, window=0, percentile=100.00%, depth=32
  352.  
  353. Run status group 0 (all jobs):
  354. READ: bw=25.1GiB/s (26.9GB/s), 25.1GiB/s-25.1GiB/s (26.9GB/s-26.9GB/s), io=200GiB (215GB), run=7981-7981msec
  355. async_cached_seqread: (g=0): rw=read, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=libaio, iodepth=32
  356. ...
  357. fio-3.33
  358. Starting 4 processes
  359. async_cached_seqread: Laying out IO file (1 file / 1024MiB)
  360.  
  361. async_cached_seqread: (groupid=0, jobs=4): err= 0: pid=148701: Fri Jun 14 12:47:18 2024
  362. read: IOPS=6388, BW=25.0GiB/s (26.8GB/s)(200GiB/8015msec)
  363. slat (usec): min=350, max=2616, avg=615.11, stdev=85.22
  364. clat (nsec): min=1374, max=65847k, avg=17809877.70, stdev=4189025.18
  365. lat (usec): min=483, max=68462, avg=18424.99, stdev=4229.99
  366. clat percentiles (usec):
  367. | 1.00th=[ 1205], 5.00th=[ 6783], 10.00th=[14091], 20.00th=[17957],
  368. | 30.00th=[18744], 40.00th=[19006], 50.00th=[19006], 60.00th=[19006],
  369. | 70.00th=[19006], 80.00th=[19792], 90.00th=[20317], 95.00th=[20579],
  370. | 99.00th=[20841], 99.50th=[21103], 99.90th=[44303], 99.95th=[53740],
  371. | 99.99th=[62653]
  372. bw ( MiB/s): min=21162, max=27232, per=99.81%, avg=25504.66, stdev=312.08, samples=64
  373. iops : min= 5290, max= 6808, avg=6376.12, stdev=78.06, samples=64
  374. lat (usec) : 2=0.24%, 4=0.15%, 500=0.01%, 750=0.38%
  375. lat (msec) : 2=0.78%, 4=1.38%, 10=4.30%, 20=74.56%, 50=18.13%
  376. lat (msec) : 100=0.07%
  377. cpu : usr=0.22%, sys=97.98%, ctx=128557, majf=0, minf=131118
  378. IO depths : 1=0.4%, 2=0.8%, 4=1.6%, 8=3.1%, 16=6.2%, 32=87.9%, >=64=0.0%
  379. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  380. complete : 0=0.0%, 4=99.6%, 8=0.0%, 16=0.0%, 32=0.4%, 64=0.0%, >=64=0.0%
  381. issued rwts: total=51200,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  382. latency : target=0, window=0, percentile=100.00%, depth=32
  383.  
  384. Run status group 0 (all jobs):
  385. READ: bw=25.0GiB/s (26.8GB/s), 25.0GiB/s-25.0GiB/s (26.8GB/s-26.8GB/s), io=200GiB (215GB), run=8015-8015msec
  386. Linux 6.7.4 (rescue) 06/14/2024 _x86_64_ (48 CPU)
  387.  
  388. avg-cpu: %user %nice %system %iowait %steal %idle
  389. 0.11 0.00 0.40 0.00 0.00 99.49
  390.  
  391. Device tps kB_read/s kB_wrtn/s kB_dscd/s kB_read kB_wrtn kB_dscd
  392. loop0 0.42 9.38 0.00 0.00 440029 0 0
  393. nvme0n1 81.80 6.04 1901.13 0.00 283296 89229680 0
  394. nvme1n1 60.85 4.87 718.96 0.00 228374 33744318 0
  395. nvme2n1 56.90 4.59 652.83 0.00 215550 30640563 0
  396. nvme3n1 50.08 4.09 562.33 0.00 192024 26392965 0
  397. nvme4n1 42.05 3.37 421.38 0.00 157971 19777344 0
  398. nvme5n1 30.99 2.75 324.07 0.00 129292 15210417 0
  399. nvme6n1 18.57 1.65 183.94 0.00 77238 8633139 0
  400. nvme7n1 10.55 1.05 104.39 0.00 49287 4899424 0
  401.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!