API tools faq
paste
Advertisement
Guest User

AM08pro Samsung 990 Pro

a guest
Jan 1st, 2024
50
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 60.22 KB | None | 0 0
raw download clone embed print report
  1. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=read --bs=1M --ioengine=libaio --iodepth=8 --filesize=64G --numjobs=1 --group_reporting --name=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1
  2. SEQ1M: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=8
  3. fio-3.28
  4. Starting 1 process
  5. Jobs: 0 (f=0)
  6. Jobs: 0 (f=0)
  7. Jobs: 0 (f=0)
  8. Jobs: 1 (f=0): [/(1)][-.-%][eta 00m:00s]
  9. Jobs: 1 (f=1): [R(1)][9.9%][r=6911MiB/s][r=6910 IOPS][eta 01m:13s]
  10. Jobs: 1 (f=1): [R(1)][15.6%][r=6911MiB/s][r=6911 IOPS][eta 00m:54s]
  11. Jobs: 1 (f=1): [R(1)][20.0%][r=6910MiB/s][r=6910 IOPS][eta 00m:48s]
  12. Jobs: 1 (f=1): [R(1)][24.1%][r=6910MiB/s][r=6910 IOPS][eta 00m:44s]
  13. Jobs: 1 (f=1): [R(1)][28.1%][r=6910MiB/s][r=6909 IOPS][eta 00m:41s]
  14. Jobs: 1 (f=1): [R(1)][32.1%][r=6912MiB/s][r=6912 IOPS][eta 00m:38s]
  15. Jobs: 1 (f=1): [R(1)][35.7%][r=6911MiB/s][r=6911 IOPS][eta 00m:36s]
  16. Jobs: 1 (f=1): [R(1)][40.0%][r=6911MiB/s][r=6911 IOPS][eta 00m:33s]
  17. Jobs: 1 (f=1): [R(1)][43.6%][r=6911MiB/s][r=6911 IOPS][eta 00m:31s]
  18. Jobs: 1 (f=1): [R(1)][47.3%][r=6911MiB/s][r=6910 IOPS][eta 00m:29s]
  19. Jobs: 1 (f=1): [R(1)][50.9%][r=6911MiB/s][r=6910 IOPS][eta 00m:27s]
  20. Jobs: 1 (f=1): [R(1)][55.6%][r=6910MiB/s][r=6910 IOPS][eta 00m:24s]
  21. Jobs: 1 (f=1): [R(1)][59.3%][r=6910MiB/s][r=6910 IOPS][eta 00m:22s]
  22. Jobs: 1 (f=1): [R(1)][63.0%][r=6910MiB/s][r=6909 IOPS][eta 00m:20s]
  23. Jobs: 1 (f=1): [R(1)][66.7%][r=6911MiB/s][r=6911 IOPS][eta 00m:18s]
  24. Jobs: 1 (f=1): [R(1)][70.4%][r=6911MiB/s][r=6911 IOPS][eta 00m:16s]
  25. Jobs: 1 (f=1): [R(1)][74.1%][r=6910MiB/s][r=6909 IOPS][eta 00m:14s]
  26. Jobs: 1 (f=1): [R(1)][77.8%][r=6910MiB/s][r=6910 IOPS][eta 00m:12s]
  27. Jobs: 1 (f=1): [R(1)][81.5%][r=6909MiB/s][r=6909 IOPS][eta 00m:10s]
  28. Jobs: 1 (f=1): [R(1)][85.2%][r=6910MiB/s][r=6909 IOPS][eta 00m:08s]
  29. Jobs: 1 (f=1): [R(1)][88.9%][r=6910MiB/s][r=6910 IOPS][eta 00m:06s]
  30. Jobs: 1 (f=1): [R(1)][92.6%][r=6909MiB/s][r=6909 IOPS][eta 00m:04s]
  31. Jobs: 1 (f=1): [R(1)][96.3%][r=6909MiB/s][r=6909 IOPS][eta 00m:02s]
  32. Jobs: 1 (f=1): [R(1)][98.1%][r=6908MiB/s][r=6908 IOPS][eta 00m:01s]
  33. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4062: Mon Jan 1 16:10:08 2024
  34. read: IOPS=6907, BW=6907MiB/s (7243MB/s)(313GiB/46449msec)
  35. slat (usec): min=37, max=144, avg=39.10, stdev= 1.40
  36. clat (usec): min=280, max=2107, avg=1118.77, stdev=12.12
  37. lat (usec): min=320, max=2146, avg=1157.94, stdev=12.01
  38. clat percentiles (usec):
  39. | 1.00th=[ 1106], 5.00th=[ 1106], 10.00th=[ 1123], 20.00th=[ 1123],
  40. | 30.00th=[ 1123], 40.00th=[ 1123], 50.00th=[ 1123], 60.00th=[ 1123],
  41. | 70.00th=[ 1123], 80.00th=[ 1123], 90.00th=[ 1123], 95.00th=[ 1123],
  42. | 99.00th=[ 1139], 99.50th=[ 1139], 99.90th=[ 1188], 99.95th=[ 1188],
  43. | 99.99th=[ 1565]
  44. bw ( MiB/s): min= 6880, max= 6916, per=100.00%, avg=6909.77, stdev= 3.40, samples=92
  45. iops : min= 6880, max= 6916, avg=6909.63, stdev= 3.39, samples=92
  46. lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
  47. lat (msec) : 2=99.98%, 4=0.01%
  48. cpu : usr=0.46%, sys=29.05%, ctx=320840, majf=0, minf=58
  49. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  50. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  51. complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  52. issued rwts: total=320831,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  53. latency : target=0, window=0, percentile=100.00%, depth=8
  54.  
  55. Run status group 0 (all jobs):
  56. READ: bw=6907MiB/s (7243MB/s), 6907MiB/s-6907MiB/s (7243MB/s-7243MB/s), io=313GiB (336GB), run=46449-46449msec
  57.  
  58. Disk stats (read/write):
  59. nvme0n1: ios=693405/5, merge=0/1, ticks=764681/7, in_queue=764691, util=99.82%
  60.  
  61.  
  62. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=read --bs=1M --ioengine=libaio --iodepth=1 --filesize=64G --numjobs=1 --group_reporting --name=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1
  63. SEQ1M: (g=0): rw=read, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1
  64. fio-3.28
  65. Starting 1 process
  66. Jobs: 0 (f=0)
  67. Jobs: 0 (f=0)
  68. Jobs: 0 (f=0)
  69. Jobs: 1 (f=0): [/(1)][-.-%][eta 00m:00s]
  70. Jobs: 1 (f=1): [R(1)][4.4%][r=3070MiB/s][r=3070 IOPS][eta 02m:55s]
  71. Jobs: 1 (f=1): [R(1)][7.1%][r=3080MiB/s][r=3080 IOPS][eta 02m:10s]
  72. Jobs: 1 (f=1): [R(1)][9.3%][r=3106MiB/s][r=3106 IOPS][eta 01m:57s]
  73. Jobs: 1 (f=1): [R(1)][11.3%][r=3069MiB/s][r=3069 IOPS][eta 01m:50s]
  74. Jobs: 1 (f=1): [R(1)][13.1%][r=3102MiB/s][r=3102 IOPS][eta 01m:46s]
  75. Jobs: 1 (f=1): [R(1)][15.0%][r=3048MiB/s][r=3048 IOPS][eta 01m:42s]
  76. Jobs: 1 (f=1): [R(1)][16.8%][r=3105MiB/s][r=3105 IOPS][eta 01m:39s]
  77. Jobs: 1 (f=1): [R(1)][18.6%][r=3104MiB/s][r=3104 IOPS][eta 01m:36s]
  78. Jobs: 1 (f=1): [R(1)][20.5%][r=3098MiB/s][r=3098 IOPS][eta 01m:33s]
  79. Jobs: 1 (f=1): [R(1)][22.2%][r=3103MiB/s][r=3103 IOPS][eta 01m:31s]
  80. Jobs: 1 (f=1): [R(1)][24.1%][r=3047MiB/s][r=3047 IOPS][eta 01m:28s]
  81. Jobs: 1 (f=1): [R(1)][25.9%][r=2978MiB/s][r=2977 IOPS][eta 01m:26s]
  82. Jobs: 1 (f=1): [R(1)][27.6%][r=3079MiB/s][r=3079 IOPS][eta 01m:24s]
  83. Jobs: 1 (f=1): [R(1)][29.3%][r=3086MiB/s][r=3086 IOPS][eta 01m:22s]
  84. Jobs: 1 (f=1): [R(1)][31.3%][r=3017MiB/s][r=3017 IOPS][eta 01m:19s]
  85. Jobs: 1 (f=1): [R(1)][33.0%][r=3106MiB/s][r=3106 IOPS][eta 01m:17s]
  86. Jobs: 1 (f=1): [R(1)][34.8%][r=3019MiB/s][r=3019 IOPS][eta 01m:15s]
  87. Jobs: 1 (f=1): [R(1)][36.5%][r=2927MiB/s][r=2927 IOPS][eta 01m:13s]
  88. Jobs: 1 (f=1): [R(1)][38.3%][r=3103MiB/s][r=3103 IOPS][eta 01m:11s]
  89. Jobs: 1 (f=1): [R(1)][40.0%][r=3102MiB/s][r=3102 IOPS][eta 01m:09s]
  90. Jobs: 1 (f=1): [R(1)][42.1%][r=3043MiB/s][r=3043 IOPS][eta 01m:06s]
  91. Jobs: 1 (f=1): [R(1)][43.9%][r=2997MiB/s][r=2996 IOPS][eta 01m:04s]
  92. Jobs: 1 (f=1): [R(1)][45.6%][r=3063MiB/s][r=3063 IOPS][eta 01m:02s]
  93. Jobs: 1 (f=1): [R(1)][47.4%][r=3081MiB/s][r=3081 IOPS][eta 01m:00s]
  94. Jobs: 1 (f=1): [R(1)][49.1%][r=3051MiB/s][r=3051 IOPS][eta 00m:58s]
  95. Jobs: 1 (f=1): [R(1)][50.9%][r=3082MiB/s][r=3082 IOPS][eta 00m:56s]
  96. Jobs: 1 (f=1): [R(1)][52.6%][r=3075MiB/s][r=3075 IOPS][eta 00m:54s]
  97. Jobs: 1 (f=1): [R(1)][54.4%][r=3072MiB/s][r=3072 IOPS][eta 00m:52s]
  98. Jobs: 1 (f=1): [R(1)][56.1%][r=2994MiB/s][r=2993 IOPS][eta 00m:50s]
  99. Jobs: 1 (f=1): [R(1)][57.9%][r=3102MiB/s][r=3102 IOPS][eta 00m:48s]
  100. Jobs: 1 (f=1): [R(1)][59.6%][r=3104MiB/s][r=3104 IOPS][eta 00m:46s]
  101. Jobs: 1 (f=1): [R(1)][61.4%][r=3039MiB/s][r=3039 IOPS][eta 00m:44s]
  102. Jobs: 1 (f=1): [R(1)][63.2%][r=3107MiB/s][r=3107 IOPS][eta 00m:42s]
  103. Jobs: 1 (f=1): [R(1)][64.9%][r=3083MiB/s][r=3083 IOPS][eta 00m:40s]
  104. Jobs: 1 (f=1): [R(1)][66.7%][r=3107MiB/s][r=3107 IOPS][eta 00m:38s]
  105. Jobs: 1 (f=1): [R(1)][68.4%][r=3106MiB/s][r=3106 IOPS][eta 00m:36s]
  106. Jobs: 1 (f=1): [R(1)][70.2%][r=3093MiB/s][r=3093 IOPS][eta 00m:34s]
  107. Jobs: 1 (f=1): [R(1)][71.9%][r=3057MiB/s][r=3057 IOPS][eta 00m:32s]
  108. Jobs: 1 (f=1): [R(1)][73.7%][r=3104MiB/s][r=3104 IOPS][eta 00m:30s]
  109. Jobs: 1 (f=1): [R(1)][75.4%][r=3105MiB/s][r=3105 IOPS][eta 00m:28s]
  110. Jobs: 1 (f=1): [R(1)][77.2%][r=3098MiB/s][r=3098 IOPS][eta 00m:26s]
  111. Jobs: 1 (f=1): [R(1)][79.6%][r=3105MiB/s][r=3105 IOPS][eta 00m:23s]
  112. Jobs: 1 (f=1): [R(1)][81.4%][r=3081MiB/s][r=3081 IOPS][eta 00m:21s]
  113. Jobs: 1 (f=1): [R(1)][83.2%][r=2980MiB/s][r=2979 IOPS][eta 00m:19s]
  114. Jobs: 1 (f=1): [R(1)][85.0%][r=3079MiB/s][r=3079 IOPS][eta 00m:17s]
  115. Jobs: 1 (f=1): [R(1)][86.7%][r=3105MiB/s][r=3105 IOPS][eta 00m:15s]
  116. Jobs: 1 (f=1): [R(1)][88.5%][r=3020MiB/s][r=3020 IOPS][eta 00m:13s]
  117. Jobs: 1 (f=1): [R(1)][90.3%][r=3096MiB/s][r=3096 IOPS][eta 00m:11s]
  118. Jobs: 1 (f=1): [R(1)][92.0%][r=3016MiB/s][r=3016 IOPS][eta 00m:09s]
  119. Jobs: 1 (f=1): [R(1)][93.8%][r=2937MiB/s][r=2936 IOPS][eta 00m:07s]
  120. Jobs: 1 (f=1): [R(1)][95.6%][r=3104MiB/s][r=3104 IOPS][eta 00m:05s]
  121. Jobs: 1 (f=1): [R(1)][97.3%][r=3101MiB/s][r=3101 IOPS][eta 00m:03s]
  122. Jobs: 1 (f=1): [R(1)][99.1%][r=3051MiB/s][r=3051 IOPS][eta 00m:01s]
  123. Jobs: 1 (f=1): [R(1)][100.0%][r=3080MiB/s][r=3080 IOPS][eta 00m:00s]
  124. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4097: Mon Jan 1 16:26:50 2024
  125. read: IOPS=3063, BW=3063MiB/s (3212MB/s)(319GiB/106543msec)
  126. slat (usec): min=50, max=175, avg=72.06, stdev= 2.74
  127. clat (usec): min=151, max=2640, avg=253.60, stdev=19.24
  128. lat (usec): min=288, max=2714, avg=325.82, stdev=19.66
  129. clat percentiles (usec):
  130. | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247],
  131. | 30.00th=[ 247], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 249],
  132. | 70.00th=[ 251], 80.00th=[ 253], 90.00th=[ 269], 95.00th=[ 277],
  133. | 99.00th=[ 363], 99.50th=[ 367], 99.90th=[ 383], 99.95th=[ 396],
  134. | 99.99th=[ 799]
  135. bw ( MiB/s): min= 2697, max= 3112, per=100.00%, avg=3064.79, stdev=67.27, samples=213
  136. iops : min= 2697, max= 3112, avg=3064.73, stdev=67.33, samples=213
  137. lat (usec) : 250=68.13%, 500=31.85%, 750=0.01%, 1000=0.01%
  138. lat (msec) : 2=0.01%, 4=0.01%
  139. cpu : usr=0.61%, sys=24.83%, ctx=326387, majf=0, minf=59
  140. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  141. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  142. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  143. issued rwts: total=326355,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  144. latency : target=0, window=0, percentile=100.00%, depth=1
  145.  
  146. Run status group 0 (all jobs):
  147. READ: bw=3063MiB/s (3212MB/s), 3063MiB/s-3063MiB/s (3212MB/s-3212MB/s), io=319GiB (342GB), run=106543-106543msec
  148.  
  149. Disk stats (read/write):
  150. nvme0n1: ios=327550/148, merge=0/54, ticks=87733/57, in_queue=87802, util=99.96%
  151.  
  152. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=randread --bs=4k --ioengine=libaio --iodepth=32 --filesize=64G --numjobs=1 --group_reporting --name=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1
  153. SEQ1M: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  154. fio-3.28
  155. Starting 1 process
  156. Jobs: 0 (f=0)
  157. Jobs: 0 (f=0)
  158. Jobs: 0 (f=0)
  159. Jobs: 1 (f=0): [/(1)][-.-%][eta 00m:00s]
  160. Jobs: 1 (f=1): [r(1)][1.4%][r=929MiB/s][r=238k IOPS][eta 09m:22s]
  161. Jobs: 1 (f=1): [r(1)][2.3%][r=928MiB/s][r=238k IOPS][eta 07m:10s]
  162. Jobs: 1 (f=1): [r(1)][2.9%][r=928MiB/s][r=238k IOPS][eta 06m:37s]
  163. Jobs: 1 (f=1): [r(1)][3.5%][r=927MiB/s][r=237k IOPS][eta 06m:21s]
  164. Jobs: 1 (f=1): [r(1)][4.1%][r=927MiB/s][r=237k IOPS][eta 06m:11s]
  165. Jobs: 1 (f=1): [r(1)][4.7%][r=927MiB/s][r=237k IOPS][eta 06m:04s]
  166. Jobs: 1 (f=1): [r(1)][5.3%][r=927MiB/s][r=237k IOPS][eta 05m:59s]
  167. Jobs: 1 (f=1): [r(1)][5.9%][r=927MiB/s][r=237k IOPS][eta 05m:54s]
  168. Jobs: 1 (f=1): [r(1)][6.4%][r=927MiB/s][r=237k IOPS][eta 05m:50s]
  169. Jobs: 1 (f=1): [r(1)][7.0%][r=926MiB/s][r=237k IOPS][eta 05m:47s]
  170. Jobs: 1 (f=1): [r(1)][7.5%][r=926MiB/s][r=237k IOPS][eta 05m:44s]
  171. Jobs: 1 (f=1): [r(1)][8.1%][r=926MiB/s][r=237k IOPS][eta 05m:40s]
  172. Jobs: 1 (f=1): [r(1)][8.6%][r=925MiB/s][r=237k IOPS][eta 05m:38s]
  173. Jobs: 1 (f=1): [r(1)][9.2%][r=925MiB/s][r=237k IOPS][eta 05m:35s]
  174. Jobs: 1 (f=1): [r(1)][9.8%][r=925MiB/s][r=237k IOPS][eta 05m:32s]
  175. Jobs: 1 (f=1): [r(1)][10.3%][r=925MiB/s][r=237k IOPS][eta 05m:30s]
  176. Jobs: 1 (f=1): [r(1)][10.9%][r=925MiB/s][r=237k IOPS][eta 05m:27s]
  177. Jobs: 1 (f=1): [r(1)][11.4%][r=925MiB/s][r=237k IOPS][eta 05m:25s]
  178. Jobs: 1 (f=1): [r(1)][12.0%][r=924MiB/s][r=237k IOPS][eta 05m:23s]
  179. Jobs: 1 (f=1): [r(1)][12.6%][r=925MiB/s][r=237k IOPS][eta 05m:20s]
  180. Jobs: 1 (f=1): [r(1)][13.1%][r=925MiB/s][r=237k IOPS][eta 05m:18s]
  181. Jobs: 1 (f=1): [r(1)][13.7%][r=925MiB/s][r=237k IOPS][eta 05m:16s]
  182. Jobs: 1 (f=1): [r(1)][14.2%][r=925MiB/s][r=237k IOPS][eta 05m:13s]
  183. Jobs: 1 (f=1): [r(1)][14.8%][r=925MiB/s][r=237k IOPS][eta 05m:11s]
  184. Jobs: 1 (f=1): [r(1)][15.3%][r=925MiB/s][r=237k IOPS][eta 05m:09s]
  185. Jobs: 1 (f=1): [r(1)][15.9%][r=925MiB/s][r=237k IOPS][eta 05m:07s]
  186. Jobs: 1 (f=1): [r(1)][16.4%][r=925MiB/s][r=237k IOPS][eta 05m:05s]
  187. Jobs: 1 (f=1): [r(1)][17.0%][r=924MiB/s][r=237k IOPS][eta 05m:02s]
  188. Jobs: 1 (f=1): [r(1)][17.6%][r=924MiB/s][r=237k IOPS][eta 05m:00s]
  189. Jobs: 1 (f=1): [r(1)][18.1%][r=923MiB/s][r=236k IOPS][eta 04m:58s]
  190. Jobs: 1 (f=1): [r(1)][18.7%][r=923MiB/s][r=236k IOPS][eta 04m:56s]
  191. Jobs: 1 (f=1): [r(1)][19.2%][r=922MiB/s][r=236k IOPS][eta 04m:54s]
  192. Jobs: 1 (f=1): [r(1)][19.8%][r=918MiB/s][r=235k IOPS][eta 04m:52s]
  193. Jobs: 1 (f=1): [r(1)][20.3%][r=922MiB/s][r=236k IOPS][eta 04m:50s]
  194. Jobs: 1 (f=1): [r(1)][20.9%][r=922MiB/s][r=236k IOPS][eta 04m:48s]
  195. Jobs: 1 (f=1): [r(1)][21.4%][r=925MiB/s][r=237k IOPS][eta 04m:46s]
  196. Jobs: 1 (f=1): [r(1)][22.0%][r=928MiB/s][r=237k IOPS][eta 04m:43s]
  197. Jobs: 1 (f=1): [r(1)][22.6%][r=927MiB/s][r=237k IOPS][eta 04m:41s]
  198. Jobs: 1 (f=1): [r(1)][23.1%][r=927MiB/s][r=237k IOPS][eta 04m:39s]
  199. Jobs: 1 (f=1): [r(1)][23.7%][r=927MiB/s][r=237k IOPS][eta 04m:37s]
  200. Jobs: 1 (f=1): [r(1)][24.2%][r=926MiB/s][r=237k IOPS][eta 04m:35s]
  201. Jobs: 1 (f=1): [r(1)][24.8%][r=926MiB/s][r=237k IOPS][eta 04m:33s]
  202. Jobs: 1 (f=1): [r(1)][25.3%][r=926MiB/s][r=237k IOPS][eta 04m:31s]
  203. Jobs: 1 (f=1): [r(1)][25.9%][r=926MiB/s][r=237k IOPS][eta 04m:29s]
  204. Jobs: 1 (f=1): [r(1)][26.4%][r=925MiB/s][r=237k IOPS][eta 04m:27s]
  205. Jobs: 1 (f=1): [r(1)][27.0%][r=925MiB/s][r=237k IOPS][eta 04m:25s]
  206. Jobs: 1 (f=1): [r(1)][27.5%][r=925MiB/s][r=237k IOPS][eta 04m:23s]
  207. Jobs: 1 (f=1): [r(1)][28.1%][r=925MiB/s][r=237k IOPS][eta 04m:21s]
  208. Jobs: 1 (f=1): [r(1)][28.7%][r=924MiB/s][r=237k IOPS][eta 04m:19s]
  209. Jobs: 1 (f=1): [r(1)][29.2%][r=924MiB/s][r=237k IOPS][eta 04m:17s]
  210. Jobs: 1 (f=1): [r(1)][29.8%][r=924MiB/s][r=236k IOPS][eta 04m:14s]
  211. Jobs: 1 (f=1): [r(1)][30.4%][r=923MiB/s][r=236k IOPS][eta 04m:12s]
  212. Jobs: 1 (f=1): [r(1)][30.9%][r=923MiB/s][r=236k IOPS][eta 04m:10s]
  213. Jobs: 1 (f=1): [r(1)][31.5%][r=923MiB/s][r=236k IOPS][eta 04m:08s]
  214. Jobs: 1 (f=1): [r(1)][32.0%][r=921MiB/s][r=236k IOPS][eta 04m:06s]
  215. Jobs: 1 (f=1): [r(1)][32.6%][r=924MiB/s][r=236k IOPS][eta 04m:04s]
  216. Jobs: 1 (f=1): [r(1)][33.1%][r=924MiB/s][r=237k IOPS][eta 04m:02s]
  217. Jobs: 1 (f=1): [r(1)][33.7%][r=924MiB/s][r=236k IOPS][eta 04m:00s]
  218. Jobs: 1 (f=1): [r(1)][34.3%][r=924MiB/s][r=237k IOPS][eta 03m:58s]
  219. Jobs: 1 (f=1): [r(1)][34.8%][r=921MiB/s][r=236k IOPS][eta 03m:56s]
  220. Jobs: 1 (f=1): [r(1)][35.4%][r=924MiB/s][r=237k IOPS][eta 03m:54s]
  221. Jobs: 1 (f=1): [r(1)][35.9%][r=924MiB/s][r=237k IOPS][eta 03m:52s]
  222. Jobs: 1 (f=1): [r(1)][36.5%][r=921MiB/s][r=236k IOPS][eta 03m:50s]
  223. Jobs: 1 (f=1): [r(1)][37.0%][r=924MiB/s][r=236k IOPS][eta 03m:48s]
  224. Jobs: 1 (f=1): [r(1)][37.6%][r=923MiB/s][r=236k IOPS][eta 03m:46s]
  225. Jobs: 1 (f=1): [r(1)][38.1%][r=922MiB/s][r=236k IOPS][eta 03m:44s]
  226. Jobs: 1 (f=1): [r(1)][38.7%][r=922MiB/s][r=236k IOPS][eta 03m:42s]
  227. Jobs: 1 (f=1): [r(1)][39.2%][r=921MiB/s][r=236k IOPS][eta 03m:40s]
  228. Jobs: 1 (f=1): [r(1)][39.8%][r=920MiB/s][r=236k IOPS][eta 03m:38s]
  229. Jobs: 1 (f=1): [r(1)][40.3%][r=921MiB/s][r=236k IOPS][eta 03m:36s]
  230. Jobs: 1 (f=1): [r(1)][40.9%][r=924MiB/s][r=237k IOPS][eta 03m:34s]
  231. Jobs: 1 (f=1): [r(1)][41.4%][r=927MiB/s][r=237k IOPS][eta 03m:32s]
  232. Jobs: 1 (f=1): [r(1)][42.0%][r=927MiB/s][r=237k IOPS][eta 03m:30s]
  233. Jobs: 1 (f=1): [r(1)][42.5%][r=926MiB/s][r=237k IOPS][eta 03m:28s]
  234. Jobs: 1 (f=1): [r(1)][43.1%][r=927MiB/s][r=237k IOPS][eta 03m:26s]
  235. Jobs: 1 (f=1): [r(1)][43.6%][r=926MiB/s][r=237k IOPS][eta 03m:24s]
  236. Jobs: 1 (f=1): [r(1)][44.2%][r=925MiB/s][r=237k IOPS][eta 03m:22s]
  237. Jobs: 1 (f=1): [r(1)][44.8%][r=925MiB/s][r=237k IOPS][eta 03m:20s]
  238. Jobs: 1 (f=1): [r(1)][45.3%][r=925MiB/s][r=237k IOPS][eta 03m:18s]
  239. Jobs: 1 (f=1): [r(1)][45.9%][r=925MiB/s][r=237k IOPS][eta 03m:16s]
  240. Jobs: 1 (f=1): [r(1)][46.4%][r=925MiB/s][r=237k IOPS][eta 03m:14s]
  241. Jobs: 1 (f=1): [r(1)][47.0%][r=924MiB/s][r=237k IOPS][eta 03m:12s]
  242. Jobs: 1 (f=1): [r(1)][47.5%][r=924MiB/s][r=237k IOPS][eta 03m:10s]
  243. Jobs: 1 (f=1): [r(1)][48.1%][r=923MiB/s][r=236k IOPS][eta 03m:08s]
  244. Jobs: 1 (f=1): [r(1)][48.6%][r=923MiB/s][r=236k IOPS][eta 03m:06s]
  245. Jobs: 1 (f=1): [r(1)][49.2%][r=924MiB/s][r=236k IOPS][eta 03m:04s]
  246. Jobs: 1 (f=1): [r(1)][49.7%][r=923MiB/s][r=236k IOPS][eta 03m:02s]
  247. Jobs: 1 (f=1): [r(1)][50.3%][r=923MiB/s][r=236k IOPS][eta 03m:00s]
  248. Jobs: 1 (f=1): [r(1)][50.8%][r=922MiB/s][r=236k IOPS][eta 02m:58s]
  249. Jobs: 1 (f=1): [r(1)][51.4%][r=923MiB/s][r=236k IOPS][eta 02m:56s]
  250. Jobs: 1 (f=1): [r(1)][51.9%][r=923MiB/s][r=236k IOPS][eta 02m:54s]
  251. Jobs: 1 (f=1): [r(1)][52.5%][r=917MiB/s][r=235k IOPS][eta 02m:52s]
  252. Jobs: 1 (f=1): [r(1)][53.0%][r=923MiB/s][r=236k IOPS][eta 02m:50s]
  253. Jobs: 1 (f=1): [r(1)][53.6%][r=923MiB/s][r=236k IOPS][eta 02m:48s]
  254. Jobs: 1 (f=1): [r(1)][54.1%][r=919MiB/s][r=235k IOPS][eta 02m:46s]
  255. Jobs: 1 (f=1): [r(1)][54.7%][r=923MiB/s][r=236k IOPS][eta 02m:44s]
  256. Jobs: 1 (f=1): [r(1)][55.2%][r=920MiB/s][r=236k IOPS][eta 02m:42s]
  257. Jobs: 1 (f=1): [r(1)][55.8%][r=923MiB/s][r=236k IOPS][eta 02m:40s]
  258. Jobs: 1 (f=1): [r(1)][56.4%][r=923MiB/s][r=236k IOPS][eta 02m:38s]
  259. Jobs: 1 (f=1): [r(1)][56.9%][r=923MiB/s][r=236k IOPS][eta 02m:36s]
  260. Jobs: 1 (f=1): [r(1)][57.5%][r=922MiB/s][r=236k IOPS][eta 02m:34s]
  261. Jobs: 1 (f=1): [r(1)][58.0%][r=922MiB/s][r=236k IOPS][eta 02m:32s]
  262. Jobs: 1 (f=1): [r(1)][58.6%][r=921MiB/s][r=236k IOPS][eta 02m:30s]
  263. Jobs: 1 (f=1): [r(1)][59.1%][r=921MiB/s][r=236k IOPS][eta 02m:28s]
  264. Jobs: 1 (f=1): [r(1)][59.7%][r=920MiB/s][r=236k IOPS][eta 02m:26s]
  265. Jobs: 1 (f=1): [r(1)][60.2%][r=920MiB/s][r=236k IOPS][eta 02m:24s]
  266. Jobs: 1 (f=1): [r(1)][60.8%][r=926MiB/s][r=237k IOPS][eta 02m:22s]
  267. Jobs: 1 (f=1): [r(1)][61.3%][r=926MiB/s][r=237k IOPS][eta 02m:20s]
  268. Jobs: 1 (f=1): [r(1)][62.0%][r=926MiB/s][r=237k IOPS][eta 02m:17s]
  269. Jobs: 1 (f=1): [r(1)][62.6%][r=926MiB/s][r=237k IOPS][eta 02m:15s]
  270. Jobs: 1 (f=1): [r(1)][63.2%][r=926MiB/s][r=237k IOPS][eta 02m:13s]
  271. Jobs: 1 (f=1): [r(1)][63.7%][r=925MiB/s][r=237k IOPS][eta 02m:11s]
  272. Jobs: 1 (f=1): [r(1)][64.3%][r=925MiB/s][r=237k IOPS][eta 02m:09s]
  273. Jobs: 1 (f=1): [r(1)][64.8%][r=925MiB/s][r=237k IOPS][eta 02m:07s]
  274. Jobs: 1 (f=1): [r(1)][65.4%][r=924MiB/s][r=237k IOPS][eta 02m:05s]
  275. Jobs: 1 (f=1): [r(1)][65.9%][r=924MiB/s][r=237k IOPS][eta 02m:03s]
  276. Jobs: 1 (f=1): [r(1)][66.5%][r=924MiB/s][r=237k IOPS][eta 02m:01s]
  277. Jobs: 1 (f=1): [r(1)][67.0%][r=923MiB/s][r=236k IOPS][eta 01m:59s]
  278. Jobs: 1 (f=1): [r(1)][67.6%][r=923MiB/s][r=236k IOPS][eta 01m:57s]
  279. Jobs: 1 (f=1): [r(1)][68.1%][r=923MiB/s][r=236k IOPS][eta 01m:55s]
  280. Jobs: 1 (f=1): [r(1)][68.7%][r=923MiB/s][r=236k IOPS][eta 01m:53s]
  281. Jobs: 1 (f=1): [r(1)][69.3%][r=923MiB/s][r=236k IOPS][eta 01m:51s]
  282. Jobs: 1 (f=1): [r(1)][69.8%][r=923MiB/s][r=236k IOPS][eta 01m:49s]
  283. Jobs: 1 (f=1): [r(1)][70.4%][r=923MiB/s][r=236k IOPS][eta 01m:47s]
  284. Jobs: 1 (f=1): [r(1)][70.9%][r=923MiB/s][r=236k IOPS][eta 01m:45s]
  285. Jobs: 1 (f=1): [r(1)][71.5%][r=922MiB/s][r=236k IOPS][eta 01m:43s]
  286. Jobs: 1 (f=1): [r(1)][72.0%][r=922MiB/s][r=236k IOPS][eta 01m:41s]
  287. Jobs: 1 (f=1): [r(1)][72.6%][r=923MiB/s][r=236k IOPS][eta 01m:39s]
  288. Jobs: 1 (f=1): [r(1)][73.1%][r=923MiB/s][r=236k IOPS][eta 01m:37s]
  289. Jobs: 1 (f=1): [r(1)][73.7%][r=922MiB/s][r=236k IOPS][eta 01m:35s]
  290. Jobs: 1 (f=1): [r(1)][74.2%][r=922MiB/s][r=236k IOPS][eta 01m:33s]
  291. Jobs: 1 (f=1): [r(1)][74.8%][r=922MiB/s][r=236k IOPS][eta 01m:31s]
  292. Jobs: 1 (f=1): [r(1)][75.3%][r=922MiB/s][r=236k IOPS][eta 01m:29s]
  293. Jobs: 1 (f=1): [r(1)][75.9%][r=922MiB/s][r=236k IOPS][eta 01m:27s]
  294. Jobs: 1 (f=1): [r(1)][76.5%][r=922MiB/s][r=236k IOPS][eta 01m:25s]
  295. Jobs: 1 (f=1): [r(1)][77.0%][r=922MiB/s][r=236k IOPS][eta 01m:23s]
  296. Jobs: 1 (f=1): [r(1)][77.6%][r=922MiB/s][r=236k IOPS][eta 01m:21s]
  297. Jobs: 1 (f=1): [r(1)][78.1%][r=922MiB/s][r=236k IOPS][eta 01m:19s]
  298. Jobs: 1 (f=1): [r(1)][78.7%][r=920MiB/s][r=236k IOPS][eta 01m:17s]
  299. Jobs: 1 (f=1): [r(1)][79.2%][r=920MiB/s][r=235k IOPS][eta 01m:15s]
  300. Jobs: 1 (f=1): [r(1)][79.8%][r=920MiB/s][r=235k IOPS][eta 01m:13s]
  301. Jobs: 1 (f=1): [r(1)][80.3%][r=923MiB/s][r=236k IOPS][eta 01m:11s]
  302. Jobs: 1 (f=1): [r(1)][80.9%][r=926MiB/s][r=237k IOPS][eta 01m:09s]
  303. Jobs: 1 (f=1): [r(1)][81.4%][r=926MiB/s][r=237k IOPS][eta 01m:07s]
  304. Jobs: 1 (f=1): [r(1)][82.0%][r=925MiB/s][r=237k IOPS][eta 01m:05s]
  305. Jobs: 1 (f=1): [r(1)][82.5%][r=925MiB/s][r=237k IOPS][eta 01m:03s]
  306. Jobs: 1 (f=1): [r(1)][83.1%][r=925MiB/s][r=237k IOPS][eta 01m:01s]
  307. Jobs: 1 (f=1): [r(1)][83.7%][r=924MiB/s][r=237k IOPS][eta 00m:59s]
  308. Jobs: 1 (f=1): [r(1)][84.2%][r=925MiB/s][r=237k IOPS][eta 00m:57s]
  309. Jobs: 1 (f=1): [r(1)][84.8%][r=924MiB/s][r=237k IOPS][eta 00m:55s]
  310. Jobs: 1 (f=1): [r(1)][85.3%][r=925MiB/s][r=237k IOPS][eta 00m:53s]
  311. Jobs: 1 (f=1): [r(1)][85.9%][r=924MiB/s][r=236k IOPS][eta 00m:51s]
  312. Jobs: 1 (f=1): [r(1)][86.4%][r=924MiB/s][r=236k IOPS][eta 00m:49s]
  313. Jobs: 1 (f=1): [r(1)][87.0%][r=923MiB/s][r=236k IOPS][eta 00m:47s]
  314. Jobs: 1 (f=1): [r(1)][87.5%][r=923MiB/s][r=236k IOPS][eta 00m:45s]
  315. Jobs: 1 (f=1): [r(1)][88.1%][r=923MiB/s][r=236k IOPS][eta 00m:43s]
  316. Jobs: 1 (f=1): [r(1)][88.6%][r=923MiB/s][r=236k IOPS][eta 00m:41s]
  317. Jobs: 1 (f=1): [r(1)][89.2%][r=923MiB/s][r=236k IOPS][eta 00m:39s]
  318. Jobs: 1 (f=1): [r(1)][89.8%][r=922MiB/s][r=236k IOPS][eta 00m:37s]
  319. Jobs: 1 (f=1): [r(1)][90.3%][r=922MiB/s][r=236k IOPS][eta 00m:35s]
  320. Jobs: 1 (f=1): [r(1)][90.9%][r=923MiB/s][r=236k IOPS][eta 00m:33s]
  321. Jobs: 1 (f=1): [r(1)][91.4%][r=922MiB/s][r=236k IOPS][eta 00m:31s]
  322. Jobs: 1 (f=1): [r(1)][92.0%][r=922MiB/s][r=236k IOPS][eta 00m:29s]
  323. Jobs: 1 (f=1): [r(1)][92.5%][r=922MiB/s][r=236k IOPS][eta 00m:27s]
  324. Jobs: 1 (f=1): [r(1)][93.1%][r=923MiB/s][r=236k IOPS][eta 00m:25s]
  325. Jobs: 1 (f=1): [r(1)][93.6%][r=922MiB/s][r=236k IOPS][eta 00m:23s]
  326. Jobs: 1 (f=1): [r(1)][94.2%][r=922MiB/s][r=236k IOPS][eta 00m:21s]
  327. Jobs: 1 (f=1): [r(1)][94.7%][r=922MiB/s][r=236k IOPS][eta 00m:19s]
  328. Jobs: 1 (f=1): [r(1)][95.3%][r=922MiB/s][r=236k IOPS][eta 00m:17s]
  329. Jobs: 1 (f=1): [r(1)][95.8%][r=922MiB/s][r=236k IOPS][eta 00m:15s]
  330. Jobs: 1 (f=1): [r(1)][96.4%][r=922MiB/s][r=236k IOPS][eta 00m:13s]
  331. Jobs: 1 (f=1): [r(1)][97.0%][r=921MiB/s][r=236k IOPS][eta 00m:11s]
  332. Jobs: 1 (f=1): [r(1)][97.5%][r=921MiB/s][r=236k IOPS][eta 00m:09s]
  333. Jobs: 1 (f=1): [r(1)][98.1%][r=920MiB/s][r=236k IOPS][eta 00m:07s]
  334. Jobs: 1 (f=1): [r(1)][98.6%][r=919MiB/s][r=235k IOPS][eta 00m:05s]
  335. Jobs: 1 (f=1): [r(1)][99.2%][r=919MiB/s][r=235k IOPS][eta 00m:03s]
  336. Jobs: 1 (f=1): [r(1)][99.7%][r=919MiB/s][r=235k IOPS][eta 00m:01s]
  337. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4151: Mon Jan 1 16:49:07 2024
  338. read: IOPS=236k, BW=923MiB/s (968MB/s)(319GiB/353953msec)
  339. slat (nsec): min=2194, max=47127, avg=3382.44, stdev=1541.92
  340. clat (usec): min=54, max=3365, avg=131.73, stdev= 9.66
  341. lat (usec): min=56, max=3367, avg=135.17, stdev= 9.70
  342. clat percentiles (usec):
  343. | 1.00th=[ 119], 5.00th=[ 122], 10.00th=[ 124], 20.00th=[ 126],
  344. | 30.00th=[ 128], 40.00th=[ 129], 50.00th=[ 130], 60.00th=[ 131],
  345. | 70.00th=[ 133], 80.00th=[ 137], 90.00th=[ 145], 95.00th=[ 151],
  346. | 99.00th=[ 165], 99.50th=[ 172], 99.90th=[ 188], 99.95th=[ 194],
  347. | 99.99th=[ 210]
  348. bw ( KiB/s): min=928192, max=951807, per=100.00%, avg=945643.01, stdev=2307.18, samples=707
  349. iops : min=232048, max=237951, avg=236410.71, stdev=576.79, samples=707
  350. lat (usec) : 100=0.01%, 250=100.00%, 500=0.01%, 750=0.01%, 1000=0.01%
  351. lat (msec) : 2=0.01%, 4=0.01%
  352. cpu : usr=14.75%, sys=85.24%, ctx=1707, majf=0, minf=58
  353. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  354. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  355. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  356. issued rwts: total=83650296,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  357. latency : target=0, window=0, percentile=100.00%, depth=32
  358.  
  359. Run status group 0 (all jobs):
  360. READ: bw=923MiB/s (968MB/s), 923MiB/s-923MiB/s (968MB/s-968MB/s), io=319GiB (343GB), run=353953-353953msec
  361.  
  362. Disk stats (read/write):
  363. nvme0n1: ios=83838164/106, merge=0/32, ticks=3717502/45, in_queue=3717559, util=100.00%
  364.  
  365. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=randread --bs=4k --ioengine=libaio --iodepth=1 --filesize=64G --numjobs=1 --group_reporting -- name=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1 --runtime=60s
  366. SEQ1M: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
  367. fio-3.28
  368. Starting 1 process
  369. Jobs: 0 (f=0)
  370. Jobs: 0 (f=0)
  371. Jobs: 0 (f=0)
  372. Jobs: 1 (f=0): [/(1)][-.-%][eta 01m:05s]
  373. Jobs: 1 (f=1): [r(1)][12.1%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:58s]
  374. Jobs: 1 (f=1): [r(1)][15.2%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:56s]
  375. Jobs: 1 (f=1): [r(1)][18.2%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:54s]
  376. Jobs: 1 (f=1): [r(1)][21.2%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:52s]
  377. Jobs: 1 (f=1): [r(1)][24.2%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:50s]
  378. Jobs: 1 (f=1): [r(1)][27.3%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:48s]
  379. Jobs: 1 (f=1): [r(1)][30.3%][r=68.6MiB/s][r=17.6k IOPS][eta 00m:46s]
  380. Jobs: 1 (f=1): [r(1)][33.3%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:44s]
  381. Jobs: 1 (f=1): [r(1)][36.4%][r=68.7MiB/s][r=17.6k IOPS][eta 00m:42s]
  382. Jobs: 1 (f=1): [r(1)][39.4%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:40s]
  383. Jobs: 1 (f=1): [r(1)][42.4%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:38s]
  384. Jobs: 1 (f=1): [r(1)][45.5%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:36s]
  385. Jobs: 1 (f=1): [r(1)][48.5%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:34s]
  386. Jobs: 1 (f=1): [r(1)][51.5%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:32s]
  387. Jobs: 1 (f=1): [r(1)][54.5%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:30s]
  388. Jobs: 1 (f=1): [r(1)][57.6%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:28s]
  389. Jobs: 1 (f=1): [r(1)][60.6%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:26s]
  390. Jobs: 1 (f=1): [r(1)][63.6%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:24s]
  391. Jobs: 1 (f=1): [r(1)][66.7%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:22s]
  392. Jobs: 1 (f=1): [r(1)][69.7%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:20s]
  393. Jobs: 1 (f=1): [r(1)][72.7%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:18s]
  394. Jobs: 1 (f=1): [r(1)][75.8%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:16s]
  395. Jobs: 1 (f=1): [r(1)][78.8%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:14s]
  396. Jobs: 1 (f=1): [r(1)][81.8%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:12s]
  397. Jobs: 1 (f=1): [r(1)][84.8%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:10s]
  398. Jobs: 1 (f=1): [r(1)][87.9%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:08s]
  399. Jobs: 1 (f=1): [r(1)][90.9%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:06s]
  400. Jobs: 1 (f=1): [r(1)][93.9%][r=68.9MiB/s][r=17.6k IOPS][eta 00m:04s]
  401. Jobs: 1 (f=1): [r(1)][97.0%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:02s]
  402. Jobs: 1 (f=1): [r(1)][100.0%][r=68.8MiB/s][r=17.6k IOPS][eta 00m:00s]
  403. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4227: Mon Jan 1 17:28:53 2024
  404. read: IOPS=17.6k, BW=68.7MiB/s (72.1MB/s)(4125MiB/60001msec)
  405. slat (nsec): min=5570, max=34905, avg=7494.84, stdev=441.48
  406. clat (usec): min=25, max=547, avg=48.51, stdev= 2.57
  407. lat (usec): min=51, max=554, avg=56.14, stdev= 2.62
  408. clat percentiles (nsec):
  409. | 1.00th=[47360], 5.00th=[47872], 10.00th=[47872], 20.00th=[47872],
  410. | 30.00th=[48384], 40.00th=[48384], 50.00th=[48384], 60.00th=[48384],
  411. | 70.00th=[48384], 80.00th=[48896], 90.00th=[48896], 95.00th=[48896],
  412. | 99.00th=[50432], 99.50th=[56064], 99.90th=[86528], 99.95th=[86528],
  413. | 99.99th=[87552]
  414. bw ( KiB/s): min=70168, max=70560, per=100.00%, avg=70437.56, stdev=50.72, samples=120
  415. iops : min=17542, max=17640, avg=17609.38, stdev=12.67, samples=120
  416. lat (usec) : 50=98.84%, 100=1.16%, 250=0.01%, 500=0.01%, 750=0.01%
  417. cpu : usr=5.61%, sys=22.12%, ctx=1056000, majf=0, minf=58
  418. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  419. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  420. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  421. issued rwts: total=1055971,0,0,0 short=0,0,0,0 dropped=0,0,0,0
  422. latency : target=0, window=0, percentile=100.00%, depth=1
  423.  
  424. Run status group 0 (all jobs):
  425. READ: bw=68.7MiB/s (72.1MB/s), 68.7MiB/s-68.7MiB/s (72.1MB/s-72.1MB/s), io=4125MiB (4325MB), run=60001-60001msec
  426.  
  427. Disk stats (read/write):
  428. nvme0n1: ios=1075974/0, merge=0/0, ticks=47112/0, in_queue=47112, util=99.89%
  429. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=write --bs=1M --ioengine=libaio --iodepth=8 --filesize=64G --numjobs=1 --group_reporting --nam e=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1
  430. SEQ1M: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=8
  431. fio-3.28
  432. Starting 1 process
  433. Jobs: 0 (f=0)
  434. Jobs: 0 (f=0)
  435. Jobs: 0 (f=0)
  436. Jobs: 1 (f=0): [/(1)][-.-%][eta 00m:00s]
  437. Jobs: 1 (f=1): [W(1)][9.4%][w=6592MiB/s][w=6591 IOPS][eta 01m:17s]
  438. Jobs: 1 (f=1): [W(1)][14.9%][w=6557MiB/s][w=6556 IOPS][eta 00m:57s]
  439. Jobs: 1 (f=1): [W(1)][19.0%][w=6555MiB/s][w=6555 IOPS][eta 00m:51s]
  440. Jobs: 1 (f=1): [W(1)][23.0%][w=6562MiB/s][w=6562 IOPS][eta 00m:47s]
  441. Jobs: 1 (f=1): [W(1)][27.1%][w=6578MiB/s][w=6578 IOPS][eta 00m:43s]
  442. Jobs: 1 (f=1): [W(1)][30.5%][w=6583MiB/s][w=6583 IOPS][eta 00m:41s]
  443. Jobs: 1 (f=1): [W(1)][34.5%][w=6590MiB/s][w=6589 IOPS][eta 00m:38s]
  444. Jobs: 1 (f=1): [W(1)][37.9%][w=6593MiB/s][w=6592 IOPS][eta 00m:36s]
  445. Jobs: 1 (f=1): [W(1)][41.4%][w=6597MiB/s][w=6597 IOPS][eta 00m:34s]
  446. Jobs: 1 (f=1): [W(1)][45.6%][w=6584MiB/s][w=6584 IOPS][eta 00m:31s]
  447. Jobs: 1 (f=1): [W(1)][49.1%][w=6562MiB/s][w=6562 IOPS][eta 00m:29s]
  448. Jobs: 1 (f=1): [W(1)][52.6%][w=6590MiB/s][w=6590 IOPS][eta 00m:27s]
  449. Jobs: 1 (f=1): [W(1)][56.1%][w=6551MiB/s][w=6551 IOPS][eta 00m:25s]
  450. Jobs: 1 (f=1): [W(1)][59.6%][w=6590MiB/s][w=6589 IOPS][eta 00m:23s]
  451. Jobs: 1 (f=1): [W(1)][63.2%][w=6536MiB/s][w=6535 IOPS][eta 00m:21s]
  452. Jobs: 1 (f=1): [W(1)][66.7%][w=6544MiB/s][w=6543 IOPS][eta 00m:19s]
  453. Jobs: 1 (f=1): [W(1)][71.4%][w=6593MiB/s][w=6593 IOPS][eta 00m:16s]
  454. Jobs: 1 (f=1): [W(1)][75.0%][w=6594MiB/s][w=6594 IOPS][eta 00m:14s]
  455. Jobs: 1 (f=1): [W(1)][78.6%][w=6564MiB/s][w=6564 IOPS][eta 00m:12s]
  456. Jobs: 1 (f=1): [W(1)][82.1%][w=6545MiB/s][w=6545 IOPS][eta 00m:10s]
  457. Jobs: 1 (f=1): [W(1)][85.7%][w=6583MiB/s][w=6582 IOPS][eta 00m:08s]
  458. Jobs: 1 (f=1): [W(1)][89.3%][w=6561MiB/s][w=6560 IOPS][eta 00m:06s]
  459. Jobs: 1 (f=1): [W(1)][92.9%][w=6592MiB/s][w=6591 IOPS][eta 00m:04s]
  460. Jobs: 1 (f=1): [W(1)][96.4%][w=6558MiB/s][w=6558 IOPS][eta 00m:02s]
  461. Jobs: 1 (f=1): [W(1)][98.2%][w=6590MiB/s][w=6589 IOPS][eta 00m:01s]
  462. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4249: Mon Jan 1 17:31:35 2024
  463. write: IOPS=6571, BW=6572MiB/s (6891MB/s)(314GiB/48870msec); 0 zone resets
  464. slat (usec): min=32, max=441, avg=36.80, stdev=11.74
  465. clat (usec): min=273, max=9964, avg=1180.14, stdev=457.49
  466. lat (usec): min=315, max=10003, avg=1217.03, stdev=457.13
  467. clat percentiles (usec):
  468. | 1.00th=[ 1090], 5.00th=[ 1139], 10.00th=[ 1139], 20.00th=[ 1139],
  469. | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[ 1139], 60.00th=[ 1139],
  470. | 70.00th=[ 1139], 80.00th=[ 1139], 90.00th=[ 1156], 95.00th=[ 1156],
  471. | 99.00th=[ 1188], 99.50th=[ 6194], 99.90th=[ 6521], 99.95th=[ 6652],
  472. | 99.99th=[ 7635]
  473. bw ( MiB/s): min= 6450, max= 6598, per=100.00%, avg=6575.16, stdev=29.15, samples=97
  474. iops : min= 6450, max= 6598, avg=6575.11, stdev=29.16, samples=97
  475. lat (usec) : 500=0.01%, 750=0.03%, 1000=0.53%
  476. lat (msec) : 2=98.63%, 4=0.03%, 10=0.78%
  477. cpu : usr=1.49%, sys=23.83%, ctx=321158, majf=0, minf=58
  478. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=100.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  479. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  480. complete : 0=0.0%, 4=100.0%, 8=0.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  481. issued rwts: total=0,321160,0,0 short=0,0,0,0 dropped=0,0,0,0
  482. latency : target=0, window=0, percentile=100.00%, depth=8
  483.  
  484. Run status group 0 (all jobs):
  485. WRITE: bw=6572MiB/s (6891MB/s), 6572MiB/s-6572MiB/s (6891MB/s-6891MB/s), io=314GiB (337GB), run=48870-48870msec
  486.  
  487. Disk stats (read/write):
  488. nvme0n1: ios=0/899011, merge=0/27, ticks=0/1049391, in_queue=1049423, util=99.83%
  489. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=write --bs=1M --ioengine=libaio --iodepth=1 --filesize=64G --numjobs=1 --group_reporting --nam e=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1
  490. SEQ1M: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=libaio, iodepth=1
  491. fio-3.28
  492. Starting 1 process
  493. Jobs: 0 (f=0)
  494. Jobs: 0 (f=0)
  495. Jobs: 0 (f=0)
  496. Jobs: 1 (f=0): [/(1)][-.-%][eta 00m:00s]
  497. Jobs: 1 (f=1): [W(1)][6.2%][w=4262MiB/s][w=4262 IOPS][eta 02m:01s]
  498. Jobs: 1 (f=1): [W(1)][9.8%][w=3994MiB/s][w=3993 IOPS][eta 01m:32s]
  499. Jobs: 1 (f=1): [W(1)][12.2%][w=3822MiB/s][w=3822 IOPS][eta 01m:26s]
  500. Jobs: 1 (f=1): [W(1)][14.6%][w=3840MiB/s][w=3840 IOPS][eta 01m:22s]
  501. Jobs: 1 (f=1): [W(1)][16.8%][w=3838MiB/s][w=3838 IOPS][eta 01m:19s]
  502. Jobs: 1 (f=1): [W(1)][18.9%][w=3804MiB/s][w=3803 IOPS][eta 01m:17s]
  503. Jobs: 1 (f=1): [W(1)][21.3%][w=3820MiB/s][w=3819 IOPS][eta 01m:14s]
  504. Jobs: 1 (f=1): [W(1)][23.4%][w=3838MiB/s][w=3837 IOPS][eta 01m:12s]
  505. Jobs: 1 (f=1): [W(1)][25.8%][w=3826MiB/s][w=3825 IOPS][eta 01m:09s]
  506. Jobs: 1 (f=1): [W(1)][28.0%][w=3814MiB/s][w=3814 IOPS][eta 01m:07s]
  507. Jobs: 1 (f=1): [W(1)][30.1%][w=3820MiB/s][w=3820 IOPS][eta 01m:05s]
  508. Jobs: 1 (f=1): [W(1)][32.3%][w=3804MiB/s][w=3804 IOPS][eta 01m:03s]
  509. Jobs: 1 (f=1): [W(1)][34.4%][w=3838MiB/s][w=3838 IOPS][eta 01m:01s]
  510. Jobs: 1 (f=1): [W(1)][36.6%][w=3820MiB/s][w=3820 IOPS][eta 00m:59s]
  511. Jobs: 1 (f=1): [W(1)][38.7%][w=3815MiB/s][w=3814 IOPS][eta 00m:57s]
  512. Jobs: 1 (f=1): [W(1)][41.3%][w=3823MiB/s][w=3822 IOPS][eta 00m:54s]
  513. Jobs: 1 (f=1): [W(1)][43.5%][w=3840MiB/s][w=3839 IOPS][eta 00m:52s]
  514. Jobs: 1 (f=1): [W(1)][45.7%][w=3808MiB/s][w=3807 IOPS][eta 00m:50s]
  515. Jobs: 1 (f=1): [W(1)][47.8%][w=3823MiB/s][w=3822 IOPS][eta 00m:48s]
  516. Jobs: 1 (f=1): [W(1)][50.0%][w=3817MiB/s][w=3817 IOPS][eta 00m:46s]
  517. Jobs: 1 (f=1): [W(1)][52.2%][w=3839MiB/s][w=3839 IOPS][eta 00m:44s]
  518. Jobs: 1 (f=1): [W(1)][54.9%][w=5229MiB/s][w=5229 IOPS][eta 00m:41s]
  519. Jobs: 1 (f=1): [W(1)][57.8%][w=4593MiB/s][w=4593 IOPS][eta 00m:38s]
  520. Jobs: 1 (f=1): [W(1)][60.0%][w=4280MiB/s][w=4280 IOPS][eta 00m:36s]
  521. Jobs: 1 (f=1): [W(1)][62.9%][w=4277MiB/s][w=4277 IOPS][eta 00m:33s]
  522. Jobs: 1 (f=1): [W(1)][65.2%][w=4252MiB/s][w=4252 IOPS][eta 00m:31s]
  523. Jobs: 1 (f=1): [W(1)][67.4%][w=4277MiB/s][w=4277 IOPS][eta 00m:29s]
  524. Jobs: 1 (f=1): [W(1)][70.5%][w=4281MiB/s][w=4281 IOPS][eta 00m:26s]
  525. Jobs: 1 (f=1): [W(1)][72.7%][w=4282MiB/s][w=4282 IOPS][eta 00m:24s]
  526. Jobs: 1 (f=1): [W(1)][75.0%][w=4277MiB/s][w=4277 IOPS][eta 00m:22s]
  527. Jobs: 1 (f=1): [W(1)][77.3%][w=4257MiB/s][w=4257 IOPS][eta 00m:20s]
  528. Jobs: 1 (f=1): [W(1)][79.5%][w=4274MiB/s][w=4274 IOPS][eta 00m:18s]
  529. Jobs: 1 (f=1): [W(1)][82.8%][w=4280MiB/s][w=4280 IOPS][eta 00m:15s]
  530. Jobs: 1 (f=1): [W(1)][85.1%][w=4272MiB/s][w=4272 IOPS][eta 00m:13s]
  531. Jobs: 1 (f=1): [W(1)][87.4%][w=4265MiB/s][w=4265 IOPS][eta 00m:11s]
  532. Jobs: 1 (f=1): [W(1)][89.7%][w=4277MiB/s][w=4277 IOPS][eta 00m:09s]
  533. Jobs: 1 (f=1): [W(1)][92.0%][w=4280MiB/s][w=4280 IOPS][eta 00m:07s]
  534. Jobs: 1 (f=1): [W(1)][94.3%][w=3840MiB/s][w=3839 IOPS][eta 00m:05s]
  535. Jobs: 1 (f=1): [W(1)][96.6%][w=3822MiB/s][w=3821 IOPS][eta 00m:03s]
  536. Jobs: 1 (f=1): [W(1)][98.9%][w=3813MiB/s][w=3812 IOPS][eta 00m:01s]
  537. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4280: Mon Jan 1 17:43:54 2024
  538. write: IOPS=4051, BW=4051MiB/s (4248MB/s)(316GiB/79795msec); 0 zone resets
  539. slat (usec): min=32, max=275, avg=99.88, stdev=21.29
  540. clat (usec): min=50, max=7737, avg=146.14, stdev=155.47
  541. lat (usec): min=180, max=7822, avg=246.24, stdev=156.56
  542. clat percentiles (usec):
  543. | 1.00th=[ 137], 5.00th=[ 139], 10.00th=[ 139], 20.00th=[ 141],
  544. | 30.00th=[ 141], 40.00th=[ 141], 50.00th=[ 141], 60.00th=[ 143],
  545. | 70.00th=[ 143], 80.00th=[ 143], 90.00th=[ 143], 95.00th=[ 147],
  546. | 99.00th=[ 149], 99.50th=[ 151], 99.90th=[ 1303], 99.95th=[ 5014],
  547. | 99.99th=[ 5276]
  548. bw ( MiB/s): min= 3786, max= 5308, per=100.00%, avg=4054.12, stdev=303.68, samples=159
  549. iops : min= 3786, max= 5308, avg=4053.96, stdev=303.69, samples=159
  550. lat (usec) : 100=0.09%, 250=99.80%, 500=0.01%, 750=0.01%, 1000=0.01%
  551. lat (msec) : 2=0.01%, 4=0.01%, 10=0.10%
  552. cpu : usr=2.07%, sys=40.57%, ctx=323333, majf=0, minf=59
  553. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  554. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  555. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  556. issued rwts: total=0,323255,0,0 short=0,0,0,0 dropped=0,0,0,0
  557. latency : target=0, window=0, percentile=100.00%, depth=1
  558.  
  559. Run status group 0 (all jobs):
  560. WRITE: bw=4051MiB/s (4248MB/s), 4051MiB/s-4051MiB/s (4248MB/s-4248MB/s), io=316GiB (339GB), run=79795-79795msec
  561.  
  562. Disk stats (read/write):
  563. nvme0n1: ios=0/982553, merge=0/16, ticks=0/160556, in_queue=160580, util=99.93%
  564. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=randwrite --bs=4k --ioengine=libaio --iodepth=32 --filesize=64G --numjobs=1 --group_reporting --name=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1
  565. SEQ1M: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=32
  566. fio-3.28
  567. Starting 1 process
  568. Jobs: 0 (f=0)
  569. Jobs: 0 (f=0)
  570. Jobs: 0 (f=0)
  571. Jobs: 1 (f=0): [/(1)][-.-%][eta 00m:00s]
  572. Jobs: 1 (f=1): [w(1)][0.9%][w=624MiB/s][w=160k IOPS][eta 13m:59s]
  573. Jobs: 1 (f=1): [w(1)][1.5%][w=626MiB/s][w=160k IOPS][eta 10m:43s]
  574. Jobs: 1 (f=1): [w(1)][2.0%][w=609MiB/s][w=156k IOPS][eta 09m:58s]
  575. Jobs: 1 (f=1): [w(1)][2.4%][w=622MiB/s][w=159k IOPS][eta 09m:35s]
  576. Jobs: 1 (f=1): [w(1)][2.8%][w=612MiB/s][w=157k IOPS][eta 09m:23s]
  577. Jobs: 1 (f=1): [w(1)][3.1%][w=610MiB/s][w=156k IOPS][eta 09m:14s]
  578. Jobs: 1 (f=1): [w(1)][3.5%][w=623MiB/s][w=159k IOPS][eta 09m:07s]
  579. Jobs: 1 (f=1): [w(1)][3.9%][w=612MiB/s][w=157k IOPS][eta 09m:01s]
  580. Jobs: 1 (f=1): [w(1)][4.3%][w=621MiB/s][w=159k IOPS][eta 08m:56s]
  581. Jobs: 1 (f=1): [w(1)][4.7%][w=610MiB/s][w=156k IOPS][eta 08m:52s]
  582. Jobs: 1 (f=1): [w(1)][5.0%][w=609MiB/s][w=156k IOPS][eta 08m:48s]
  583. Jobs: 1 (f=1): [w(1)][5.4%][w=617MiB/s][w=158k IOPS][eta 08m:44s]
  584. Jobs: 1 (f=1): [w(1)][5.8%][w=617MiB/s][w=158k IOPS][eta 08m:41s]
  585. Jobs: 1 (f=1): [w(1)][6.2%][w=612MiB/s][w=157k IOPS][eta 08m:38s]
  586. Jobs: 1 (f=1): [w(1)][6.5%][w=611MiB/s][w=156k IOPS][eta 08m:35s]
  587. Jobs: 1 (f=1): [w(1)][6.9%][w=611MiB/s][w=157k IOPS][eta 08m:32s]
  588. Jobs: 1 (f=1): [w(1)][7.3%][w=609MiB/s][w=156k IOPS][eta 08m:30s]
  589. Jobs: 1 (f=1): [w(1)][7.7%][w=613MiB/s][w=157k IOPS][eta 08m:27s]
  590. Jobs: 1 (f=1): [w(1)][8.0%][w=611MiB/s][w=156k IOPS][eta 08m:25s]
  591. Jobs: 1 (f=1): [w(1)][8.4%][w=612MiB/s][w=157k IOPS][eta 08m:22s]
  592. Jobs: 1 (f=1): [w(1)][8.8%][w=617MiB/s][w=158k IOPS][eta 08m:20s]
  593. Jobs: 1 (f=1): [w(1)][9.1%][w=610MiB/s][w=156k IOPS][eta 08m:18s]
  594. Jobs: 1 (f=1): [w(1)][9.5%][w=607MiB/s][w=155k IOPS][eta 08m:16s]
  595. Jobs: 1 (f=1): [w(1)][9.9%][w=620MiB/s][w=159k IOPS][eta 08m:13s]
  596. Jobs: 1 (f=1): [w(1)][10.2%][w=621MiB/s][w=159k IOPS][eta 08m:11s]
  597. Jobs: 1 (f=1): [w(1)][10.6%][w=610MiB/s][w=156k IOPS][eta 08m:08s]
  598. Jobs: 1 (f=1): [w(1)][11.0%][w=609MiB/s][w=156k IOPS][eta 08m:06s]
  599. Jobs: 1 (f=1): [w(1)][11.4%][w=609MiB/s][w=156k IOPS][eta 08m:04s]
  600. Jobs: 1 (f=1): [w(1)][11.7%][w=615MiB/s][w=157k IOPS][eta 08m:02s]
  601. Jobs: 1 (f=1): [w(1)][12.1%][w=619MiB/s][w=158k IOPS][eta 08m:00s]
  602. Jobs: 1 (f=1): [w(1)][12.5%][w=610MiB/s][w=156k IOPS][eta 07m:58s]
  603. Jobs: 1 (f=1): [w(1)][12.8%][w=611MiB/s][w=156k IOPS][eta 07m:56s]
  604. Jobs: 1 (f=1): [w(1)][13.2%][w=612MiB/s][w=157k IOPS][eta 07m:54s]
  605. Jobs: 1 (f=1): [w(1)][13.6%][w=610MiB/s][w=156k IOPS][eta 07m:51s]
  606. Jobs: 1 (f=1): [w(1)][13.9%][w=613MiB/s][w=157k IOPS][eta 07m:49s]
  607. Jobs: 1 (f=1): [w(1)][14.3%][w=617MiB/s][w=158k IOPS][eta 07m:47s]
  608. Jobs: 1 (f=1): [w(1)][14.7%][w=620MiB/s][w=159k IOPS][eta 07m:45s]
  609. Jobs: 1 (f=1): [w(1)][15.0%][w=611MiB/s][w=156k IOPS][eta 07m:43s]
  610. Jobs: 1 (f=1): [w(1)][15.4%][w=616MiB/s][w=158k IOPS][eta 07m:41s]
  611. Jobs: 1 (f=1): [w(1)][15.8%][w=612MiB/s][w=157k IOPS][eta 07m:38s]
  612. Jobs: 1 (f=1): [w(1)][16.2%][w=607MiB/s][w=155k IOPS][eta 07m:36s]
  613. Jobs: 1 (f=1): [w(1)][16.5%][w=609MiB/s][w=156k IOPS][eta 07m:34s]
  614. Jobs: 1 (f=1): [w(1)][16.9%][w=609MiB/s][w=156k IOPS][eta 07m:32s]
  615. Jobs: 1 (f=1): [w(1)][17.3%][w=609MiB/s][w=156k IOPS][eta 07m:30s]
  616. Jobs: 1 (f=1): [w(1)][17.6%][w=609MiB/s][w=156k IOPS][eta 07m:28s]
  617. Jobs: 1 (f=1): [w(1)][18.0%][w=613MiB/s][w=157k IOPS][eta 07m:26s]
  618. Jobs: 1 (f=1): [w(1)][18.4%][w=609MiB/s][w=156k IOPS][eta 07m:24s]
  619. Jobs: 1 (f=1): [w(1)][18.8%][w=607MiB/s][w=155k IOPS][eta 07m:22s]
  620. Jobs: 1 (f=1): [w(1)][19.1%][w=616MiB/s][w=158k IOPS][eta 07m:20s]
  621. Jobs: 1 (f=1): [w(1)][19.5%][w=616MiB/s][w=158k IOPS][eta 07m:18s]
  622. Jobs: 1 (f=1): [w(1)][19.9%][w=610MiB/s][w=156k IOPS][eta 07m:16s]
  623. Jobs: 1 (f=1): [w(1)][20.2%][w=610MiB/s][w=156k IOPS][eta 07m:14s]
  624. Jobs: 1 (f=1): [w(1)][20.6%][w=606MiB/s][w=155k IOPS][eta 07m:12s]
  625. Jobs: 1 (f=1): [w(1)][21.0%][w=611MiB/s][w=156k IOPS][eta 07m:10s]
  626. Jobs: 1 (f=1): [w(1)][21.3%][w=612MiB/s][w=157k IOPS][eta 07m:08s]
  627. Jobs: 1 (f=1): [w(1)][21.7%][w=619MiB/s][w=158k IOPS][eta 07m:06s]
  628. Jobs: 1 (f=1): [w(1)][22.1%][w=612MiB/s][w=157k IOPS][eta 07m:04s]
  629. Jobs: 1 (f=1): [w(1)][22.4%][w=611MiB/s][w=156k IOPS][eta 07m:02s]
  630. Jobs: 1 (f=1): [w(1)][22.8%][w=612MiB/s][w=157k IOPS][eta 07m:00s]
  631. Jobs: 1 (f=1): [w(1)][23.2%][w=606MiB/s][w=155k IOPS][eta 06m:58s]
  632. Jobs: 1 (f=1): [w(1)][23.5%][w=609MiB/s][w=156k IOPS][eta 06m:56s]
  633. Jobs: 1 (f=1): [w(1)][23.9%][w=614MiB/s][w=157k IOPS][eta 06m:53s]
  634. Jobs: 1 (f=1): [w(1)][24.3%][w=612MiB/s][w=157k IOPS][eta 06m:51s]
  635. Jobs: 1 (f=1): [w(1)][24.7%][w=612MiB/s][w=157k IOPS][eta 06m:49s]
  636. Jobs: 1 (f=1): [w(1)][25.0%][w=609MiB/s][w=156k IOPS][eta 06m:47s]
  637. Jobs: 1 (f=1): [w(1)][25.4%][w=609MiB/s][w=156k IOPS][eta 06m:45s]
  638. Jobs: 1 (f=1): [w(1)][25.8%][w=609MiB/s][w=156k IOPS][eta 06m:43s]
  639. Jobs: 1 (f=1): [w(1)][26.2%][w=609MiB/s][w=156k IOPS][eta 06m:41s]
  640. Jobs: 1 (f=1): [w(1)][26.5%][w=610MiB/s][w=156k IOPS][eta 06m:39s]
  641. Jobs: 1 (f=1): [w(1)][26.9%][w=610MiB/s][w=156k IOPS][eta 06m:37s]
  642. Jobs: 1 (f=1): [w(1)][27.3%][w=608MiB/s][w=156k IOPS][eta 06m:35s]
  643. Jobs: 1 (f=1): [w(1)][27.6%][w=619MiB/s][w=158k IOPS][eta 06m:33s]
  644. Jobs: 1 (f=1): [w(1)][28.0%][w=615MiB/s][w=157k IOPS][eta 06m:31s]
  645. Jobs: 1 (f=1): [w(1)][28.4%][w=612MiB/s][w=157k IOPS][eta 06m:29s]
  646. Jobs: 1 (f=1): [w(1)][28.7%][w=611MiB/s][w=156k IOPS][eta 06m:27s]
  647. Jobs: 1 (f=1): [w(1)][29.1%][w=611MiB/s][w=156k IOPS][eta 06m:25s]
  648. Jobs: 1 (f=1): [w(1)][29.5%][w=609MiB/s][w=156k IOPS][eta 06m:23s]
  649. Jobs: 1 (f=1): [w(1)][29.8%][w=607MiB/s][w=155k IOPS][eta 06m:21s]
  650. Jobs: 1 (f=1): [w(1)][30.2%][w=609MiB/s][w=156k IOPS][eta 06m:19s]
  651. Jobs: 1 (f=1): [w(1)][30.6%][w=608MiB/s][w=156k IOPS][eta 06m:17s]
  652. Jobs: 1 (f=1): [w(1)][30.9%][w=607MiB/s][w=155k IOPS][eta 06m:15s]
  653. Jobs: 1 (f=1): [w(1)][31.3%][w=611MiB/s][w=156k IOPS][eta 06m:13s]
  654. Jobs: 1 (f=1): [w(1)][31.7%][w=607MiB/s][w=155k IOPS][eta 06m:11s]
  655. Jobs: 1 (f=1): [w(1)][32.0%][w=609MiB/s][w=156k IOPS][eta 06m:09s]
  656. Jobs: 1 (f=1): [w(1)][32.4%][w=609MiB/s][w=156k IOPS][eta 06m:07s]
  657. Jobs: 1 (f=1): [w(1)][32.8%][w=608MiB/s][w=156k IOPS][eta 06m:05s]
  658. Jobs: 1 (f=1): [w(1)][33.1%][w=608MiB/s][w=156k IOPS][eta 06m:03s]
  659. Jobs: 1 (f=1): [w(1)][33.5%][w=611MiB/s][w=156k IOPS][eta 06m:01s]
  660. Jobs: 1 (f=1): [w(1)][33.9%][w=610MiB/s][w=156k IOPS][eta 05m:59s]
  661. Jobs: 1 (f=1): [w(1)][34.3%][w=610MiB/s][w=156k IOPS][eta 05m:57s]
  662. Jobs: 1 (f=1): [w(1)][34.6%][w=606MiB/s][w=155k IOPS][eta 05m:55s]
  663. Jobs: 1 (f=1): [w(1)][35.0%][w=610MiB/s][w=156k IOPS][eta 05m:53s]
  664. Jobs: 1 (f=1): [w(1)][35.4%][w=606MiB/s][w=155k IOPS][eta 05m:51s]
  665. Jobs: 1 (f=1): [w(1)][35.7%][w=609MiB/s][w=156k IOPS][eta 05m:49s]
  666. Jobs: 1 (f=1): [w(1)][36.1%][w=612MiB/s][w=157k IOPS][eta 05m:47s]
  667. Jobs: 1 (f=1): [w(1)][36.5%][w=610MiB/s][w=156k IOPS][eta 05m:45s]
  668. Jobs: 1 (f=1): [w(1)][36.8%][w=611MiB/s][w=156k IOPS][eta 05m:43s]
  669. Jobs: 1 (f=1): [w(1)][37.2%][w=605MiB/s][w=155k IOPS][eta 05m:41s]
  670. Jobs: 1 (f=1): [w(1)][37.6%][w=607MiB/s][w=155k IOPS][eta 05m:39s]
  671. Jobs: 1 (f=1): [w(1)][37.9%][w=607MiB/s][w=156k IOPS][eta 05m:37s]
  672. Jobs: 1 (f=1): [w(1)][38.3%][w=613MiB/s][w=157k IOPS][eta 05m:35s]
  673. Jobs: 1 (f=1): [w(1)][38.7%][w=616MiB/s][w=158k IOPS][eta 05m:33s]
  674. Jobs: 1 (f=1): [w(1)][39.0%][w=609MiB/s][w=156k IOPS][eta 05m:31s]
  675. Jobs: 1 (f=1): [w(1)][39.4%][w=611MiB/s][w=156k IOPS][eta 05m:29s]
  676. Jobs: 1 (f=1): [w(1)][39.8%][w=605MiB/s][w=155k IOPS][eta 05m:27s]
  677. Jobs: 1 (f=1): [w(1)][40.1%][w=607MiB/s][w=155k IOPS][eta 05m:25s]
  678. Jobs: 1 (f=1): [w(1)][40.5%][w=607MiB/s][w=155k IOPS][eta 05m:23s]
  679. Jobs: 1 (f=1): [w(1)][40.9%][w=615MiB/s][w=157k IOPS][eta 05m:21s]
  680. Jobs: 1 (f=1): [w(1)][41.3%][w=614MiB/s][w=157k IOPS][eta 05m:19s]
  681. Jobs: 1 (f=1): [w(1)][41.6%][w=614MiB/s][w=157k IOPS][eta 05m:17s]
  682. Jobs: 1 (f=1): [w(1)][42.0%][w=613MiB/s][w=157k IOPS][eta 05m:15s]
  683. Jobs: 1 (f=1): [w(1)][42.4%][w=608MiB/s][w=156k IOPS][eta 05m:13s]
  684. Jobs: 1 (f=1): [w(1)][42.7%][w=618MiB/s][w=158k IOPS][eta 05m:11s]
  685. Jobs: 1 (f=1): [w(1)][43.1%][w=609MiB/s][w=156k IOPS][eta 05m:09s]
  686. Jobs: 1 (f=1): [w(1)][43.5%][w=613MiB/s][w=157k IOPS][eta 05m:07s]
  687. Jobs: 1 (f=1): [w(1)][43.8%][w=609MiB/s][w=156k IOPS][eta 05m:05s]
  688. Jobs: 1 (f=1): [w(1)][44.2%][w=609MiB/s][w=156k IOPS][eta 05m:03s]
  689. Jobs: 1 (f=1): [w(1)][44.6%][w=609MiB/s][w=156k IOPS][eta 05m:01s]
  690. Jobs: 1 (f=1): [w(1)][44.9%][w=607MiB/s][w=155k IOPS][eta 04m:59s]
  691. Jobs: 1 (f=1): [w(1)][45.3%][w=609MiB/s][w=156k IOPS][eta 04m:57s]
  692. Jobs: 1 (f=1): [w(1)][45.7%][w=612MiB/s][w=157k IOPS][eta 04m:55s]
  693. Jobs: 1 (f=1): [w(1)][46.0%][w=611MiB/s][w=156k IOPS][eta 04m:53s]
  694. Jobs: 1 (f=1): [w(1)][46.4%][w=607MiB/s][w=155k IOPS][eta 04m:51s]
  695. Jobs: 1 (f=1): [w(1)][46.8%][w=615MiB/s][w=158k IOPS][eta 04m:49s]
  696. Jobs: 1 (f=1): [w(1)][47.1%][w=609MiB/s][w=156k IOPS][eta 04m:47s]
  697. Jobs: 1 (f=1): [w(1)][47.5%][w=608MiB/s][w=156k IOPS][eta 04m:45s]
  698. Jobs: 1 (f=1): [w(1)][47.9%][w=612MiB/s][w=157k IOPS][eta 04m:43s]
  699. Jobs: 1 (f=1): [w(1)][48.3%][w=614MiB/s][w=157k IOPS][eta 04m:41s]
  700. Jobs: 1 (f=1): [w(1)][48.6%][w=614MiB/s][w=157k IOPS][eta 04m:39s]
  701. Jobs: 1 (f=1): [w(1)][49.0%][w=618MiB/s][w=158k IOPS][eta 04m:37s]
  702. Jobs: 1 (f=1): [w(1)][49.4%][w=607MiB/s][w=155k IOPS][eta 04m:35s]
  703. Jobs: 1 (f=1): [w(1)][49.7%][w=611MiB/s][w=156k IOPS][eta 04m:33s]
  704. Jobs: 1 (f=1): [w(1)][50.1%][w=612MiB/s][w=157k IOPS][eta 04m:31s]
  705. Jobs: 1 (f=1): [w(1)][50.5%][w=610MiB/s][w=156k IOPS][eta 04m:29s]
  706. Jobs: 1 (f=1): [w(1)][50.8%][w=613MiB/s][w=157k IOPS][eta 04m:27s]
  707. Jobs: 1 (f=1): [w(1)][51.2%][w=612MiB/s][w=157k IOPS][eta 04m:25s]
  708. Jobs: 1 (f=1): [w(1)][51.6%][w=605MiB/s][w=155k IOPS][eta 04m:23s]
  709. Jobs: 1 (f=1): [w(1)][51.9%][w=606MiB/s][w=155k IOPS][eta 04m:21s]
  710. Jobs: 1 (f=1): [w(1)][52.3%][w=607MiB/s][w=155k IOPS][eta 04m:19s]
  711. Jobs: 1 (f=1): [w(1)][52.7%][w=610MiB/s][w=156k IOPS][eta 04m:17s]
  712. Jobs: 1 (f=1): [w(1)][53.0%][w=611MiB/s][w=156k IOPS][eta 04m:15s]
  713. Jobs: 1 (f=1): [w(1)][53.4%][w=608MiB/s][w=156k IOPS][eta 04m:13s]
  714. Jobs: 1 (f=1): [w(1)][53.8%][w=604MiB/s][w=155k IOPS][eta 04m:11s]
  715. Jobs: 1 (f=1): [w(1)][54.1%][w=604MiB/s][w=155k IOPS][eta 04m:09s]
  716. Jobs: 1 (f=1): [w(1)][54.5%][w=606MiB/s][w=155k IOPS][eta 04m:07s]
  717. Jobs: 1 (f=1): [w(1)][54.9%][w=608MiB/s][w=156k IOPS][eta 04m:05s]
  718. Jobs: 1 (f=1): [w(1)][55.2%][w=611MiB/s][w=156k IOPS][eta 04m:03s]
  719. Jobs: 1 (f=1): [w(1)][55.6%][w=609MiB/s][w=156k IOPS][eta 04m:01s]
  720. Jobs: 1 (f=1): [w(1)][56.0%][w=608MiB/s][w=156k IOPS][eta 03m:59s]
  721. Jobs: 1 (f=1): [w(1)][56.4%][w=608MiB/s][w=156k IOPS][eta 03m:57s]
  722. Jobs: 1 (f=1): [w(1)][56.7%][w=613MiB/s][w=157k IOPS][eta 03m:55s]
  723. Jobs: 1 (f=1): [w(1)][57.1%][w=610MiB/s][w=156k IOPS][eta 03m:53s]
  724. Jobs: 1 (f=1): [w(1)][57.5%][w=609MiB/s][w=156k IOPS][eta 03m:51s]
  725. Jobs: 1 (f=1): [w(1)][57.8%][w=610MiB/s][w=156k IOPS][eta 03m:49s]
  726. Jobs: 1 (f=1): [w(1)][58.2%][w=609MiB/s][w=156k IOPS][eta 03m:47s]
  727. Jobs: 1 (f=1): [w(1)][58.6%][w=608MiB/s][w=156k IOPS][eta 03m:45s]
  728. Jobs: 1 (f=1): [w(1)][58.9%][w=609MiB/s][w=156k IOPS][eta 03m:43s]
  729. Jobs: 1 (f=1): [w(1)][59.3%][w=616MiB/s][w=158k IOPS][eta 03m:41s]
  730. Jobs: 1 (f=1): [w(1)][59.7%][w=619MiB/s][w=158k IOPS][eta 03m:39s]
  731. Jobs: 1 (f=1): [w(1)][60.0%][w=610MiB/s][w=156k IOPS][eta 03m:37s]
  732. Jobs: 1 (f=1): [w(1)][60.4%][w=613MiB/s][w=157k IOPS][eta 03m:35s]
  733. Jobs: 1 (f=1): [w(1)][60.8%][w=610MiB/s][w=156k IOPS][eta 03m:33s]
  734. Jobs: 1 (f=1): [w(1)][61.1%][w=606MiB/s][w=155k IOPS][eta 03m:31s]
  735. Jobs: 1 (f=1): [w(1)][61.5%][w=609MiB/s][w=156k IOPS][eta 03m:29s]
  736. Jobs: 1 (f=1): [w(1)][61.9%][w=611MiB/s][w=156k IOPS][eta 03m:27s]
  737. Jobs: 1 (f=1): [w(1)][62.2%][w=615MiB/s][w=158k IOPS][eta 03m:25s]
  738. Jobs: 1 (f=1): [w(1)][62.6%][w=617MiB/s][w=158k IOPS][eta 03m:23s]
  739. Jobs: 1 (f=1): [w(1)][63.0%][w=607MiB/s][w=155k IOPS][eta 03m:21s]
  740. Jobs: 1 (f=1): [w(1)][63.4%][w=618MiB/s][w=158k IOPS][eta 03m:19s]
  741. Jobs: 1 (f=1): [w(1)][63.7%][w=608MiB/s][w=156k IOPS][eta 03m:17s]
  742. Jobs: 1 (f=1): [w(1)][64.1%][w=608MiB/s][w=156k IOPS][eta 03m:15s]
  743. Jobs: 1 (f=1): [w(1)][64.5%][w=618MiB/s][w=158k IOPS][eta 03m:13s]
  744. Jobs: 1 (f=1): [w(1)][64.8%][w=615MiB/s][w=157k IOPS][eta 03m:11s]
  745. Jobs: 1 (f=1): [w(1)][65.2%][w=608MiB/s][w=156k IOPS][eta 03m:09s]
  746. Jobs: 1 (f=1): [w(1)][65.6%][w=609MiB/s][w=156k IOPS][eta 03m:07s]
  747. Jobs: 1 (f=1): [w(1)][65.9%][w=607MiB/s][w=155k IOPS][eta 03m:05s]
  748. Jobs: 1 (f=1): [w(1)][66.3%][w=610MiB/s][w=156k IOPS][eta 03m:03s]
  749. Jobs: 1 (f=1): [w(1)][66.7%][w=610MiB/s][w=156k IOPS][eta 03m:01s]
  750. Jobs: 1 (f=1): [w(1)][67.0%][w=611MiB/s][w=156k IOPS][eta 02m:59s]
  751. Jobs: 1 (f=1): [w(1)][67.4%][w=612MiB/s][w=157k IOPS][eta 02m:57s]
  752. Jobs: 1 (f=1): [w(1)][67.8%][w=608MiB/s][w=156k IOPS][eta 02m:55s]
  753. Jobs: 1 (f=1): [w(1)][68.1%][w=619MiB/s][w=159k IOPS][eta 02m:53s]
  754. Jobs: 1 (f=1): [w(1)][68.5%][w=617MiB/s][w=158k IOPS][eta 02m:51s]
  755. Jobs: 1 (f=1): [w(1)][68.9%][w=613MiB/s][w=157k IOPS][eta 02m:49s]
  756. Jobs: 1 (f=1): [w(1)][69.2%][w=612MiB/s][w=157k IOPS][eta 02m:47s]
  757. Jobs: 1 (f=1): [w(1)][69.6%][w=611MiB/s][w=156k IOPS][eta 02m:45s]
  758. Jobs: 1 (f=1): [w(1)][70.0%][w=611MiB/s][w=156k IOPS][eta 02m:43s]
  759. Jobs: 1 (f=1): [w(1)][70.3%][w=607MiB/s][w=155k IOPS][eta 02m:41s]
  760. Jobs: 1 (f=1): [w(1)][70.7%][w=608MiB/s][w=156k IOPS][eta 02m:39s]
  761. Jobs: 1 (f=1): [w(1)][71.1%][w=619MiB/s][w=158k IOPS][eta 02m:37s]
  762. Jobs: 1 (f=1): [w(1)][71.5%][w=612MiB/s][w=157k IOPS][eta 02m:35s]
  763. Jobs: 1 (f=1): [w(1)][71.8%][w=611MiB/s][w=156k IOPS][eta 02m:33s]
  764. Jobs: 1 (f=1): [w(1)][72.2%][w=611MiB/s][w=156k IOPS][eta 02m:31s]
  765. Jobs: 1 (f=1): [w(1)][72.6%][w=618MiB/s][w=158k IOPS][eta 02m:29s]
  766. Jobs: 1 (f=1): [w(1)][72.9%][w=614MiB/s][w=157k IOPS][eta 02m:27s]
  767. Jobs: 1 (f=1): [w(1)][73.3%][w=608MiB/s][w=156k IOPS][eta 02m:25s]
  768. Jobs: 1 (f=1): [w(1)][73.7%][w=609MiB/s][w=156k IOPS][eta 02m:23s]
  769. Jobs: 1 (f=1): [w(1)][74.0%][w=610MiB/s][w=156k IOPS][eta 02m:21s]
  770. Jobs: 1 (f=1): [w(1)][74.4%][w=611MiB/s][w=156k IOPS][eta 02m:19s]
  771. Jobs: 1 (f=1): [w(1)][74.8%][w=607MiB/s][w=155k IOPS][eta 02m:17s]
  772. Jobs: 1 (f=1): [w(1)][75.1%][w=603MiB/s][w=154k IOPS][eta 02m:15s]
  773. Jobs: 1 (f=1): [w(1)][75.5%][w=616MiB/s][w=158k IOPS][eta 02m:13s]
  774. Jobs: 1 (f=1): [w(1)][75.9%][w=615MiB/s][w=157k IOPS][eta 02m:11s]
  775. Jobs: 1 (f=1): [w(1)][76.2%][w=621MiB/s][w=159k IOPS][eta 02m:09s]
  776. Jobs: 1 (f=1): [w(1)][76.6%][w=611MiB/s][w=156k IOPS][eta 02m:07s]
  777. Jobs: 1 (f=1): [w(1)][77.0%][w=607MiB/s][w=155k IOPS][eta 02m:05s]
  778. Jobs: 1 (f=1): [w(1)][77.3%][w=606MiB/s][w=155k IOPS][eta 02m:03s]
  779. Jobs: 1 (f=1): [w(1)][77.7%][w=614MiB/s][w=157k IOPS][eta 02m:01s]
  780. Jobs: 1 (f=1): [w(1)][78.1%][w=618MiB/s][w=158k IOPS][eta 01m:59s]
  781. Jobs: 1 (f=1): [w(1)][78.5%][w=609MiB/s][w=156k IOPS][eta 01m:57s]
  782. Jobs: 1 (f=1): [w(1)][78.8%][w=608MiB/s][w=156k IOPS][eta 01m:55s]
  783. Jobs: 1 (f=1): [w(1)][79.2%][w=614MiB/s][w=157k IOPS][eta 01m:53s]
  784. Jobs: 1 (f=1): [w(1)][79.6%][w=608MiB/s][w=156k IOPS][eta 01m:51s]
  785. Jobs: 1 (f=1): [w(1)][79.9%][w=607MiB/s][w=155k IOPS][eta 01m:49s]
  786. Jobs: 1 (f=1): [w(1)][80.3%][w=607MiB/s][w=155k IOPS][eta 01m:47s]
  787. Jobs: 1 (f=1): [w(1)][80.7%][w=611MiB/s][w=156k IOPS][eta 01m:45s]
  788. Jobs: 1 (f=1): [w(1)][81.0%][w=613MiB/s][w=157k IOPS][eta 01m:43s]
  789. Jobs: 1 (f=1): [w(1)][81.4%][w=623MiB/s][w=159k IOPS][eta 01m:41s]
  790. Jobs: 1 (f=1): [w(1)][81.8%][w=613MiB/s][w=157k IOPS][eta 01m:39s]
  791. Jobs: 1 (f=1): [w(1)][82.1%][w=609MiB/s][w=156k IOPS][eta 01m:37s]
  792. Jobs: 1 (f=1): [w(1)][82.5%][w=618MiB/s][w=158k IOPS][eta 01m:35s]
  793. Jobs: 1 (f=1): [w(1)][82.9%][w=609MiB/s][w=156k IOPS][eta 01m:33s]
  794. Jobs: 1 (f=1): [w(1)][83.2%][w=610MiB/s][w=156k IOPS][eta 01m:31s]
  795. Jobs: 1 (f=1): [w(1)][83.6%][w=612MiB/s][w=157k IOPS][eta 01m:29s]
  796. Jobs: 1 (f=1): [w(1)][84.0%][w=609MiB/s][w=156k IOPS][eta 01m:27s]
  797. Jobs: 1 (f=1): [w(1)][84.3%][w=608MiB/s][w=156k IOPS][eta 01m:25s]
  798. Jobs: 1 (f=1): [w(1)][84.7%][w=611MiB/s][w=156k IOPS][eta 01m:23s]
  799. Jobs: 1 (f=1): [w(1)][85.1%][w=611MiB/s][w=156k IOPS][eta 01m:21s]
  800. Jobs: 1 (f=1): [w(1)][85.5%][w=611MiB/s][w=156k IOPS][eta 01m:19s]
  801. Jobs: 1 (f=1): [w(1)][85.8%][w=612MiB/s][w=157k IOPS][eta 01m:17s]
  802. Jobs: 1 (f=1): [w(1)][86.2%][w=620MiB/s][w=159k IOPS][eta 01m:15s]
  803. Jobs: 1 (f=1): [w(1)][86.7%][w=619MiB/s][w=158k IOPS][eta 01m:12s]
  804. Jobs: 1 (f=1): [w(1)][87.1%][w=612MiB/s][w=157k IOPS][eta 01m:10s]
  805. Jobs: 1 (f=1): [w(1)][87.5%][w=607MiB/s][w=155k IOPS][eta 01m:08s]
  806. Jobs: 1 (f=1): [w(1)][87.8%][w=611MiB/s][w=156k IOPS][eta 01m:06s]
  807. Jobs: 1 (f=1): [w(1)][88.2%][w=609MiB/s][w=156k IOPS][eta 01m:04s]
  808. Jobs: 1 (f=1): [w(1)][88.6%][w=609MiB/s][w=156k IOPS][eta 01m:02s]
  809. Jobs: 1 (f=1): [w(1)][88.9%][w=613MiB/s][w=157k IOPS][eta 01m:00s]
  810. Jobs: 1 (f=1): [w(1)][89.3%][w=609MiB/s][w=156k IOPS][eta 00m:58s]
  811. Jobs: 1 (f=1): [w(1)][89.7%][w=606MiB/s][w=155k IOPS][eta 00m:56s]
  812. Jobs: 1 (f=1): [w(1)][90.0%][w=608MiB/s][w=156k IOPS][eta 00m:54s]
  813. Jobs: 1 (f=1): [w(1)][90.4%][w=619MiB/s][w=158k IOPS][eta 00m:52s]
  814. Jobs: 1 (f=1): [w(1)][90.8%][w=620MiB/s][w=159k IOPS][eta 00m:50s]
  815. Jobs: 1 (f=1): [w(1)][91.1%][w=605MiB/s][w=155k IOPS][eta 00m:48s]
  816. Jobs: 1 (f=1): [w(1)][91.5%][w=617MiB/s][w=158k IOPS][eta 00m:46s]
  817. Jobs: 1 (f=1): [w(1)][91.9%][w=608MiB/s][w=156k IOPS][eta 00m:44s]
  818. Jobs: 1 (f=1): [w(1)][92.3%][w=609MiB/s][w=156k IOPS][eta 00m:42s]
  819. Jobs: 1 (f=1): [w(1)][92.6%][w=612MiB/s][w=157k IOPS][eta 00m:40s]
  820. Jobs: 1 (f=1): [w(1)][93.0%][w=611MiB/s][w=157k IOPS][eta 00m:38s]
  821. Jobs: 1 (f=1): [w(1)][93.4%][w=611MiB/s][w=156k IOPS][eta 00m:36s]
  822. Jobs: 1 (f=1): [w(1)][93.7%][w=607MiB/s][w=155k IOPS][eta 00m:34s]
  823. Jobs: 1 (f=1): [w(1)][94.1%][w=604MiB/s][w=155k IOPS][eta 00m:32s]
  824. Jobs: 1 (f=1): [w(1)][94.5%][w=608MiB/s][w=156k IOPS][eta 00m:30s]
  825. Jobs: 1 (f=1): [w(1)][94.8%][w=612MiB/s][w=157k IOPS][eta 00m:28s]
  826. Jobs: 1 (f=1): [w(1)][95.2%][w=609MiB/s][w=156k IOPS][eta 00m:26s]
  827. Jobs: 1 (f=1): [w(1)][95.4%][w=609MiB/s][w=156k IOPS][eta 00m:25s]
  828. Jobs: 1 (f=1): [w(1)][95.8%][w=609MiB/s][w=156k IOPS][eta 00m:23s]
  829. Jobs: 1 (f=1): [w(1)][96.1%][w=610MiB/s][w=156k IOPS][eta 00m:21s]
  830. Jobs: 1 (f=1): [w(1)][96.5%][w=606MiB/s][w=155k IOPS][eta 00m:19s]
  831. Jobs: 1 (f=1): [w(1)][96.9%][w=607MiB/s][w=155k IOPS][eta 00m:17s]
  832. Jobs: 1 (f=1): [w(1)][97.2%][w=608MiB/s][w=156k IOPS][eta 00m:15s]
  833. Jobs: 1 (f=1): [w(1)][97.6%][w=609MiB/s][w=156k IOPS][eta 00m:13s]
  834. Jobs: 1 (f=1): [w(1)][98.0%][w=617MiB/s][w=158k IOPS][eta 00m:11s]
  835. Jobs: 1 (f=1): [w(1)][98.3%][w=616MiB/s][w=158k IOPS][eta 00m:09s]
  836. Jobs: 1 (f=1): [w(1)][98.7%][w=617MiB/s][w=158k IOPS][eta 00m:07s]
  837. Jobs: 1 (f=1): [w(1)][99.3%][w=613MiB/s][w=157k IOPS][eta 00m:04s]
  838. Jobs: 1 (f=1): [w(1)][99.6%][w=606MiB/s][w=155k IOPS][eta 00m:02s]
  839. Jobs: 1 (f=0): [f(1)][100.0%][w=608MiB/s][w=156k IOPS][eta 00m:00s]
  840. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4304: Mon Jan 1 17:55:41 2024
  841. write: IOPS=156k, BW=611MiB/s (641MB/s)(319GiB/535231msec); 0 zone resets
  842. slat (usec): min=2, max=461, avg= 5.53, stdev= 2.94
  843. clat (usec): min=5, max=5283, avg=198.76, stdev=38.37
  844. lat (usec): min=12, max=5285, avg=204.34, stdev=38.45
  845. clat percentiles (usec):
  846. | 1.00th=[ 190], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 194],
  847. | 30.00th=[ 196], 40.00th=[ 196], 50.00th=[ 196], 60.00th=[ 198],
  848. | 70.00th=[ 200], 80.00th=[ 200], 90.00th=[ 208], 95.00th=[ 212],
  849. | 99.00th=[ 219], 99.50th=[ 221], 99.90th=[ 482], 99.95th=[ 545],
  850. | 99.99th=[ 3195]
  851. bw ( KiB/s): min=614264, max=641352, per=100.00%, avg=625960.46, stdev=5158.21, samples=1070
  852. iops : min=153566, max=160338, avg=156490.07, stdev=1289.55, samples=1070
  853. lat (usec) : 10=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=99.81%
  854. lat (usec) : 500=0.13%, 750=0.04%, 1000=0.01%
  855. lat (msec) : 2=0.01%, 4=0.01%, 10=0.01%
  856. cpu : usr=4.88%, sys=64.75%, ctx=83142969, majf=0, minf=58
  857. IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
  858. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  859. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
  860. issued rwts: total=0,83728186,0,0 short=0,0,0,0 dropped=0,0,0,0
  861. latency : target=0, window=0, percentile=100.00%, depth=32
  862.  
  863. Run status group 0 (all jobs):
  864. WRITE: bw=611MiB/s (641MB/s), 611MiB/s-611MiB/s (641MB/s-641MB/s), io=319GiB (343GB), run=535231-535231msec
  865.  
  866. Disk stats (read/write):
  867. nvme0n1: ios=12/83850005, merge=0/203, ticks=1/646866, in_queue=647005, util=100.00%
  868. root@am08pro:/home/am08pro# fio --filename=./fio.temp --direct=1 --rw=randwrite --bs=4k --ioengine=libaio --iodepth=1 --filesize=64G --numjobs=1 --group_reporting --name=SEQ1M --eta-newline=1 --loops=5 --startdelay=5 --ramp_time=1 --time_based --runtime=60s
  869. SEQ1M: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1
  870. fio-3.28
  871. Starting 1 process
  872. Jobs: 0 (f=0)
  873. Jobs: 0 (f=0)
  874. Jobs: 0 (f=0)
  875. Jobs: 1 (f=0): [/(1)][-.-%][eta 01m:05s]
  876. Jobs: 1 (f=1): [w(1)][12.1%][w=313MiB/s][w=80.2k IOPS][eta 00m:58s]
  877. Jobs: 1 (f=1): [w(1)][15.2%][w=313MiB/s][w=80.2k IOPS][eta 00m:56s]
  878. Jobs: 1 (f=1): [w(1)][18.2%][w=313MiB/s][w=80.1k IOPS][eta 00m:54s]
  879. Jobs: 1 (f=1): [w(1)][21.2%][w=312MiB/s][w=80.0k IOPS][eta 00m:52s]
  880. Jobs: 1 (f=1): [w(1)][24.2%][w=312MiB/s][w=80.0k IOPS][eta 00m:50s]
  881. Jobs: 1 (f=1): [w(1)][27.3%][w=313MiB/s][w=80.1k IOPS][eta 00m:48s]
  882. Jobs: 1 (f=1): [w(1)][30.3%][w=313MiB/s][w=80.0k IOPS][eta 00m:46s]
  883. Jobs: 1 (f=1): [w(1)][33.3%][w=313MiB/s][w=80.0k IOPS][eta 00m:44s]
  884. Jobs: 1 (f=1): [w(1)][36.4%][w=312MiB/s][w=79.9k IOPS][eta 00m:42s]
  885. Jobs: 1 (f=1): [w(1)][39.4%][w=312MiB/s][w=79.9k IOPS][eta 00m:40s]
  886. Jobs: 1 (f=1): [w(1)][42.4%][w=312MiB/s][w=80.0k IOPS][eta 00m:38s]
  887. Jobs: 1 (f=1): [w(1)][45.5%][w=312MiB/s][w=79.9k IOPS][eta 00m:36s]
  888. Jobs: 1 (f=1): [w(1)][48.5%][w=312MiB/s][w=79.9k IOPS][eta 00m:34s]
  889. Jobs: 1 (f=1): [w(1)][51.5%][w=312MiB/s][w=79.8k IOPS][eta 00m:32s]
  890. Jobs: 1 (f=1): [w(1)][54.5%][w=312MiB/s][w=79.8k IOPS][eta 00m:30s]
  891. Jobs: 1 (f=1): [w(1)][57.6%][w=313MiB/s][w=80.0k IOPS][eta 00m:28s]
  892. Jobs: 1 (f=1): [w(1)][60.6%][w=313MiB/s][w=80.0k IOPS][eta 00m:26s]
  893. Jobs: 1 (f=1): [w(1)][63.6%][w=312MiB/s][w=80.0k IOPS][eta 00m:24s]
  894. Jobs: 1 (f=1): [w(1)][66.7%][w=311MiB/s][w=79.7k IOPS][eta 00m:22s]
  895. Jobs: 1 (f=1): [w(1)][69.7%][w=311MiB/s][w=79.7k IOPS][eta 00m:20s]
  896. Jobs: 1 (f=1): [w(1)][72.7%][w=311MiB/s][w=79.7k IOPS][eta 00m:18s]
  897. Jobs: 1 (f=1): [w(1)][75.8%][w=312MiB/s][w=79.8k IOPS][eta 00m:16s]
  898. Jobs: 1 (f=1): [w(1)][78.8%][w=311MiB/s][w=79.7k IOPS][eta 00m:14s]
  899. Jobs: 1 (f=1): [w(1)][81.8%][w=310MiB/s][w=79.5k IOPS][eta 00m:12s]
  900. Jobs: 1 (f=1): [w(1)][84.8%][w=313MiB/s][w=80.1k IOPS][eta 00m:10s]
  901. Jobs: 1 (f=1): [w(1)][87.9%][w=311MiB/s][w=79.6k IOPS][eta 00m:08s]
  902. Jobs: 1 (f=1): [w(1)][90.9%][w=311MiB/s][w=79.7k IOPS][eta 00m:06s]
  903. Jobs: 1 (f=1): [w(1)][93.9%][w=311MiB/s][w=79.7k IOPS][eta 00m:04s]
  904. Jobs: 1 (f=1): [w(1)][97.0%][w=311MiB/s][w=79.7k IOPS][eta 00m:02s]
  905. Jobs: 1 (f=1): [w(1)][100.0%][w=310MiB/s][w=79.5k IOPS][eta 00m:00s]
  906. SEQ1M: (groupid=0, jobs=1): err= 0: pid=4337: Mon Jan 1 17:58:06 2024
  907. write: IOPS=79.8k, BW=312MiB/s (327MB/s)(18.3GiB/60001msec); 0 zone resets
  908. slat (nsec): min=2364, max=28482, avg=2491.92, stdev=166.62
  909. clat (nsec): min=391, max=5963.1k, avg=9775.89, stdev=4316.74
  910. lat (usec): min=10, max=5966, avg=12.32, stdev= 4.32
  911. clat percentiles (nsec):
  912. | 1.00th=[ 9536], 5.00th=[ 9536], 10.00th=[ 9536], 20.00th=[ 9536],
  913. | 30.00th=[ 9536], 40.00th=[ 9664], 50.00th=[ 9664], 60.00th=[ 9664],
  914. | 70.00th=[ 9792], 80.00th=[ 9792], 90.00th=[ 9792], 95.00th=[ 9920],
  915. | 99.00th=[10944], 99.50th=[13504], 99.90th=[27264], 99.95th=[27264],
  916. | 99.99th=[31360]
  917. bw ( KiB/s): min=316888, max=322776, per=100.00%, avg=319442.83, stdev=1044.64, samples=120
  918. iops : min=79222, max=80694, avg=79860.62, stdev=261.17, samples=120
  919. lat (nsec) : 500=0.01%, 750=0.01%
  920. lat (usec) : 10=97.86%, 20=1.72%, 50=0.41%, 100=0.01%, 250=0.01%
  921. lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01%
  922. lat (msec) : 2=0.01%, 10=0.01%
  923. cpu : usr=6.21%, sys=27.21%, ctx=4789965, majf=0, minf=58
  924. IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
  925. submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  926. complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
  927. issued rwts: total=0,4789893,0,0 short=0,0,0,0 dropped=0,0,0,0
  928. latency : target=0, window=0, percentile=100.00%, depth=1
  929.  
  930. Run status group 0 (all jobs):
  931. WRITE: bw=312MiB/s (327MB/s), 312MiB/s-312MiB/s (327MB/s-327MB/s), io=18.3GiB (19.6GB), run=60001-60001msec
  932.  
  933. Disk stats (read/write):
  934. nvme0n1: ios=0/4869355, merge=0/12, ticks=0/35301, in_queue=35321, util=99.87%
  935.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!