test io

[root@localhost ~]# ./test
4M randwrite iodepth=32 20min
test1: (g=0): rw=randwrite, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=32
fio-2.2.8
Starting 1 process
Jobs: 1 (f=1): [w(1)] [0.0% done] [0KB/28643KB/0KB /s] [0/6/0 iops] [eta 2084d:10h:24m:15s]
test1: (groupid=0, jobs=1): err= 0: pid=15826: Sat Oct  1 02:28:14 2016
  write: io=92976MB, bw=79270KB/s, iops=19, runt=1201054msec
    slat (usec): min=326, max=4226.2K, avg=50988.83, stdev=103486.80
    clat (msec): min=5, max=15014, avg=1602.22, stdev=1266.40
     lat (msec): min=6, max=15015, avg=1653.21, stdev=1303.29
    clat percentiles (msec):
     |  1.00th=[    7],  5.00th=[   21], 10.00th=[   50], 20.00th=[  469],
     | 30.00th=[  881], 40.00th=[ 1254], 50.00th=[ 1532], 60.00th=[ 1795],
     | 70.00th=[ 2089], 80.00th=[ 2376], 90.00th=[ 2900], 95.00th=[ 3589],
     | 99.00th=[ 6194], 99.50th=[ 7570], 99.90th=[10028], 99.95th=[11338],
     | 99.99th=[13566]
    bw (KB  /s): min= 1938, max=443783, per=100.00%, avg=80480.79, stdev=44528.46
    lat (msec) : 10=1.23%, 20=3.49%, 50=5.30%, 100=0.96%, 250=3.22%
    lat (msec) : 500=6.53%, 750=6.35%, 1000=5.70%, 2000=34.46%, >=2000=32.77%
  cpu          : usr=0.81%, sys=0.56%, ctx=53371, majf=0, minf=10
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=99.9%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=23244/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
  WRITE: io=92976MB, aggrb=79269KB/s, minb=79269KB/s, maxb=79269KB/s, mint=1201054msec, maxt=1201054msec

Disk stats (read/write):
    bcache0: ios=60/92976, merge=0/0, ticks=20/60354499, in_queue=60364941, util=100.00%, aggrios=1238/208418, aggrmerge=3/5602, aggrticks=38768/102251338, aggrin_queue=102465121, aggrutil=100.00%
  sdd: ios=2476/231109, merge=6/11204, ticks=77537/16421203, in_queue=16498188, util=19.90%
  sda: ios=0/185728, merge=0/0, ticks=0/188081474, in_queue=188432054, util=100.00%
4M randread iodepth=32 20min
test2: (g=0): rw=randread, bs=4M-4M/4M-4M/4M-4M, ioengine=libaio, iodepth=32
fio-2.2.8
Starting 1 process
Jobs: 1 (f=1): [r(1)] [0.0% done] [139.9MB/0KB/0KB /s] [34/0/0 iops] [eta 694d:00h:21m:00s]
test2: (groupid=0, jobs=1): err= 0: pid=15966: Sat Oct  1 02:48:15 2016
  read : io=278996MB, bw=238014KB/s, iops=58, runt=1200315msec
    slat (usec): min=190, max=1447.2K, avg=17016.12, stdev=22214.46
    clat (msec): min=2, max=2778, avg=533.63, stdev=261.42
     lat (msec): min=2, max=2779, avg=550.65, stdev=265.86
    clat percentiles (msec):
     |  1.00th=[    9],  5.00th=[  101], 10.00th=[  198], 20.00th=[  347],
     | 30.00th=[  449], 40.00th=[  494], 50.00th=[  529], 60.00th=[  562],
     | 70.00th=[  611], 80.00th=[  693], 90.00th=[  840], 95.00th=[  979],
     | 99.00th=[ 1336], 99.50th=[ 1516], 99.90th=[ 1991], 99.95th=[ 2180],
     | 99.99th=[ 2573]
    bw (KB  /s): min=30835, max=1020046, per=100.00%, avg=238820.22, stdev=80312.22
    lat (msec) : 4=0.07%, 10=1.33%, 20=0.90%, 50=0.92%, 100=1.71%
    lat (msec) : 250=9.03%, 500=27.90%, 750=42.85%, 1000=10.71%, 2000=4.47%
    lat (msec) : >=2000=0.10%
  cpu          : usr=0.04%, sys=1.68%, ctx=33892, majf=0, minf=585
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=100.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.1%, 64=0.0%, >=64=0.0%
     issued    : total=r=69749/w=0/d=0, short=r=0/w=0/d=0, drop=r=0/w=0/d=0
     latency   : target=0, window=0, percentile=100.00%, depth=32

Run status group 0 (all jobs):
   READ: io=278996MB, aggrb=238014KB/s, minb=238014KB/s, maxb=238014KB/s, mint=1200315msec, maxt=1200315msec

Disk stats (read/write):
    bcache0: ios=278996/0, merge=0/0, ticks=65835714/0, in_queue=65837393, util=100.00%, aggrios=577176/44145, aggrmerge=5591/0, aggrticks=87222795/2798401, aggrin_queue=89963572, aggrutil=100.00%
  sdd: ios=226968/85882, merge=11182/0, ticks=3717864/2530746, in_queue=6248070, util=13.77%
  sda: ios=927384/2408, merge=0/0, ticks=170727727/3066057, in_queue=173679074, util=100.00%