ceph write

# rados bench -p bench 60 write -t 10 --no-cleanup
 Maintaining 10 concurrent writes of 4194304 bytes for up to 60 seconds or 0 objects
 Object prefix: benchmark_data_waas_23595
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
     0       0         0         0         0         0         -         0
     1      10       258       248   991.769       992 0.0526486 0.0394335
     2      10       515       505   1009.82      1028 0.0307377 0.0392734
     3      10       773       763   1017.18      1032 0.0301991 0.0382929
     4      10      1035      1025   1024.85      1048 0.0346227 0.0388963
     5      10      1262      1252   1001.46       908 0.0271423 0.0388302
     6      10      1533      1523   1015.19      1084 0.0316136 0.0392355
     7      10      1757      1747   998.144       896 0.0339673    0.0399
     8      10      1948      1938   968.862       764 0.0295541 0.0404821
     9      10      2066      2056   913.648       472 0.0590027 0.0431005
    10      10      2308      2298   919.072       968 0.0314918 0.0434177
    11      10      2470      2460   894.418       648 0.0309268 0.0437702
    12      10      2667      2657   885.542       788 0.0310218 0.0451078
    13      10      2866      2856   878.646       796 0.0314066 0.0451925
    14      10      3086      3076   878.736       880 0.0353909 0.0454394
    15      10      3330      3320   885.213       976 0.0358161 0.0451223
    16      10      3552      3542    885.38       888 0.0334657 0.0450823
    17      10      3692      3682   866.235       560 0.0285584 0.0447821
    18      10      3815      3805    845.43       492 0.0352983 0.0468325
    19      10      3882      3872   815.036       268 0.0293144 0.0473254
2016-06-06 12:43:45.500069min lat: 0.0245182 max lat: 2.04452 avg lat: 0.0498048
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
    20      10      4010      4000   799.882       512   0.03152 0.0498048
    21      10      4129      4119   784.456       476 0.0295575 0.0502996
    22      10      4330      4320    785.34       804 0.0366071 0.0507546
    23       9      4544      4535   788.582       860 0.0428247 0.0505435
    24      10      4770      4760    793.22       900 0.0339418 0.0503494
    25      10      5037      5027   804.207      1068 0.0373111 0.0497056
    26      10      5320      5310   816.809      1132 0.0371079 0.0489402
    27      10      5577      5567   824.625      1028 0.0312157 0.0483705
    28      10      5804      5794   827.599       908 0.0312807 0.0483013
    29      10      5995      5985   825.402       764 0.0290381 0.0483164
    30      10      6207      6197   826.153       848 0.0330036 0.0483868
    31      10      6446      6436   830.337       956 0.0305659 0.0480972
    32      10      6658      6648   830.885       848 0.0283897 0.0481062
    33      10      6814      6804   824.613       624 0.0292446 0.0483719
    34      10      6972      6962   818.946       632 0.0330052 0.0485177
    35      10      7216      7206   823.429       976 0.0323613 0.0484703
    36      10      7425      7415   823.774       836 0.0348405   0.04844
    37      10      7696      7686   830.804      1084 0.0307202 0.0481184
    38      10      7911      7901    831.57       860  0.028346 0.0478624
    39      10      8147      8137   834.449       944  0.168811 0.0478853
2016-06-06 12:44:05.502647min lat: 0.0244224 max lat: 2.04452 avg lat: 0.0479826
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
    40      10      8328      8318   831.685       724 0.0298348 0.0479826
    41      10      8522      8512   830.323       776  0.235783 0.0481304
    42      10      8769      8759   834.075       988 0.0323972 0.0479292
    43      10      8994      8984   835.606       900  0.037034 0.0478486
    44      10      9231      9221   838.157       948 0.0348446 0.0476443
    45      10      9422      9412   836.507       764  0.232985 0.0477111
    46      10      9657      9647   838.754       940  0.028361 0.0476641
    47      10      9782      9772   831.542       500  0.235351  0.047551
    48      10      9879      9869   822.301       388 0.0388461 0.0485661
    49      10     10097     10087   823.313       872 0.0297445 0.0484193
    50      10     10369     10359   828.604      1088 0.0491413 0.0482516
    51      10     10657     10647   834.942      1152 0.0302095  0.047893
    52      10     10881     10871   836.114       896 0.0324437 0.0476974
    53      10     11162     11152   841.543      1124 0.0298526  0.047506
    54      10     11390     11380   842.846       912 0.0347393 0.0474324
    55      10     11648     11638   846.283      1032 0.0338494 0.0472325
    56      10     11909     11899   849.811      1044   0.03199 0.0470239
    57      10     12151     12141   851.882       968 0.0302047  0.046839
    58      10     12380     12370   852.985       916  0.242595 0.0468636
    59      10     12614     12604    854.39       936 0.0359764 0.0467499
2016-06-06 12:44:25.505429min lat: 0.0244224 max lat: 2.04452 avg lat: 0.046841
   sec Cur ops   started  finished  avg MB/s  cur MB/s  last lat   avg lat
    60      10     12804     12794   852.815       760 0.0332168  0.046841
 Total time run:         60.485929
Total writes made:      12804
Write size:             4194304
Bandwidth (MB/sec):     846.742

Stddev Bandwidth:       224.953
Max bandwidth (MB/sec): 1152
Min bandwidth (MB/sec): 0
Average Latency:        0.046958
Stddev Latency:         0.0792478
Max latency:            2.04452
Min latency:            0.0244224