xbolva00@xbolva00-G551JW:~/LLVM/llvm/test-suite-build$ ../test-suite/utils/compare.py --filter-short patch3.json baseline3.json
Tests: 1163
Short Running: 782 (filtered out)
Remaining: 381
Metric: exec_time

Program                                        patch3  baseline3 diff
 test-suite...ks/Shootout/Shootout-ary3.test     0.82    0.97    19.0%
 test-suite...Rodinia/backprop/backprop.test     0.74    0.87    17.7%
 test-suite...out-C++/Shootout-C++-ary3.test     0.97    0.83    -14.4%
 test-suite...an/halide_local_laplacian.test    17.95   16.03    -10.7%
 test-suite...test:BM_MULADDSUB_LAMBDA/44217   102.90  113.37    10.2%
 test-suite...CHMARK_ANISTROPIC_DIFFUSION/64   2200.25 2411.80    9.6%
 test-suite...HMARK_ANISTROPIC_DIFFUSION/128   9441.66 10345.73   9.6%
 test-suite...r-algebra/kernels/2mm/2mm.test    32.60   29.49    -9.6%
 test-suite...rid/halide_bilateral_grid.test    28.88   26.22    -9.2%
 test-suite...bl/IndirectAddressing-dbl.test     2.34    2.55     9.2%
 test-suite...CRaw.test:BM_HYDRO_1D_RAW/5001     2.47    2.70     9.1%
 test-suite...lcalsARaw.test:BM_COUPLE_RAW/0   1577.07 1433.56   -9.1%
 test-suite...lFlow-flt/ControlFlow-flt.test     2.03    2.22     9.1%
 test-suite...CHMARK_ANISTROPIC_DIFFUSION/32   488.04  531.77     9.0%
 test-suite...mbolics-dbl/Symbolics-dbl.test     1.95    2.13     8.9%
 Geomean difference                                               nan%
              patch3      baseline3        diff
count  380.000000     381.000000     380.000000
mean   2516.187156    2530.804912    0.009398
std    23951.832243   24069.969294   0.031390
min    0.610700       0.602500      -0.144130
25%    1.802824       1.770900       0.007054
50%    5.405466       5.421500       0.012999
75%    111.546006     112.569785     0.016343
max    326571.727000  328327.695500  0.190186
xbolva00@xbolva00-G551JW:~/LLVM/llvm/test-suite-build$ ../test-suite/utils/compare.py --filter-short patch3.json baseline3.json
Tests: 1163
Short Running: 782 (filtered out)
Remaining: 381
Metric: exec_time

Program                                        patch3 baseline3 diff
 test-suite...Rodinia/backprop/backprop.test     0.71   0.87    22.2%
 test-suite...ks/Shootout/Shootout-ary3.test     0.82   0.97    18.3%
 test-suite....test:BM_INT_PREDICT_RAW/44217   596.03 501.10    -15.9%
 test-suite...test:BM_MULADDSUB_LAMBDA/44217   103.02 113.37    10.0%
 test-suite...XRayFDRMultiThreaded/threads:4   146.41 161.01    10.0%
 test-suite...da.test:BM_HYDRO_2D_LAMBDA/171    14.14  12.73    -9.9%
 test-suite...XRayFDRMultiThreaded/threads:1    80.97  88.52     9.3%
 test-suite...bda.test:BM_INIT3_LAMBDA/44217   100.64 109.98     9.3%
 test-suite...lFlow-flt/ControlFlow-flt.test     2.04   2.22     8.9%
 test-suite.../Benchmarks/Ptrdist/ft/ft.test     0.60   0.65     8.8%
 test-suite...Raw.test:BM_HYDRO_1D_RAW/44217    28.98  31.49     8.7%
 test-suite...alsCRaw.test:BM_ICCG_RAW/44217    54.47  50.29    -7.7%
 test-suite...e/Benchmarks/Misc/salsa20.test     4.01   4.30     7.4%
 test-suite....test:BM_HYDRO_1D_LAMBDA/44217    31.49  29.22    -7.2%
 test-suite...CRaw.test:BM_HYDRO_1D_RAW/5001     2.52   2.70     7.1%
 Geomean difference                                              nan%
              patch3      baseline3        diff
count  380.000000     381.000000     380.000000
mean   2508.445743    2530.804912    0.014998
std    23841.767251   24069.969294   0.027288
min    0.601200       0.602500      -0.159266
25%    1.804213       1.770900       0.009639
50%    5.342950       5.421500       0.013109
75%    111.742092     112.569785     0.016544
max    324551.493500  328327.695500  0.221678
xbolva00@xbolva00-G551JW:~/LLVM/llvm/test-suite-build$ ../test-suite/utils/compare.py --filter-short patch3.json baseline3.json
Tests: 1163
Short Running: 782 (filtered out)
Remaining: 381
Metric: exec_time

Program                                        patch3  baseline3 diff
 test-suite...nchmarks/llubenchmark/llu.test     7.14    5.79    -18.8%
 test-suite...r-algebra/kernels/2mm/2mm.test    35.79   29.49    -17.6%
 test-suite...CHMARK_ANISTROPIC_DIFFUSION/64   2127.52 2411.80   13.4%
 test-suite...mbolics-dbl/Symbolics-dbl.test     1.88    2.13    13.3%
 test-suite...HMARK_ANISTROPIC_DIFFUSION/128   9220.77 10345.73  12.2%
 test-suite...CHMARK_ANISTROPIC_DIFFUSION/32   475.54  531.77    11.8%
 test-suite...chmarks/Misc/himenobmtxpa.test     0.73    0.66    -9.8%
 test-suite...mbda.test:BM_INIT3_LAMBDA/5001     9.90   10.85     9.6%
 test-suite...Rodinia/backprop/backprop.test     0.80    0.87     9.4%
 test-suite...CRaw.test:BM_HYDRO_1D_RAW/5001     2.46    2.70     9.4%
 test-suite...Raw.test:BM_HYDRO_1D_RAW/44217    28.80   31.49     9.4%
 test-suite...bl/IndirectAddressing-dbl.test     2.33    2.55     9.3%
 test-suite...alsBRaw.test:BM_INIT3_RAW/5001     9.71   10.60     9.2%
 test-suite...bda.test:BM_INIT3_LAMBDA/44217   100.83  109.98     9.1%
 test-suite...oxyApps-C/miniGMG/miniGMG.test     0.61    0.66     8.4%
 Geomean difference                                               nan%
              patch3      baseline3        diff
count  379.000000     381.000000     379.000000
mean   2470.732116    2530.804912    0.014680
std    23361.008932   24069.969294   0.029148
min    0.609900       0.602500      -0.188195
25%    1.809250       1.770900       0.010521
50%    5.350900       5.421500       0.013169
75%    110.744082     112.569785     0.016689
max    317807.413000  328327.695500  0.133618