Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- benchmarks@lamppc8:~/experiments/compiler-benchmark$ for args_file in /home/benchmarks/experiments/circe/modules/tests/js/target/test.args /home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args /home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args /home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args; do \
- > for v in 2.12.5-bin-dbd90495c2-SNAPSHOT 2.12.5-bin-f18e3c59fd-SNAPSHOT 2.12.5-bin-0417fcf133-SNAPSHOT; do \
- > /usr/bin/sbt "set scalaVersion in compilation := \"$v\"" "hot -f1 -wi 10 -i 8 -p source=@$args_file" || break; \
- > done
- > done
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/js/target/test.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 85630.910 ms/op
- [info] # Warmup Iteration 2: 55834.575 ms/op
- [info] # Warmup Iteration 3: 44023.415 ms/op
- [info] # Warmup Iteration 4: 39929.774 ms/op
- [info] # Warmup Iteration 5: 35903.242 ms/op
- [info] # Warmup Iteration 6: 37111.202 ms/op
- [info] # Warmup Iteration 7: 34762.392 ms/op
- [info] # Warmup Iteration 8: 34057.748 ms/op
- [info] # Warmup Iteration 9: 33822.867 ms/op
- [info] # Warmup Iteration 10: 33453.769 ms/op
- [info] Iteration 1: 31977.374 ms/op
- [info] compile·p0.00: 31977.374 ms/op
- [info] compile·p0.50: 31977.374 ms/op
- [info] compile·p0.90: 31977.374 ms/op
- [info] compile·p0.95: 31977.374 ms/op
- [info] compile·p0.99: 31977.374 ms/op
- [info] compile·p0.999: 31977.374 ms/op
- [info] compile·p0.9999: 31977.374 ms/op
- [info] compile·p1.00: 31977.374 ms/op
- [info]
- [info] Iteration 2: 33957.085 ms/op
- [info] compile·p0.00: 33957.085 ms/op
- [info] compile·p0.50: 33957.085 ms/op
- [info] compile·p0.90: 33957.085 ms/op
- [info] compile·p0.95: 33957.085 ms/op
- [info] compile·p0.99: 33957.085 ms/op
- [info] compile·p0.999: 33957.085 ms/op
- [info] compile·p0.9999: 33957.085 ms/op
- [info] compile·p1.00: 33957.085 ms/op
- [info]
- [info] Iteration 3: 32044.483 ms/op
- [info] compile·p0.00: 32044.483 ms/op
- [info] compile·p0.50: 32044.483 ms/op
- [info] compile·p0.90: 32044.483 ms/op
- [info] compile·p0.95: 32044.483 ms/op
- [info] compile·p0.99: 32044.483 ms/op
- [info] compile·p0.999: 32044.483 ms/op
- [info] compile·p0.9999: 32044.483 ms/op
- [info] compile·p1.00: 32044.483 ms/op
- [info]
- [info] Iteration 4: 31608.275 ms/op
- [info] compile·p0.00: 31608.275 ms/op
- [info] compile·p0.50: 31608.275 ms/op
- [info] compile·p0.90: 31608.275 ms/op
- [info] compile·p0.95: 31608.275 ms/op
- [info] compile·p0.99: 31608.275 ms/op
- [info] compile·p0.999: 31608.275 ms/op
- [info] compile·p0.9999: 31608.275 ms/op
- [info] compile·p1.00: 31608.275 ms/op
- [info]
- [info] Iteration 5: 32312.918 ms/op
- [info] compile·p0.00: 32312.918 ms/op
- [info] compile·p0.50: 32312.918 ms/op
- [info] compile·p0.90: 32312.918 ms/op
- [info] compile·p0.95: 32312.918 ms/op
- [info] compile·p0.99: 32312.918 ms/op
- [info] compile·p0.999: 32312.918 ms/op
- [info] compile·p0.9999: 32312.918 ms/op
- [info] compile·p1.00: 32312.918 ms/op
- [info]
- [info] Iteration 6: 31138.513 ms/op
- [info] compile·p0.00: 31138.513 ms/op
- [info] compile·p0.50: 31138.513 ms/op
- [info] compile·p0.90: 31138.513 ms/op
- [info] compile·p0.95: 31138.513 ms/op
- [info] compile·p0.99: 31138.513 ms/op
- [info] compile·p0.999: 31138.513 ms/op
- [info] compile·p0.9999: 31138.513 ms/op
- [info] compile·p1.00: 31138.513 ms/op
- [info]
- [info] Iteration 7: 30970.741 ms/op
- [info] compile·p0.00: 30970.741 ms/op
- [info] compile·p0.50: 30970.741 ms/op
- [info] compile·p0.90: 30970.741 ms/op
- [info] compile·p0.95: 30970.741 ms/op
- [info] compile·p0.99: 30970.741 ms/op
- [info] compile·p0.999: 30970.741 ms/op
- [info] compile·p0.9999: 30970.741 ms/op
- [info] compile·p1.00: 30970.741 ms/op
- [info]
- [info] Iteration 8: 31876.710 ms/op
- [info] compile·p0.00: 31876.710 ms/op
- [info] compile·p0.50: 31876.710 ms/op
- [info] compile·p0.90: 31876.710 ms/op
- [info] compile·p0.95: 31876.710 ms/op
- [info] compile·p0.99: 31876.710 ms/op
- [info] compile·p0.999: 31876.710 ms/op
- [info] compile·p0.9999: 31876.710 ms/op
- [info] compile·p1.00: 31876.710 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 31985.762 ±(99.9%) 1755.206 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [30000.000, 30250.000) = 0
- [info] [30250.000, 30500.000) = 0
- [info] [30500.000, 30750.000) = 0
- [info] [30750.000, 31000.000) = 1
- [info] [31000.000, 31250.000) = 1
- [info] [31250.000, 31500.000) = 0
- [info] [31500.000, 31750.000) = 1
- [info] [31750.000, 32000.000) = 2
- [info] [32000.000, 32250.000) = 1
- [info] [32250.000, 32500.000) = 1
- [info] [32500.000, 32750.000) = 0
- [info] [32750.000, 33000.000) = 0
- [info] [33000.000, 33250.000) = 0
- [info] [33250.000, 33500.000) = 0
- [info] [33500.000, 33750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 30970.741 ms/op
- [info] p(50.0000) = 31927.042 ms/op
- [info] p(90.0000) = 33957.085 ms/op
- [info] p(95.0000) = 33957.085 ms/op
- [info] p(99.0000) = 33957.085 ms/op
- [info] p(99.9000) = 33957.085 ms/op
- [info] p(99.9900) = 33957.085 ms/op
- [info] p(99.9990) = 33957.085 ms/op
- [info] p(99.9999) = 33957.085 ms/op
- [info] p(100.0000) = 33957.085 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:11:32
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 8 31985.762 ± 1755.206 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 30970.741 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 31927.042 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 33957.085 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 33957.085 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 33957.085 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 33957.085 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 33957.085 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 33957.085 ms/op
- [success] Total time: 695 s, completed Feb 5, 2018 12:47:11 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] 'compiler-interface' not yet compiled for Scala 2.12.5-bin-f18e3c59fd-SNAPSHOT. Compiling...
- [info] Compilation completed in 16.241 s
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/js/target/test.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 86301.999 ms/op
- [info] # Warmup Iteration 2: 51673.825 ms/op
- [info] # Warmup Iteration 3: 38587.597 ms/op
- [info] # Warmup Iteration 4: 32614.908 ms/op
- [info] # Warmup Iteration 5: 29225.910 ms/op
- [info] # Warmup Iteration 6: 28085.060 ms/op
- [info] # Warmup Iteration 7: 28387.049 ms/op
- [info] # Warmup Iteration 8: 25669.140 ms/op
- [info] # Warmup Iteration 9: 25266.487 ms/op
- [info] # Warmup Iteration 10: 24930.943 ms/op
- [info] Iteration 1: 24024.973 ms/op
- [info] compile·p0.00: 24024.973 ms/op
- [info] compile·p0.50: 24024.973 ms/op
- [info] compile·p0.90: 24024.973 ms/op
- [info] compile·p0.95: 24024.973 ms/op
- [info] compile·p0.99: 24024.973 ms/op
- [info] compile·p0.999: 24024.973 ms/op
- [info] compile·p0.9999: 24024.973 ms/op
- [info] compile·p1.00: 24024.973 ms/op
- [info]
- [info] Iteration 2: 24058.528 ms/op
- [info] compile·p0.00: 24058.528 ms/op
- [info] compile·p0.50: 24058.528 ms/op
- [info] compile·p0.90: 24058.528 ms/op
- [info] compile·p0.95: 24058.528 ms/op
- [info] compile·p0.99: 24058.528 ms/op
- [info] compile·p0.999: 24058.528 ms/op
- [info] compile·p0.9999: 24058.528 ms/op
- [info] compile·p1.00: 24058.528 ms/op
- [info]
- [info] Iteration 3: 23991.419 ms/op
- [info] compile·p0.00: 23991.419 ms/op
- [info] compile·p0.50: 23991.419 ms/op
- [info] compile·p0.90: 23991.419 ms/op
- [info] compile·p0.95: 23991.419 ms/op
- [info] compile·p0.99: 23991.419 ms/op
- [info] compile·p0.999: 23991.419 ms/op
- [info] compile·p0.9999: 23991.419 ms/op
- [info] compile·p1.00: 23991.419 ms/op
- [info]
- [info] Iteration 4: 24427.626 ms/op
- [info] compile·p0.00: 24427.626 ms/op
- [info] compile·p0.50: 24427.626 ms/op
- [info] compile·p0.90: 24427.626 ms/op
- [info] compile·p0.95: 24427.626 ms/op
- [info] compile·p0.99: 24427.626 ms/op
- [info] compile·p0.999: 24427.626 ms/op
- [info] compile·p0.9999: 24427.626 ms/op
- [info] compile·p1.00: 24427.626 ms/op
- [info]
- [info] Iteration 5: 23756.538 ms/op
- [info] compile·p0.00: 23756.538 ms/op
- [info] compile·p0.50: 23756.538 ms/op
- [info] compile·p0.90: 23756.538 ms/op
- [info] compile·p0.95: 23756.538 ms/op
- [info] compile·p0.99: 23756.538 ms/op
- [info] compile·p0.999: 23756.538 ms/op
- [info] compile·p0.9999: 23756.538 ms/op
- [info] compile·p1.00: 23756.538 ms/op
- [info]
- [info] Iteration 6: 23051.895 ms/op
- [info] compile·p0.00: 23051.895 ms/op
- [info] compile·p0.50: 23051.895 ms/op
- [info] compile·p0.90: 23051.895 ms/op
- [info] compile·p0.95: 23051.895 ms/op
- [info] compile·p0.99: 23051.895 ms/op
- [info] compile·p0.999: 23051.895 ms/op
- [info] compile·p0.9999: 23051.895 ms/op
- [info] compile·p1.00: 23051.895 ms/op
- [info]
- [info] Iteration 7: 23286.776 ms/op
- [info] compile·p0.00: 23286.776 ms/op
- [info] compile·p0.50: 23286.776 ms/op
- [info] compile·p0.90: 23286.776 ms/op
- [info] compile·p0.95: 23286.776 ms/op
- [info] compile·p0.99: 23286.776 ms/op
- [info] compile·p0.999: 23286.776 ms/op
- [info] compile·p0.9999: 23286.776 ms/op
- [info] compile·p1.00: 23286.776 ms/op
- [info]
- [info] Iteration 8: 22716.350 ms/op
- [info] compile·p0.00: 22716.350 ms/op
- [info] compile·p0.50: 22716.350 ms/op
- [info] compile·p0.90: 22716.350 ms/op
- [info] compile·p0.95: 22716.350 ms/op
- [info] compile·p0.99: 22716.350 ms/op
- [info] compile·p0.999: 22716.350 ms/op
- [info] compile·p0.9999: 22716.350 ms/op
- [info] compile·p1.00: 22716.350 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 23664.263 ±(99.9%) 1119.504 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [22000.000, 22250.000) = 0
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 1
- [info] [22750.000, 23000.000) = 0
- [info] [23000.000, 23250.000) = 1
- [info] [23250.000, 23500.000) = 1
- [info] [23500.000, 23750.000) = 0
- [info] [23750.000, 24000.000) = 2
- [info] [24000.000, 24250.000) = 2
- [info] [24250.000, 24500.000) = 1
- [info] [24500.000, 24750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 22716.350 ms/op
- [info] p(50.0000) = 23873.978 ms/op
- [info] p(90.0000) = 24427.626 ms/op
- [info] p(95.0000) = 24427.626 ms/op
- [info] p(99.0000) = 24427.626 ms/op
- [info] p(99.9000) = 24427.626 ms/op
- [info] p(99.9900) = 24427.626 ms/op
- [info] p(99.9990) = 24427.626 ms/op
- [info] p(99.9999) = 24427.626 ms/op
- [info] p(100.0000) = 24427.626 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:09:21
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 8 23664.263 ± 1119.504 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 22716.350 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 23873.978 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24427.626 ms/op
- [success] Total time: 590 s, completed Feb 5, 2018 12:57:13 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] 'compiler-interface' not yet compiled for Scala 2.12.5-bin-0417fcf133-SNAPSHOT. Compiling...
- [info] Compilation completed in 16.242 s
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/js/target/test.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 88852.136 ms/op
- [info] # Warmup Iteration 2: 51271.172 ms/op
- [info] # Warmup Iteration 3: 38319.161 ms/op
- [info] # Warmup Iteration 4: 33655.095 ms/op
- [info] # Warmup Iteration 5: 30366.761 ms/op
- [info] # Warmup Iteration 6: 27145.535 ms/op
- [info] # Warmup Iteration 7: 28756.148 ms/op
- [info] # Warmup Iteration 8: 26407.338 ms/op
- [info] # Warmup Iteration 9: 25769.804 ms/op
- [info] # Warmup Iteration 10: 24998.052 ms/op
- [info] Iteration 1: 23924.310 ms/op
- [info] compile·p0.00: 23924.310 ms/op
- [info] compile·p0.50: 23924.310 ms/op
- [info] compile·p0.90: 23924.310 ms/op
- [info] compile·p0.95: 23924.310 ms/op
- [info] compile·p0.99: 23924.310 ms/op
- [info] compile·p0.999: 23924.310 ms/op
- [info] compile·p0.9999: 23924.310 ms/op
- [info] compile·p1.00: 23924.310 ms/op
- [info]
- [info] Iteration 2: 24763.171 ms/op
- [info] compile·p0.00: 24763.171 ms/op
- [info] compile·p0.50: 24763.171 ms/op
- [info] compile·p0.90: 24763.171 ms/op
- [info] compile·p0.95: 24763.171 ms/op
- [info] compile·p0.99: 24763.171 ms/op
- [info] compile·p0.999: 24763.171 ms/op
- [info] compile·p0.9999: 24763.171 ms/op
- [info] compile·p1.00: 24763.171 ms/op
- [info]
- [info] Iteration 3: 24192.745 ms/op
- [info] compile·p0.00: 24192.745 ms/op
- [info] compile·p0.50: 24192.745 ms/op
- [info] compile·p0.90: 24192.745 ms/op
- [info] compile·p0.95: 24192.745 ms/op
- [info] compile·p0.99: 24192.745 ms/op
- [info] compile·p0.999: 24192.745 ms/op
- [info] compile·p0.9999: 24192.745 ms/op
- [info] compile·p1.00: 24192.745 ms/op
- [info]
- [info] Iteration 4: 23655.875 ms/op
- [info] compile·p0.00: 23655.875 ms/op
- [info] compile·p0.50: 23655.875 ms/op
- [info] compile·p0.90: 23655.875 ms/op
- [info] compile·p0.95: 23655.875 ms/op
- [info] compile·p0.99: 23655.875 ms/op
- [info] compile·p0.999: 23655.875 ms/op
- [info] compile·p0.9999: 23655.875 ms/op
- [info] compile·p1.00: 23655.875 ms/op
- [info]
- [info] Iteration 5: 24092.082 ms/op
- [info] compile·p0.00: 24092.082 ms/op
- [info] compile·p0.50: 24092.082 ms/op
- [info] compile·p0.90: 24092.082 ms/op
- [info] compile·p0.95: 24092.082 ms/op
- [info] compile·p0.99: 24092.082 ms/op
- [info] compile·p0.999: 24092.082 ms/op
- [info] compile·p0.9999: 24092.082 ms/op
- [info] compile·p1.00: 24092.082 ms/op
- [info]
- [info] Iteration 6: 22951.231 ms/op
- [info] compile·p0.00: 22951.231 ms/op
- [info] compile·p0.50: 22951.231 ms/op
- [info] compile·p0.90: 22951.231 ms/op
- [info] compile·p0.95: 22951.231 ms/op
- [info] compile·p0.99: 22951.231 ms/op
- [info] compile·p0.999: 22951.231 ms/op
- [info] compile·p0.9999: 22951.231 ms/op
- [info] compile·p1.00: 22951.231 ms/op
- [info]
- [info] Iteration 7: 23152.558 ms/op
- [info] compile·p0.00: 23152.558 ms/op
- [info] compile·p0.50: 23152.558 ms/op
- [info] compile·p0.90: 23152.558 ms/op
- [info] compile·p0.95: 23152.558 ms/op
- [info] compile·p0.99: 23152.558 ms/op
- [info] compile·p0.999: 23152.558 ms/op
- [info] compile·p0.9999: 23152.558 ms/op
- [info] compile·p1.00: 23152.558 ms/op
- [info]
- [info] Iteration 8: 23420.994 ms/op
- [info] compile·p0.00: 23420.994 ms/op
- [info] compile·p0.50: 23420.994 ms/op
- [info] compile·p0.90: 23420.994 ms/op
- [info] compile·p0.95: 23420.994 ms/op
- [info] compile·p0.99: 23420.994 ms/op
- [info] compile·p0.999: 23420.994 ms/op
- [info] compile·p0.9999: 23420.994 ms/op
- [info] compile·p1.00: 23420.994 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 23769.121 ±(99.9%) 1137.835 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [22000.000, 22250.000) = 0
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 0
- [info] [22750.000, 23000.000) = 1
- [info] [23000.000, 23250.000) = 1
- [info] [23250.000, 23500.000) = 1
- [info] [23500.000, 23750.000) = 1
- [info] [23750.000, 24000.000) = 1
- [info] [24000.000, 24250.000) = 2
- [info] [24250.000, 24500.000) = 0
- [info] [24500.000, 24750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 22951.231 ms/op
- [info] p(50.0000) = 23790.092 ms/op
- [info] p(90.0000) = 24763.171 ms/op
- [info] p(95.0000) = 24763.171 ms/op
- [info] p(99.0000) = 24763.171 ms/op
- [info] p(99.9000) = 24763.171 ms/op
- [info] p(99.9900) = 24763.171 ms/op
- [info] p(99.9990) = 24763.171 ms/op
- [info] p(99.9999) = 24763.171 ms/op
- [info] p(100.0000) = 24763.171 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:09:27
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 8 23769.121 ± 1137.835 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 22951.231 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 23790.092 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24763.171 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24763.171 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24763.171 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24763.171 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24763.171 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test.args sample 24763.171 ms/op
- [success] Total time: 596 s, completed Feb 5, 2018 1:07:22 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 88315.265 ms/op
- [info] # Warmup Iteration 2: 55230.595 ms/op
- [info] # Warmup Iteration 3: 44694.503 ms/op
- [info] # Warmup Iteration 4: 39527.121 ms/op
- [info] # Warmup Iteration 5: 38117.835 ms/op
- [info] # Warmup Iteration 6: 37983.617 ms/op
- [info] # Warmup Iteration 7: 34292.630 ms/op
- [info] # Warmup Iteration 8: 34259.075 ms/op
- [info] # Warmup Iteration 9: 33353.105 ms/op
- [info] # Warmup Iteration 10: 32078.037 ms/op
- [info] Iteration 1: 32447.136 ms/op
- [info] compile·p0.00: 32447.136 ms/op
- [info] compile·p0.50: 32447.136 ms/op
- [info] compile·p0.90: 32447.136 ms/op
- [info] compile·p0.95: 32447.136 ms/op
- [info] compile·p0.99: 32447.136 ms/op
- [info] compile·p0.999: 32447.136 ms/op
- [info] compile·p0.9999: 32447.136 ms/op
- [info] compile·p1.00: 32447.136 ms/op
- [info]
- [info] Iteration 2: 33285.997 ms/op
- [info] compile·p0.00: 33285.997 ms/op
- [info] compile·p0.50: 33285.997 ms/op
- [info] compile·p0.90: 33285.997 ms/op
- [info] compile·p0.95: 33285.997 ms/op
- [info] compile·p0.99: 33285.997 ms/op
- [info] compile·p0.999: 33285.997 ms/op
- [info] compile·p0.9999: 33285.997 ms/op
- [info] compile·p1.00: 33285.997 ms/op
- [info]
- [info] Iteration 3: 32212.255 ms/op
- [info] compile·p0.00: 32212.255 ms/op
- [info] compile·p0.50: 32212.255 ms/op
- [info] compile·p0.90: 32212.255 ms/op
- [info] compile·p0.95: 32212.255 ms/op
- [info] compile·p0.99: 32212.255 ms/op
- [info] compile·p0.999: 32212.255 ms/op
- [info] compile·p0.9999: 32212.255 ms/op
- [info] compile·p1.00: 32212.255 ms/op
- [info]
- [info] Iteration 4: 32514.245 ms/op
- [info] compile·p0.00: 32514.245 ms/op
- [info] compile·p0.50: 32514.245 ms/op
- [info] compile·p0.90: 32514.245 ms/op
- [info] compile·p0.95: 32514.245 ms/op
- [info] compile·p0.99: 32514.245 ms/op
- [info] compile·p0.999: 32514.245 ms/op
- [info] compile·p0.9999: 32514.245 ms/op
- [info] compile·p1.00: 32514.245 ms/op
- [info]
- [info] Iteration 5: 31910.265 ms/op
- [info] compile·p0.00: 31910.265 ms/op
- [info] compile·p0.50: 31910.265 ms/op
- [info] compile·p0.90: 31910.265 ms/op
- [info] compile·p0.95: 31910.265 ms/op
- [info] compile·p0.99: 31910.265 ms/op
- [info] compile·p0.999: 31910.265 ms/op
- [info] compile·p0.9999: 31910.265 ms/op
- [info] compile·p1.00: 31910.265 ms/op
- [info]
- [info] Iteration 6: 32010.928 ms/op
- [info] compile·p0.00: 32010.928 ms/op
- [info] compile·p0.50: 32010.928 ms/op
- [info] compile·p0.90: 32010.928 ms/op
- [info] compile·p0.95: 32010.928 ms/op
- [info] compile·p0.99: 32010.928 ms/op
- [info] compile·p0.999: 32010.928 ms/op
- [info] compile·p0.9999: 32010.928 ms/op
- [info] compile·p1.00: 32010.928 ms/op
- [info]
- [info] Iteration 7: 33151.779 ms/op
- [info] compile·p0.00: 33151.779 ms/op
- [info] compile·p0.50: 33151.779 ms/op
- [info] compile·p0.90: 33151.779 ms/op
- [info] compile·p0.95: 33151.779 ms/op
- [info] compile·p0.99: 33151.779 ms/op
- [info] compile·p0.999: 33151.779 ms/op
- [info] compile·p0.9999: 33151.779 ms/op
- [info] compile·p1.00: 33151.779 ms/op
- [info]
- [info] Iteration 8: 31977.374 ms/op
- [info] compile·p0.00: 31977.374 ms/op
- [info] compile·p0.50: 31977.374 ms/op
- [info] compile·p0.90: 31977.374 ms/op
- [info] compile·p0.95: 31977.374 ms/op
- [info] compile·p0.99: 31977.374 ms/op
- [info] compile·p0.999: 31977.374 ms/op
- [info] compile·p0.9999: 31977.374 ms/op
- [info] compile·p1.00: 31977.374 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 32438.747 ±(99.9%) 1011.336 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [31000.000, 31250.000) = 0
- [info] [31250.000, 31500.000) = 0
- [info] [31500.000, 31750.000) = 0
- [info] [31750.000, 32000.000) = 2
- [info] [32000.000, 32250.000) = 2
- [info] [32250.000, 32500.000) = 1
- [info] [32500.000, 32750.000) = 1
- [info] [32750.000, 33000.000) = 0
- [info] [33000.000, 33250.000) = 1
- [info] [33250.000, 33500.000) = 1
- [info] [33500.000, 33750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 31910.265 ms/op
- [info] p(50.0000) = 32329.695 ms/op
- [info] p(90.0000) = 33285.997 ms/op
- [info] p(95.0000) = 33285.997 ms/op
- [info] p(99.0000) = 33285.997 ms/op
- [info] p(99.9000) = 33285.997 ms/op
- [info] p(99.9900) = 33285.997 ms/op
- [info] p(99.9990) = 33285.997 ms/op
- [info] p(99.9999) = 33285.997 ms/op
- [info] p(100.0000) = 33285.997 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:11:39
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 8 32438.747 ± 1011.336 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 31910.265 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 32329.695 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 33285.997 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 33285.997 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 33285.997 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 33285.997 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 33285.997 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 33285.997 ms/op
- [success] Total time: 718 s, completed Feb 5, 2018 1:19:32 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 87241.523 ms/op
- [info] # Warmup Iteration 2: 51271.172 ms/op
- [info] # Warmup Iteration 3: 39191.577 ms/op
- [info] # Warmup Iteration 4: 33319.551 ms/op
- [info] # Warmup Iteration 5: 29393.682 ms/op
- [info] # Warmup Iteration 6: 27380.417 ms/op
- [info] # Warmup Iteration 7: 28655.485 ms/op
- [info] # Warmup Iteration 8: 26340.229 ms/op
- [info] # Warmup Iteration 9: 26809.991 ms/op
- [info] # Warmup Iteration 10: 24662.508 ms/op
- [info] Iteration 1: 24226.300 ms/op
- [info] compile·p0.00: 24226.300 ms/op
- [info] compile·p0.50: 24226.300 ms/op
- [info] compile·p0.90: 24226.300 ms/op
- [info] compile·p0.95: 24226.300 ms/op
- [info] compile·p0.99: 24226.300 ms/op
- [info] compile·p0.999: 24226.300 ms/op
- [info] compile·p0.9999: 24226.300 ms/op
- [info] compile·p1.00: 24226.300 ms/op
- [info]
- [info] Iteration 2: 24360.518 ms/op
- [info] compile·p0.00: 24360.518 ms/op
- [info] compile·p0.50: 24360.518 ms/op
- [info] compile·p0.90: 24360.518 ms/op
- [info] compile·p0.95: 24360.518 ms/op
- [info] compile·p0.99: 24360.518 ms/op
- [info] compile·p0.999: 24360.518 ms/op
- [info] compile·p0.9999: 24360.518 ms/op
- [info] compile·p1.00: 24360.518 ms/op
- [info]
- [info] Iteration 3: 24427.626 ms/op
- [info] compile·p0.00: 24427.626 ms/op
- [info] compile·p0.50: 24427.626 ms/op
- [info] compile·p0.90: 24427.626 ms/op
- [info] compile·p0.95: 24427.626 ms/op
- [info] compile·p0.99: 24427.626 ms/op
- [info] compile·p0.999: 24427.626 ms/op
- [info] compile·p0.9999: 24427.626 ms/op
- [info] compile·p1.00: 24427.626 ms/op
- [info]
- [info] Iteration 4: 24092.082 ms/op
- [info] compile·p0.00: 24092.082 ms/op
- [info] compile·p0.50: 24092.082 ms/op
- [info] compile·p0.90: 24092.082 ms/op
- [info] compile·p0.95: 24092.082 ms/op
- [info] compile·p0.99: 24092.082 ms/op
- [info] compile·p0.999: 24092.082 ms/op
- [info] compile·p0.9999: 24092.082 ms/op
- [info] compile·p1.00: 24092.082 ms/op
- [info]
- [info] Iteration 5: 23857.201 ms/op
- [info] compile·p0.00: 23857.201 ms/op
- [info] compile·p0.50: 23857.201 ms/op
- [info] compile·p0.90: 23857.201 ms/op
- [info] compile·p0.95: 23857.201 ms/op
- [info] compile·p0.99: 23857.201 ms/op
- [info] compile·p0.999: 23857.201 ms/op
- [info] compile·p0.9999: 23857.201 ms/op
- [info] compile·p1.00: 23857.201 ms/op
- [info]
- [info] Iteration 6: 23387.439 ms/op
- [info] compile·p0.00: 23387.439 ms/op
- [info] compile·p0.50: 23387.439 ms/op
- [info] compile·p0.90: 23387.439 ms/op
- [info] compile·p0.95: 23387.439 ms/op
- [info] compile·p0.99: 23387.439 ms/op
- [info] compile·p0.999: 23387.439 ms/op
- [info] compile·p0.9999: 23387.439 ms/op
- [info] compile·p1.00: 23387.439 ms/op
- [info]
- [info] Iteration 7: 23085.449 ms/op
- [info] compile·p0.00: 23085.449 ms/op
- [info] compile·p0.50: 23085.449 ms/op
- [info] compile·p0.90: 23085.449 ms/op
- [info] compile·p0.95: 23085.449 ms/op
- [info] compile·p0.99: 23085.449 ms/op
- [info] compile·p0.999: 23085.449 ms/op
- [info] compile·p0.9999: 23085.449 ms/op
- [info] compile·p1.00: 23085.449 ms/op
- [info]
- [info] Iteration 8: 23622.320 ms/op
- [info] compile·p0.00: 23622.320 ms/op
- [info] compile·p0.50: 23622.320 ms/op
- [info] compile·p0.90: 23622.320 ms/op
- [info] compile·p0.95: 23622.320 ms/op
- [info] compile·p0.99: 23622.320 ms/op
- [info] compile·p0.999: 23622.320 ms/op
- [info] compile·p0.9999: 23622.320 ms/op
- [info] compile·p1.00: 23622.320 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 23882.367 ±(99.9%) 924.465 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [23000.000, 23125.000) = 1
- [info] [23125.000, 23250.000) = 0
- [info] [23250.000, 23375.000) = 0
- [info] [23375.000, 23500.000) = 1
- [info] [23500.000, 23625.000) = 1
- [info] [23625.000, 23750.000) = 0
- [info] [23750.000, 23875.000) = 1
- [info] [23875.000, 24000.000) = 0
- [info] [24000.000, 24125.000) = 1
- [info] [24125.000, 24250.000) = 1
- [info] [24250.000, 24375.000) = 1
- [info] [24375.000, 24500.000) = 1
- [info] [24500.000, 24625.000) = 0
- [info] [24625.000, 24750.000) = 0
- [info] [24750.000, 24875.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 23085.449 ms/op
- [info] p(50.0000) = 23974.642 ms/op
- [info] p(90.0000) = 24427.626 ms/op
- [info] p(95.0000) = 24427.626 ms/op
- [info] p(99.0000) = 24427.626 ms/op
- [info] p(99.9000) = 24427.626 ms/op
- [info] p(99.9900) = 24427.626 ms/op
- [info] p(99.9990) = 24427.626 ms/op
- [info] p(99.9999) = 24427.626 ms/op
- [info] p(100.0000) = 24427.626 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:09:27
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 8 23882.367 ± 924.465 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 23085.449 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 23974.642 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24427.626 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24427.626 ms/op
- [success] Total time: 586 s, completed Feb 5, 2018 1:29:30 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 85228.257 ms/op
- [info] # Warmup Iteration 2: 52412.023 ms/op
- [info] # Warmup Iteration 3: 37446.746 ms/op
- [info] # Warmup Iteration 4: 31910.265 ms/op
- [info] # Warmup Iteration 5: 28856.812 ms/op
- [info] # Warmup Iteration 6: 27212.644 ms/op
- [info] # Warmup Iteration 7: 28387.049 ms/op
- [info] # Warmup Iteration 8: 26809.991 ms/op
- [info] # Warmup Iteration 9: 25971.130 ms/op
- [info] # Warmup Iteration 10: 25165.824 ms/op
- [info] Iteration 1: 24092.082 ms/op
- [info] compile·p0.00: 24092.082 ms/op
- [info] compile·p0.50: 24092.082 ms/op
- [info] compile·p0.90: 24092.082 ms/op
- [info] compile·p0.95: 24092.082 ms/op
- [info] compile·p0.99: 24092.082 ms/op
- [info] compile·p0.999: 24092.082 ms/op
- [info] compile·p0.9999: 24092.082 ms/op
- [info] compile·p1.00: 24092.082 ms/op
- [info]
- [info] Iteration 2: 24863.834 ms/op
- [info] compile·p0.00: 24863.834 ms/op
- [info] compile·p0.50: 24863.834 ms/op
- [info] compile·p0.90: 24863.834 ms/op
- [info] compile·p0.95: 24863.834 ms/op
- [info] compile·p0.99: 24863.834 ms/op
- [info] compile·p0.999: 24863.834 ms/op
- [info] compile·p0.9999: 24863.834 ms/op
- [info] compile·p1.00: 24863.834 ms/op
- [info]
- [info] Iteration 3: 24662.508 ms/op
- [info] compile·p0.00: 24662.508 ms/op
- [info] compile·p0.50: 24662.508 ms/op
- [info] compile·p0.90: 24662.508 ms/op
- [info] compile·p0.95: 24662.508 ms/op
- [info] compile·p0.99: 24662.508 ms/op
- [info] compile·p0.999: 24662.508 ms/op
- [info] compile·p0.9999: 24662.508 ms/op
- [info] compile·p1.00: 24662.508 ms/op
- [info]
- [info] Iteration 4: 23857.201 ms/op
- [info] compile·p0.00: 23857.201 ms/op
- [info] compile·p0.50: 23857.201 ms/op
- [info] compile·p0.90: 23857.201 ms/op
- [info] compile·p0.95: 23857.201 ms/op
- [info] compile·p0.99: 23857.201 ms/op
- [info] compile·p0.999: 23857.201 ms/op
- [info] compile·p0.9999: 23857.201 ms/op
- [info] compile·p1.00: 23857.201 ms/op
- [info]
- [info] Iteration 5: 23454.548 ms/op
- [info] compile·p0.00: 23454.548 ms/op
- [info] compile·p0.50: 23454.548 ms/op
- [info] compile·p0.90: 23454.548 ms/op
- [info] compile·p0.95: 23454.548 ms/op
- [info] compile·p0.99: 23454.548 ms/op
- [info] compile·p0.999: 23454.548 ms/op
- [info] compile·p0.9999: 23454.548 ms/op
- [info] compile·p1.00: 23454.548 ms/op
- [info]
- [info] Iteration 6: 23320.330 ms/op
- [info] compile·p0.00: 23320.330 ms/op
- [info] compile·p0.50: 23320.330 ms/op
- [info] compile·p0.90: 23320.330 ms/op
- [info] compile·p0.95: 23320.330 ms/op
- [info] compile·p0.99: 23320.330 ms/op
- [info] compile·p0.999: 23320.330 ms/op
- [info] compile·p0.9999: 23320.330 ms/op
- [info] compile·p1.00: 23320.330 ms/op
- [info]
- [info] Iteration 7: 22749.905 ms/op
- [info] compile·p0.00: 22749.905 ms/op
- [info] compile·p0.50: 22749.905 ms/op
- [info] compile·p0.90: 22749.905 ms/op
- [info] compile·p0.95: 22749.905 ms/op
- [info] compile·p0.99: 22749.905 ms/op
- [info] compile·p0.999: 22749.905 ms/op
- [info] compile·p0.9999: 22749.905 ms/op
- [info] compile·p1.00: 22749.905 ms/op
- [info]
- [info] Iteration 8: 23253.221 ms/op
- [info] compile·p0.00: 23253.221 ms/op
- [info] compile·p0.50: 23253.221 ms/op
- [info] compile·p0.90: 23253.221 ms/op
- [info] compile·p0.95: 23253.221 ms/op
- [info] compile·p0.99: 23253.221 ms/op
- [info] compile·p0.999: 23253.221 ms/op
- [info] compile·p0.9999: 23253.221 ms/op
- [info] compile·p1.00: 23253.221 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 23781.704 ±(99.9%) 1392.437 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [22000.000, 22250.000) = 0
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 1
- [info] [22750.000, 23000.000) = 0
- [info] [23000.000, 23250.000) = 0
- [info] [23250.000, 23500.000) = 3
- [info] [23500.000, 23750.000) = 0
- [info] [23750.000, 24000.000) = 1
- [info] [24000.000, 24250.000) = 1
- [info] [24250.000, 24500.000) = 0
- [info] [24500.000, 24750.000) = 1
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 22749.905 ms/op
- [info] p(50.0000) = 23655.875 ms/op
- [info] p(90.0000) = 24863.834 ms/op
- [info] p(95.0000) = 24863.834 ms/op
- [info] p(99.0000) = 24863.834 ms/op
- [info] p(99.9000) = 24863.834 ms/op
- [info] p(99.9900) = 24863.834 ms/op
- [info] p(99.9990) = 24863.834 ms/op
- [info] p(99.9999) = 24863.834 ms/op
- [info] p(100.0000) = 24863.834 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:09:21
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 8 23781.704 ± 1392.437 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 22749.905 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 23655.875 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24863.834 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24863.834 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24863.834 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24863.834 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24863.834 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/js/target/test-with-classes-dir.args sample 24863.834 ms/op
- [success] Total time: 580 s, completed Feb 5, 2018 1:39:22 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 77577.847 ms/op
- [info] # Warmup Iteration 2: 48519.709 ms/op
- [info] # Warmup Iteration 3: 33789.313 ms/op
- [info] # Warmup Iteration 4: 30165.434 ms/op
- [info] # Warmup Iteration 5: 26239.566 ms/op
- [info] # Warmup Iteration 6: 24830.280 ms/op
- [info] # Warmup Iteration 7: 24796.725 ms/op
- [info] # Warmup Iteration 8: 23320.330 ms/op
- [info] # Warmup Iteration 9: 22783.459 ms/op
- [info] # Warmup Iteration 10: 22682.796 ms/op
- [info] Iteration 1: 21843.935 ms/op
- [info] compile·p0.00: 21843.935 ms/op
- [info] compile·p0.50: 21843.935 ms/op
- [info] compile·p0.90: 21843.935 ms/op
- [info] compile·p0.95: 21843.935 ms/op
- [info] compile·p0.99: 21843.935 ms/op
- [info] compile·p0.999: 21843.935 ms/op
- [info] compile·p0.9999: 21843.935 ms/op
- [info] compile·p1.00: 21843.935 ms/op
- [info]
- [info] Iteration 2: 21441.282 ms/op
- [info] compile·p0.00: 21441.282 ms/op
- [info] compile·p0.50: 21441.282 ms/op
- [info] compile·p0.90: 21441.282 ms/op
- [info] compile·p0.95: 21441.282 ms/op
- [info] compile·p0.99: 21441.282 ms/op
- [info] compile·p0.999: 21441.282 ms/op
- [info] compile·p0.9999: 21441.282 ms/op
- [info] compile·p1.00: 21441.282 ms/op
- [info]
- [info] Iteration 3: 22078.816 ms/op
- [info] compile·p0.00: 22078.816 ms/op
- [info] compile·p0.50: 22078.816 ms/op
- [info] compile·p0.90: 22078.816 ms/op
- [info] compile·p0.95: 22078.816 ms/op
- [info] compile·p0.99: 22078.816 ms/op
- [info] compile·p0.999: 22078.816 ms/op
- [info] compile·p0.9999: 22078.816 ms/op
- [info] compile·p1.00: 22078.816 ms/op
- [info]
- [info] Iteration 4: 21307.064 ms/op
- [info] compile·p0.00: 21307.064 ms/op
- [info] compile·p0.50: 21307.064 ms/op
- [info] compile·p0.90: 21307.064 ms/op
- [info] compile·p0.95: 21307.064 ms/op
- [info] compile·p0.99: 21307.064 ms/op
- [info] compile·p0.999: 21307.064 ms/op
- [info] compile·p0.9999: 21307.064 ms/op
- [info] compile·p1.00: 21307.064 ms/op
- [info]
- [info] Iteration 5: 21105.738 ms/op
- [info] compile·p0.00: 21105.738 ms/op
- [info] compile·p0.50: 21105.738 ms/op
- [info] compile·p0.90: 21105.738 ms/op
- [info] compile·p0.95: 21105.738 ms/op
- [info] compile·p0.99: 21105.738 ms/op
- [info] compile·p0.999: 21105.738 ms/op
- [info] compile·p0.9999: 21105.738 ms/op
- [info] compile·p1.00: 21105.738 ms/op
- [info]
- [info] Iteration 6: 20468.204 ms/op
- [info] compile·p0.00: 20468.204 ms/op
- [info] compile·p0.50: 20468.204 ms/op
- [info] compile·p0.90: 20468.204 ms/op
- [info] compile·p0.95: 20468.204 ms/op
- [info] compile·p0.99: 20468.204 ms/op
- [info] compile·p0.999: 20468.204 ms/op
- [info] compile·p0.9999: 20468.204 ms/op
- [info] compile·p1.00: 20468.204 ms/op
- [info]
- [info] Iteration 7: 20535.312 ms/op
- [info] compile·p0.00: 20535.312 ms/op
- [info] compile·p0.50: 20535.312 ms/op
- [info] compile·p0.90: 20535.312 ms/op
- [info] compile·p0.95: 20535.312 ms/op
- [info] compile·p0.99: 20535.312 ms/op
- [info] compile·p0.999: 20535.312 ms/op
- [info] compile·p0.9999: 20535.312 ms/op
- [info] compile·p1.00: 20535.312 ms/op
- [info]
- [info] Iteration 8: 20199.768 ms/op
- [info] compile·p0.00: 20199.768 ms/op
- [info] compile·p0.50: 20199.768 ms/op
- [info] compile·p0.90: 20199.768 ms/op
- [info] compile·p0.95: 20199.768 ms/op
- [info] compile·p0.99: 20199.768 ms/op
- [info] compile·p0.999: 20199.768 ms/op
- [info] compile·p0.9999: 20199.768 ms/op
- [info] compile·p1.00: 20199.768 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 21122.515 ±(99.9%) 1291.782 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [20000.000, 20250.000) = 1
- [info] [20250.000, 20500.000) = 1
- [info] [20500.000, 20750.000) = 1
- [info] [20750.000, 21000.000) = 0
- [info] [21000.000, 21250.000) = 1
- [info] [21250.000, 21500.000) = 2
- [info] [21500.000, 21750.000) = 0
- [info] [21750.000, 22000.000) = 1
- [info] [22000.000, 22250.000) = 1
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 20199.768 ms/op
- [info] p(50.0000) = 21206.401 ms/op
- [info] p(90.0000) = 22078.816 ms/op
- [info] p(95.0000) = 22078.816 ms/op
- [info] p(99.0000) = 22078.816 ms/op
- [info] p(99.9000) = 22078.816 ms/op
- [info] p(99.9900) = 22078.816 ms/op
- [info] p(99.9990) = 22078.816 ms/op
- [info] p(99.9999) = 22078.816 ms/op
- [info] p(100.0000) = 22078.816 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:08:25
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 8 21122.515 ± 1291.782 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 20199.768 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 21206.401 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22078.816 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22078.816 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22078.816 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22078.816 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22078.816 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22078.816 ms/op
- [success] Total time: 524 s, completed Feb 5, 2018 1:48:19 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 76772.540 ms/op
- [info] # Warmup Iteration 2: 45634.028 ms/op
- [info] # Warmup Iteration 3: 33990.640 ms/op
- [info] # Warmup Iteration 4: 29360.128 ms/op
- [info] # Warmup Iteration 5: 27682.406 ms/op
- [info] # Warmup Iteration 6: 25367.151 ms/op
- [info] # Warmup Iteration 7: 24998.052 ms/op
- [info] # Warmup Iteration 8: 23051.895 ms/op
- [info] # Warmup Iteration 9: 22313.697 ms/op
- [info] # Warmup Iteration 10: 22112.371 ms/op
- [info] Iteration 1: 21843.935 ms/op
- [info] compile·p0.00: 21843.935 ms/op
- [info] compile·p0.50: 21843.935 ms/op
- [info] compile·p0.90: 21843.935 ms/op
- [info] compile·p0.95: 21843.935 ms/op
- [info] compile·p0.99: 21843.935 ms/op
- [info] compile·p0.999: 21843.935 ms/op
- [info] compile·p0.9999: 21843.935 ms/op
- [info] compile·p1.00: 21843.935 ms/op
- [info]
- [info] Iteration 2: 21609.054 ms/op
- [info] compile·p0.00: 21609.054 ms/op
- [info] compile·p0.50: 21609.054 ms/op
- [info] compile·p0.90: 21609.054 ms/op
- [info] compile·p0.95: 21609.054 ms/op
- [info] compile·p0.99: 21609.054 ms/op
- [info] compile·p0.999: 21609.054 ms/op
- [info] compile·p0.9999: 21609.054 ms/op
- [info] compile·p1.00: 21609.054 ms/op
- [info]
- [info] Iteration 3: 22112.371 ms/op
- [info] compile·p0.00: 22112.371 ms/op
- [info] compile·p0.50: 22112.371 ms/op
- [info] compile·p0.90: 22112.371 ms/op
- [info] compile·p0.95: 22112.371 ms/op
- [info] compile·p0.99: 22112.371 ms/op
- [info] compile·p0.999: 22112.371 ms/op
- [info] compile·p0.9999: 22112.371 ms/op
- [info] compile·p1.00: 22112.371 ms/op
- [info]
- [info] Iteration 4: 22112.371 ms/op
- [info] compile·p0.00: 22112.371 ms/op
- [info] compile·p0.50: 22112.371 ms/op
- [info] compile·p0.90: 22112.371 ms/op
- [info] compile·p0.95: 22112.371 ms/op
- [info] compile·p0.99: 22112.371 ms/op
- [info] compile·p0.999: 22112.371 ms/op
- [info] compile·p0.9999: 22112.371 ms/op
- [info] compile·p1.00: 22112.371 ms/op
- [info]
- [info] Iteration 5: 21642.609 ms/op
- [info] compile·p0.00: 21642.609 ms/op
- [info] compile·p0.50: 21642.609 ms/op
- [info] compile·p0.90: 21642.609 ms/op
- [info] compile·p0.95: 21642.609 ms/op
- [info] compile·p0.99: 21642.609 ms/op
- [info] compile·p0.999: 21642.609 ms/op
- [info] compile·p0.9999: 21642.609 ms/op
- [info] compile·p1.00: 21642.609 ms/op
- [info]
- [info] Iteration 6: 21676.163 ms/op
- [info] compile·p0.00: 21676.163 ms/op
- [info] compile·p0.50: 21676.163 ms/op
- [info] compile·p0.90: 21676.163 ms/op
- [info] compile·p0.95: 21676.163 ms/op
- [info] compile·p0.99: 21676.163 ms/op
- [info] compile·p0.999: 21676.163 ms/op
- [info] compile·p0.9999: 21676.163 ms/op
- [info] compile·p1.00: 21676.163 ms/op
- [info]
- [info] Iteration 7: 20468.204 ms/op
- [info] compile·p0.00: 20468.204 ms/op
- [info] compile·p0.50: 20468.204 ms/op
- [info] compile·p0.90: 20468.204 ms/op
- [info] compile·p0.95: 20468.204 ms/op
- [info] compile·p0.99: 20468.204 ms/op
- [info] compile·p0.999: 20468.204 ms/op
- [info] compile·p0.9999: 20468.204 ms/op
- [info] compile·p1.00: 20468.204 ms/op
- [info]
- [info] Iteration 8: 21206.401 ms/op
- [info] compile·p0.00: 21206.401 ms/op
- [info] compile·p0.50: 21206.401 ms/op
- [info] compile·p0.90: 21206.401 ms/op
- [info] compile·p0.95: 21206.401 ms/op
- [info] compile·p0.99: 21206.401 ms/op
- [info] compile·p0.999: 21206.401 ms/op
- [info] compile·p0.9999: 21206.401 ms/op
- [info] compile·p1.00: 21206.401 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 21583.888 ±(99.9%) 1028.630 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [20000.000, 20250.000) = 0
- [info] [20250.000, 20500.000) = 1
- [info] [20500.000, 20750.000) = 0
- [info] [20750.000, 21000.000) = 0
- [info] [21000.000, 21250.000) = 1
- [info] [21250.000, 21500.000) = 0
- [info] [21500.000, 21750.000) = 3
- [info] [21750.000, 22000.000) = 1
- [info] [22000.000, 22250.000) = 2
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 20468.204 ms/op
- [info] p(50.0000) = 21659.386 ms/op
- [info] p(90.0000) = 22112.371 ms/op
- [info] p(95.0000) = 22112.371 ms/op
- [info] p(99.0000) = 22112.371 ms/op
- [info] p(99.9000) = 22112.371 ms/op
- [info] p(99.9900) = 22112.371 ms/op
- [info] p(99.9990) = 22112.371 ms/op
- [info] p(99.9999) = 22112.371 ms/op
- [info] p(100.0000) = 22112.371 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:08:25
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 8 21583.888 ± 1028.630 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 20468.204 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 21659.386 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22112.371 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22112.371 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22112.371 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22112.371 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22112.371 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 22112.371 ms/op
- [success] Total time: 524 s, completed Feb 5, 2018 1:57:15 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 77443.629 ms/op
- [info] # Warmup Iteration 2: 46841.987 ms/op
- [info] # Warmup Iteration 3: 36305.895 ms/op
- [info] # Warmup Iteration 4: 30601.642 ms/op
- [info] # Warmup Iteration 5: 26977.763 ms/op
- [info] # Warmup Iteration 6: 26239.566 ms/op
- [info] # Warmup Iteration 7: 25031.606 ms/op
- [info] # Warmup Iteration 8: 24092.082 ms/op
- [info] # Warmup Iteration 9: 22548.578 ms/op
- [info] # Warmup Iteration 10: 22951.231 ms/op
- [info] Iteration 1: 21877.490 ms/op
- [info] compile·p0.00: 21877.490 ms/op
- [info] compile·p0.50: 21877.490 ms/op
- [info] compile·p0.90: 21877.490 ms/op
- [info] compile·p0.95: 21877.490 ms/op
- [info] compile·p0.99: 21877.490 ms/op
- [info] compile·p0.999: 21877.490 ms/op
- [info] compile·p0.9999: 21877.490 ms/op
- [info] compile·p1.00: 21877.490 ms/op
- [info]
- [info] Iteration 2: 21676.163 ms/op
- [info] compile·p0.00: 21676.163 ms/op
- [info] compile·p0.50: 21676.163 ms/op
- [info] compile·p0.90: 21676.163 ms/op
- [info] compile·p0.95: 21676.163 ms/op
- [info] compile·p0.99: 21676.163 ms/op
- [info] compile·p0.999: 21676.163 ms/op
- [info] compile·p0.9999: 21676.163 ms/op
- [info] compile·p1.00: 21676.163 ms/op
- [info]
- [info] Iteration 3: 22078.816 ms/op
- [info] compile·p0.00: 22078.816 ms/op
- [info] compile·p0.50: 22078.816 ms/op
- [info] compile·p0.90: 22078.816 ms/op
- [info] compile·p0.95: 22078.816 ms/op
- [info] compile·p0.99: 22078.816 ms/op
- [info] compile·p0.999: 22078.816 ms/op
- [info] compile·p0.9999: 22078.816 ms/op
- [info] compile·p1.00: 22078.816 ms/op
- [info]
- [info] Iteration 4: 23018.340 ms/op
- [info] compile·p0.00: 23018.340 ms/op
- [info] compile·p0.50: 23018.340 ms/op
- [info] compile·p0.90: 23018.340 ms/op
- [info] compile·p0.95: 23018.340 ms/op
- [info] compile·p0.99: 23018.340 ms/op
- [info] compile·p0.999: 23018.340 ms/op
- [info] compile·p0.9999: 23018.340 ms/op
- [info] compile·p1.00: 23018.340 ms/op
- [info]
- [info] Iteration 5: 21911.044 ms/op
- [info] compile·p0.00: 21911.044 ms/op
- [info] compile·p0.50: 21911.044 ms/op
- [info] compile·p0.90: 21911.044 ms/op
- [info] compile·p0.95: 21911.044 ms/op
- [info] compile·p0.99: 21911.044 ms/op
- [info] compile·p0.999: 21911.044 ms/op
- [info] compile·p0.9999: 21911.044 ms/op
- [info] compile·p1.00: 21911.044 ms/op
- [info]
- [info] Iteration 6: 21474.836 ms/op
- [info] compile·p0.00: 21474.836 ms/op
- [info] compile·p0.50: 21474.836 ms/op
- [info] compile·p0.90: 21474.836 ms/op
- [info] compile·p0.95: 21474.836 ms/op
- [info] compile·p0.99: 21474.836 ms/op
- [info] compile·p0.999: 21474.836 ms/op
- [info] compile·p0.9999: 21474.836 ms/op
- [info] compile·p1.00: 21474.836 ms/op
- [info]
- [info] Iteration 7: 20837.302 ms/op
- [info] compile·p0.00: 20837.302 ms/op
- [info] compile·p0.50: 20837.302 ms/op
- [info] compile·p0.90: 20837.302 ms/op
- [info] compile·p0.95: 20837.302 ms/op
- [info] compile·p0.99: 20837.302 ms/op
- [info] compile·p0.999: 20837.302 ms/op
- [info] compile·p0.9999: 20837.302 ms/op
- [info] compile·p1.00: 20837.302 ms/op
- [info]
- [info] Iteration 8: 21776.826 ms/op
- [info] compile·p0.00: 21776.826 ms/op
- [info] compile·p0.50: 21776.826 ms/op
- [info] compile·p0.90: 21776.826 ms/op
- [info] compile·p0.95: 21776.826 ms/op
- [info] compile·p0.99: 21776.826 ms/op
- [info] compile·p0.999: 21776.826 ms/op
- [info] compile·p0.9999: 21776.826 ms/op
- [info] compile·p1.00: 21776.826 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 21831.352 ±(99.9%) 1169.938 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [20000.000, 20250.000) = 0
- [info] [20250.000, 20500.000) = 0
- [info] [20500.000, 20750.000) = 0
- [info] [20750.000, 21000.000) = 1
- [info] [21000.000, 21250.000) = 0
- [info] [21250.000, 21500.000) = 1
- [info] [21500.000, 21750.000) = 1
- [info] [21750.000, 22000.000) = 3
- [info] [22000.000, 22250.000) = 1
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 0
- [info] [22750.000, 23000.000) = 0
- [info] [23000.000, 23250.000) = 1
- [info] [23250.000, 23500.000) = 0
- [info] [23500.000, 23750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 20837.302 ms/op
- [info] p(50.0000) = 21827.158 ms/op
- [info] p(90.0000) = 23018.340 ms/op
- [info] p(95.0000) = 23018.340 ms/op
- [info] p(99.0000) = 23018.340 ms/op
- [info] p(99.9000) = 23018.340 ms/op
- [info] p(99.9900) = 23018.340 ms/op
- [info] p(99.9990) = 23018.340 ms/op
- [info] p(99.9999) = 23018.340 ms/op
- [info] p(100.0000) = 23018.340 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:08:35
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 8 21831.352 ± 1169.938 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 20837.302 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 21827.158 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 23018.340 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 23018.340 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 23018.340 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 23018.340 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 23018.340 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test.args sample 23018.340 ms/op
- [success] Total time: 534 s, completed Feb 5, 2018 2:06:21 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 77712.065 ms/op
- [info] # Warmup Iteration 2: 45902.463 ms/op
- [info] # Warmup Iteration 3: 35836.133 ms/op
- [info] # Warmup Iteration 4: 30400.315 ms/op
- [info] # Warmup Iteration 5: 27044.872 ms/op
- [info] # Warmup Iteration 6: 26004.685 ms/op
- [info] # Warmup Iteration 7: 25534.923 ms/op
- [info] # Warmup Iteration 8: 23655.875 ms/op
- [info] # Warmup Iteration 9: 22582.133 ms/op
- [info] # Warmup Iteration 10: 22447.915 ms/op
- [info] Iteration 1: 22481.469 ms/op
- [info] compile·p0.00: 22481.469 ms/op
- [info] compile·p0.50: 22481.469 ms/op
- [info] compile·p0.90: 22481.469 ms/op
- [info] compile·p0.95: 22481.469 ms/op
- [info] compile·p0.99: 22481.469 ms/op
- [info] compile·p0.999: 22481.469 ms/op
- [info] compile·p0.9999: 22481.469 ms/op
- [info] compile·p1.00: 22481.469 ms/op
- [info]
- [info] Iteration 2: 21743.272 ms/op
- [info] compile·p0.00: 21743.272 ms/op
- [info] compile·p0.50: 21743.272 ms/op
- [info] compile·p0.90: 21743.272 ms/op
- [info] compile·p0.95: 21743.272 ms/op
- [info] compile·p0.99: 21743.272 ms/op
- [info] compile·p0.999: 21743.272 ms/op
- [info] compile·p0.9999: 21743.272 ms/op
- [info] compile·p1.00: 21743.272 ms/op
- [info]
- [info] Iteration 3: 21676.163 ms/op
- [info] compile·p0.00: 21676.163 ms/op
- [info] compile·p0.50: 21676.163 ms/op
- [info] compile·p0.90: 21676.163 ms/op
- [info] compile·p0.95: 21676.163 ms/op
- [info] compile·p0.99: 21676.163 ms/op
- [info] compile·p0.999: 21676.163 ms/op
- [info] compile·p0.9999: 21676.163 ms/op
- [info] compile·p1.00: 21676.163 ms/op
- [info]
- [info] Iteration 4: 22213.034 ms/op
- [info] compile·p0.00: 22213.034 ms/op
- [info] compile·p0.50: 22213.034 ms/op
- [info] compile·p0.90: 22213.034 ms/op
- [info] compile·p0.95: 22213.034 ms/op
- [info] compile·p0.99: 22213.034 ms/op
- [info] compile·p0.999: 22213.034 ms/op
- [info] compile·p0.9999: 22213.034 ms/op
- [info] compile·p1.00: 22213.034 ms/op
- [info]
- [info] Iteration 5: 21508.391 ms/op
- [info] compile·p0.00: 21508.391 ms/op
- [info] compile·p0.50: 21508.391 ms/op
- [info] compile·p0.90: 21508.391 ms/op
- [info] compile·p0.95: 21508.391 ms/op
- [info] compile·p0.99: 21508.391 ms/op
- [info] compile·p0.999: 21508.391 ms/op
- [info] compile·p0.9999: 21508.391 ms/op
- [info] compile·p1.00: 21508.391 ms/op
- [info]
- [info] Iteration 6: 21005.074 ms/op
- [info] compile·p0.00: 21005.074 ms/op
- [info] compile·p0.50: 21005.074 ms/op
- [info] compile·p0.90: 21005.074 ms/op
- [info] compile·p0.95: 21005.074 ms/op
- [info] compile·p0.99: 21005.074 ms/op
- [info] compile·p0.999: 21005.074 ms/op
- [info] compile·p0.9999: 21005.074 ms/op
- [info] compile·p1.00: 21005.074 ms/op
- [info]
- [info] Iteration 7: 20468.204 ms/op
- [info] compile·p0.00: 20468.204 ms/op
- [info] compile·p0.50: 20468.204 ms/op
- [info] compile·p0.90: 20468.204 ms/op
- [info] compile·p0.95: 20468.204 ms/op
- [info] compile·p0.99: 20468.204 ms/op
- [info] compile·p0.999: 20468.204 ms/op
- [info] compile·p0.9999: 20468.204 ms/op
- [info] compile·p1.00: 20468.204 ms/op
- [info]
- [info] Iteration 8: 20468.204 ms/op
- [info] compile·p0.00: 20468.204 ms/op
- [info] compile·p0.50: 20468.204 ms/op
- [info] compile·p0.90: 20468.204 ms/op
- [info] compile·p0.95: 20468.204 ms/op
- [info] compile·p0.99: 20468.204 ms/op
- [info] compile·p0.999: 20468.204 ms/op
- [info] compile·p0.9999: 20468.204 ms/op
- [info] compile·p1.00: 20468.204 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 21445.476 ±(99.9%) 1429.397 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [20000.000, 20250.000) = 0
- [info] [20250.000, 20500.000) = 2
- [info] [20500.000, 20750.000) = 0
- [info] [20750.000, 21000.000) = 0
- [info] [21000.000, 21250.000) = 1
- [info] [21250.000, 21500.000) = 0
- [info] [21500.000, 21750.000) = 3
- [info] [21750.000, 22000.000) = 0
- [info] [22000.000, 22250.000) = 1
- [info] [22250.000, 22500.000) = 1
- [info] [22500.000, 22750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 20468.204 ms/op
- [info] p(50.0000) = 21592.277 ms/op
- [info] p(90.0000) = 22481.469 ms/op
- [info] p(95.0000) = 22481.469 ms/op
- [info] p(99.0000) = 22481.469 ms/op
- [info] p(99.9000) = 22481.469 ms/op
- [info] p(99.9900) = 22481.469 ms/op
- [info] p(99.9990) = 22481.469 ms/op
- [info] p(99.9999) = 22481.469 ms/op
- [info] p(100.0000) = 22481.469 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:08:30
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 8 21445.476 ± 1429.397 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 20468.204 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21592.277 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22481.469 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22481.469 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22481.469 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22481.469 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22481.469 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22481.469 ms/op
- [success] Total time: 529 s, completed Feb 5, 2018 2:15:23 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 80262.201 ms/op
- [info] # Warmup Iteration 2: 45701.136 ms/op
- [info] # Warmup Iteration 3: 37245.420 ms/op
- [info] # Warmup Iteration 4: 29796.336 ms/op
- [info] # Warmup Iteration 5: 28152.168 ms/op
- [info] # Warmup Iteration 6: 26675.773 ms/op
- [info] # Warmup Iteration 7: 24897.389 ms/op
- [info] # Warmup Iteration 8: 24192.745 ms/op
- [info] # Warmup Iteration 9: 22749.905 ms/op
- [info] # Warmup Iteration 10: 21944.599 ms/op
- [info] Iteration 1: 21474.836 ms/op
- [info] compile·p0.00: 21474.836 ms/op
- [info] compile·p0.50: 21474.836 ms/op
- [info] compile·p0.90: 21474.836 ms/op
- [info] compile·p0.95: 21474.836 ms/op
- [info] compile·p0.99: 21474.836 ms/op
- [info] compile·p0.999: 21474.836 ms/op
- [info] compile·p0.9999: 21474.836 ms/op
- [info] compile·p1.00: 21474.836 ms/op
- [info]
- [info] Iteration 2: 22179.480 ms/op
- [info] compile·p0.00: 22179.480 ms/op
- [info] compile·p0.50: 22179.480 ms/op
- [info] compile·p0.90: 22179.480 ms/op
- [info] compile·p0.95: 22179.480 ms/op
- [info] compile·p0.99: 22179.480 ms/op
- [info] compile·p0.999: 22179.480 ms/op
- [info] compile·p0.9999: 22179.480 ms/op
- [info] compile·p1.00: 22179.480 ms/op
- [info]
- [info] Iteration 3: 22112.371 ms/op
- [info] compile·p0.00: 22112.371 ms/op
- [info] compile·p0.50: 22112.371 ms/op
- [info] compile·p0.90: 22112.371 ms/op
- [info] compile·p0.95: 22112.371 ms/op
- [info] compile·p0.99: 22112.371 ms/op
- [info] compile·p0.999: 22112.371 ms/op
- [info] compile·p0.9999: 22112.371 ms/op
- [info] compile·p1.00: 22112.371 ms/op
- [info]
- [info] Iteration 4: 21978.153 ms/op
- [info] compile·p0.00: 21978.153 ms/op
- [info] compile·p0.50: 21978.153 ms/op
- [info] compile·p0.90: 21978.153 ms/op
- [info] compile·p0.95: 21978.153 ms/op
- [info] compile·p0.99: 21978.153 ms/op
- [info] compile·p0.999: 21978.153 ms/op
- [info] compile·p0.9999: 21978.153 ms/op
- [info] compile·p1.00: 21978.153 ms/op
- [info]
- [info] Iteration 5: 21776.826 ms/op
- [info] compile·p0.00: 21776.826 ms/op
- [info] compile·p0.50: 21776.826 ms/op
- [info] compile·p0.90: 21776.826 ms/op
- [info] compile·p0.95: 21776.826 ms/op
- [info] compile·p0.99: 21776.826 ms/op
- [info] compile·p0.999: 21776.826 ms/op
- [info] compile·p0.9999: 21776.826 ms/op
- [info] compile·p1.00: 21776.826 ms/op
- [info]
- [info] Iteration 6: 20971.520 ms/op
- [info] compile·p0.00: 20971.520 ms/op
- [info] compile·p0.50: 20971.520 ms/op
- [info] compile·p0.90: 20971.520 ms/op
- [info] compile·p0.95: 20971.520 ms/op
- [info] compile·p0.99: 20971.520 ms/op
- [info] compile·p0.999: 20971.520 ms/op
- [info] compile·p0.9999: 20971.520 ms/op
- [info] compile·p1.00: 20971.520 ms/op
- [info]
- [info] Iteration 7: 20602.421 ms/op
- [info] compile·p0.00: 20602.421 ms/op
- [info] compile·p0.50: 20602.421 ms/op
- [info] compile·p0.90: 20602.421 ms/op
- [info] compile·p0.95: 20602.421 ms/op
- [info] compile·p0.99: 20602.421 ms/op
- [info] compile·p0.999: 20602.421 ms/op
- [info] compile·p0.9999: 20602.421 ms/op
- [info] compile·p1.00: 20602.421 ms/op
- [info]
- [info] Iteration 8: 21407.728 ms/op
- [info] compile·p0.00: 21407.728 ms/op
- [info] compile·p0.50: 21407.728 ms/op
- [info] compile·p0.90: 21407.728 ms/op
- [info] compile·p0.95: 21407.728 ms/op
- [info] compile·p0.99: 21407.728 ms/op
- [info] compile·p0.999: 21407.728 ms/op
- [info] compile·p0.9999: 21407.728 ms/op
- [info] compile·p1.00: 21407.728 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 21562.917 ±(99.9%) 1072.940 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [20000.000, 20250.000) = 0
- [info] [20250.000, 20500.000) = 0
- [info] [20500.000, 20750.000) = 1
- [info] [20750.000, 21000.000) = 1
- [info] [21000.000, 21250.000) = 0
- [info] [21250.000, 21500.000) = 2
- [info] [21500.000, 21750.000) = 0
- [info] [21750.000, 22000.000) = 2
- [info] [22000.000, 22250.000) = 2
- [info] [22250.000, 22500.000) = 0
- [info] [22500.000, 22750.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 20602.421 ms/op
- [info] p(50.0000) = 21625.831 ms/op
- [info] p(90.0000) = 22179.480 ms/op
- [info] p(95.0000) = 22179.480 ms/op
- [info] p(99.0000) = 22179.480 ms/op
- [info] p(99.9000) = 22179.480 ms/op
- [info] p(99.9900) = 22179.480 ms/op
- [info] p(99.9990) = 22179.480 ms/op
- [info] p(99.9999) = 22179.480 ms/op
- [info] p(100.0000) = 22179.480 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:08:35
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 8 21562.917 ± 1072.940 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 20602.421 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21625.831 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22179.480 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22179.480 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22179.480 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22179.480 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22179.480 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 22179.480 ms/op
- [success] Total time: 535 s, completed Feb 5, 2018 2:24:30 AM
- [info] Loading global plugins from /home/benchmarks/.sbt/0.13/plugins
- [info] Loading project definition from /home/benchmarks/experiments/compiler-benchmark/project
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Defining compilation/*:scalaVersion
- [info] The new value will be used by compilation/*:allDependencies, compilation/*:crossScalaVersions and 18 others.
- [info] Run `last` for details.
- [info] Reapplying settings...
- [info] Set current project to compiler-benchmark (in build file:/home/benchmarks/experiments/compiler-benchmark/)
- [info] Updating {file:/home/benchmarks/experiments/compiler-benchmark/}compilation...
- [info] Resolving jline#jline;2.14.5 ...
- [info] Done updating.
- [warn] Found version conflict(s) in library dependencies; some are suspected to be binary incompatible:
- [warn]
- [warn] * com.google.guava:guava:21.0 is selected over 20.0
- [warn] +- infrastructure:infrastructure:0.1-SNAPSHOT (depends on 21.0)
- [warn] +- org.influxdb:influxdb-java:2.5 (depends on 20.0)
- [warn]
- [warn] Run 'evicted' to see detailed eviction warnings
- [info] Compiling 3 Scala sources and 1 Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [warn] there was one feature warning; re-run with -feature for details
- [warn] one warning found
- Processing 37 classes from /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes with "reflection" generator
- Writing out Java source to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/src_managed/jmh and resources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/resource_managed/jmh
- [info] Compiling 25 Java sources to /home/benchmarks/experiments/compiler-benchmark/compilation/target/scala-2.12/classes...
- [info] Running scala.bench.ScalacBenchmarkRunner HotScalacBenchmark -foe true -f1 -wi 10 -i 8 -p source=@/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args
- [info] # JMH version: 1.19
- [info] # VM version: JDK 1.8.0_161, VM 25.161-b12
- [info] # VM invoker: /usr/lib/jvm/java-8-oracle/jre/bin/java
- [info] # VM options: -Xms2G -Xmx2G
- [info] # Warmup: 10 iterations, 10 s each
- [info] # Measurement: 8 iterations, 10 s each
- [info] # Timeout: 10 min per iteration
- [info] # Threads: 1 thread, will synchronize iterations
- [info] # Benchmark mode: Sampling time
- [info] # Benchmark: scala.tools.nsc.HotScalacBenchmark.compile
- [info] # Parameters: (corpusVersion = latest, extraArgs = , source = @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args)
- [info]
- [info] # Run progress: 0.00% complete, ETA 00:03:00
- [info] # Fork: 1 of 1
- [info] # Warmup Iteration 1: 75161.928 ms/op
- [info] # Warmup Iteration 2: 46036.681 ms/op
- [info] # Warmup Iteration 3: 33353.105 ms/op
- [info] # Warmup Iteration 4: 28554.822 ms/op
- [info] # Warmup Iteration 5: 26004.685 ms/op
- [info] # Warmup Iteration 6: 25165.824 ms/op
- [info] # Warmup Iteration 7: 24830.280 ms/op
- [info] # Warmup Iteration 8: 23823.647 ms/op
- [info] # Warmup Iteration 9: 22850.568 ms/op
- [info] # Warmup Iteration 10: 23253.221 ms/op
- [info] Iteration 1: 21709.718 ms/op
- [info] compile·p0.00: 21709.718 ms/op
- [info] compile·p0.50: 21709.718 ms/op
- [info] compile·p0.90: 21709.718 ms/op
- [info] compile·p0.95: 21709.718 ms/op
- [info] compile·p0.99: 21709.718 ms/op
- [info] compile·p0.999: 21709.718 ms/op
- [info] compile·p0.9999: 21709.718 ms/op
- [info] compile·p1.00: 21709.718 ms/op
- [info]
- [info] Iteration 2: 21206.401 ms/op
- [info] compile·p0.00: 21206.401 ms/op
- [info] compile·p0.50: 21206.401 ms/op
- [info] compile·p0.90: 21206.401 ms/op
- [info] compile·p0.95: 21206.401 ms/op
- [info] compile·p0.99: 21206.401 ms/op
- [info] compile·p0.999: 21206.401 ms/op
- [info] compile·p0.9999: 21206.401 ms/op
- [info] compile·p1.00: 21206.401 ms/op
- [info]
- [info] Iteration 3: 21206.401 ms/op
- [info] compile·p0.00: 21206.401 ms/op
- [info] compile·p0.50: 21206.401 ms/op
- [info] compile·p0.90: 21206.401 ms/op
- [info] compile·p0.95: 21206.401 ms/op
- [info] compile·p0.99: 21206.401 ms/op
- [info] compile·p0.999: 21206.401 ms/op
- [info] compile·p0.9999: 21206.401 ms/op
- [info] compile·p1.00: 21206.401 ms/op
- [info]
- [info] Iteration 4: 21441.282 ms/op
- [info] compile·p0.00: 21441.282 ms/op
- [info] compile·p0.50: 21441.282 ms/op
- [info] compile·p0.90: 21441.282 ms/op
- [info] compile·p0.95: 21441.282 ms/op
- [info] compile·p0.99: 21441.282 ms/op
- [info] compile·p0.999: 21441.282 ms/op
- [info] compile·p0.9999: 21441.282 ms/op
- [info] compile·p1.00: 21441.282 ms/op
- [info]
- [info] Iteration 5: 21609.054 ms/op
- [info] compile·p0.00: 21609.054 ms/op
- [info] compile·p0.50: 21609.054 ms/op
- [info] compile·p0.90: 21609.054 ms/op
- [info] compile·p0.95: 21609.054 ms/op
- [info] compile·p0.99: 21609.054 ms/op
- [info] compile·p0.999: 21609.054 ms/op
- [info] compile·p0.9999: 21609.054 ms/op
- [info] compile·p1.00: 21609.054 ms/op
- [info]
- [info] Iteration 6: 20367.540 ms/op
- [info] compile·p0.00: 20367.540 ms/op
- [info] compile·p0.50: 20367.540 ms/op
- [info] compile·p0.90: 20367.540 ms/op
- [info] compile·p0.95: 20367.540 ms/op
- [info] compile·p0.99: 20367.540 ms/op
- [info] compile·p0.999: 20367.540 ms/op
- [info] compile·p0.9999: 20367.540 ms/op
- [info] compile·p1.00: 20367.540 ms/op
- [info]
- [info] Iteration 7: 20099.105 ms/op
- [info] compile·p0.00: 20099.105 ms/op
- [info] compile·p0.50: 20099.105 ms/op
- [info] compile·p0.90: 20099.105 ms/op
- [info] compile·p0.95: 20099.105 ms/op
- [info] compile·p0.99: 20099.105 ms/op
- [info] compile·p0.999: 20099.105 ms/op
- [info] compile·p0.9999: 20099.105 ms/op
- [info] compile·p1.00: 20099.105 ms/op
- [info]
- [info] Iteration 8: 20803.748 ms/op
- [info] compile·p0.00: 20803.748 ms/op
- [info] compile·p0.50: 20803.748 ms/op
- [info] compile·p0.90: 20803.748 ms/op
- [info] compile·p0.95: 20803.748 ms/op
- [info] compile·p0.99: 20803.748 ms/op
- [info] compile·p0.999: 20803.748 ms/op
- [info] compile·p0.9999: 20803.748 ms/op
- [info] compile·p1.00: 20803.748 ms/op
- [info]
- [info]
- [info]
- [info] Result "scala.tools.nsc.HotScalacBenchmark.compile":
- [info] N = 8
- [info] mean = 21055.406 ±(99.9%) 1114.899 ms/op
- [info]
- [info] Histogram, ms/op:
- [info] [20000.000, 20125.000) = 1
- [info] [20125.000, 20250.000) = 0
- [info] [20250.000, 20375.000) = 1
- [info] [20375.000, 20500.000) = 0
- [info] [20500.000, 20625.000) = 0
- [info] [20625.000, 20750.000) = 0
- [info] [20750.000, 20875.000) = 1
- [info] [20875.000, 21000.000) = 0
- [info] [21000.000, 21125.000) = 0
- [info] [21125.000, 21250.000) = 2
- [info] [21250.000, 21375.000) = 0
- [info] [21375.000, 21500.000) = 1
- [info] [21500.000, 21625.000) = 1
- [info] [21625.000, 21750.000) = 1
- [info] [21750.000, 21875.000) = 0
- [info]
- [info] Percentiles, ms/op:
- [info] p(0.0000) = 20099.105 ms/op
- [info] p(50.0000) = 21206.401 ms/op
- [info] p(90.0000) = 21709.718 ms/op
- [info] p(95.0000) = 21709.718 ms/op
- [info] p(99.0000) = 21709.718 ms/op
- [info] p(99.9000) = 21709.718 ms/op
- [info] p(99.9900) = 21709.718 ms/op
- [info] p(99.9990) = 21709.718 ms/op
- [info] p(99.9999) = 21709.718 ms/op
- [info] p(100.0000) = 21709.718 ms/op
- [info]
- [info]
- [info] # Run complete. Total time: 00:08:19
- [info]
- [info] Benchmark (corpusVersion) (extraArgs) (source) Mode Cnt Score Error Units
- [info] HotScalacBenchmark.compile latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 8 21055.406 ± 1114.899 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 20099.105 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.50 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21206.401 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.90 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21709.718 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.95 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21709.718 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.99 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21709.718 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21709.718 ms/op
- [info] HotScalacBenchmark.compile:compile·p0.9999 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21709.718 ms/op
- [info] HotScalacBenchmark.compile:compile·p1.00 latest @/home/benchmarks/experiments/circe/modules/tests/jvm/target/test-with-classes-dir.args sample 21709.718 ms/op
- [success] Total time: 517 s, completed Feb 5, 2018 2:33:20 AM
- benchmarks@lamppc8:~/experiments/compiler-benchmark$
Add Comment
Please, Sign In to add comment