BATCH SIZE 1
GPU Utilization ~30%

Avg. Time Batch Preparation: 0.000 seconds
Avg. Time Train Operation:   0.009 seconds
Avg. Time Total per Batch:   0.009 seconds (116.07 samples/second)

BATCH SIZE 16
GPU Utilization ~20%

Avg. Time Batch Preparation: 0.001 seconds
Avg. Time Train Operation:   0.016 seconds
Avg. Time Total per Batch:   0.017 seconds (952.84 samples/second)

BATCH SIZE 32
GPU Utilization ~18%

Avg. Time Batch Preparation: 0.001 seconds
Avg. Time Train Operation:   0.021 seconds
Avg. Time Total per Batch:   0.023 seconds (1411.72 samples/second)

BATCH SIZE 64
GPU Utiliztion ~18%


Avg. Time Batch Preparation: 0.002 seconds
Avg. Time Train Operation:   0.036 seconds
Avg. Time Total per Batch:   0.038 seconds (1664.25 samples/second)


BATCH SIZE 128
GPU Utilization ~15%

Avg. Time Batch Preparation: 0.005 seconds
Avg. Time Train Operation:   0.066 seconds
Avg. Time Total per Batch:   0.071 seconds (1799.96 samples/second)


BATCH SIZE 256
GPU Utiliztion ~15%

Avg. Time Batch Preparation: 0.009 seconds
Avg. Time Train Operation:   0.123 seconds
Avg. Time Total per Batch:   0.132 seconds (1937.47 samples/second)