Untitled

18:09 $ srun --partition=debug -n 1 -C  gpu nvprof ./standalone 2>&1
srun: job 3072504 queued and waiting for resources
srun: job 3072504 has been allocated resources
==13549== NVPROF is profiling process 13549, command: ./standalone

     + + + + + + + + + + + + + + + +
     + RUNNING IN DOUBLE PRECISION +
     + + + + + + + + + + + + + + + +


 STANDALONE PHYSICS
 RUNNING ON CPU
 RADIATION TEST

 Iteration    1
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    2
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    3
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    4
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    5
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    6
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    7
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    8
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration    9
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   10
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   11
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   12
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   13
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   14
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   15
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   16
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   17
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   18
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   19
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Iteration   20
  Initialize test
 *****************************************************
 *   Radiative transfer calculations employ data     *
 *        provided in routine rad_aibi               *
 *****************************************************
  Run test
  Finalize test
 Domain size, ie,je,ke :   80  60  60
 nproma : 4800
 data_set type :full
 --------------------------------------------------------------------------
  Local timers:
   NCOMP_PE=    1
 --------------------------------------------------------------------------
  Id      Tag           Ncalls         min[s]        max[s]       mean[s]
   1        Total Phys      20       38.7180       38.7180       38.7180
   2        Copy block      40        0.4620        0.4620        0.4620
   3         Radiation      20       38.1320       38.1320       38.1320
 --------------------------------------------------------------------------
==13549== Profiling application: ./standalone
==13549== Profiling result:
Time(%)      Time     Calls       Avg       Min       Max  Name
 52.69%  4.51365s       939  4.8069ms  4.3888ms  13.610ms  FUNC___radiation_rg_MOD_inv_th_SCOP_0_KERNEL_1
 37.38%  3.20151s       580  5.5199ms  4.9234ms  5.7884ms  FUNC___radiation_rg_MOD_inv_so_SCOP_0_KERNEL_1
  5.03%  431.26ms       939  459.27us  109.92us  4.0699ms  FUNC___radiation_rg_MOD_inv_th_SCOP_0_KERNEL_0
  4.89%  419.19ms       580  722.74us  167.26us  4.4472ms  FUNC___radiation_rg_MOD_inv_so_SCOP_0_KERNEL_0

==13549== Unified Memory profiling result:
Device "Tesla P100-PCIE-16GB (0)"
   Count  Avg Size  Min Size  Max Size  Total Size  Total Time  Name
  244881  79.296KB  4.0000KB  0.9961MB  18.51860GB   1.884778s  Host To Device
  131025  142.66KB  4.0000KB  0.9961MB  17.82590GB   1.545198s  Device To Host
   81529         -         -         -           -   2.317428s  GPU Page fault groups
Total CPU Page faults: 74682

==13549== API calls:
Time(%)      Time     Calls       Avg       Min       Max  Name
 90.92%  8.61936s     32341  266.52us  1.7020us  17.607ms  cuCtxSynchronize
  3.51%  332.31ms      3292  100.94us     169ns  20.427ms  cudaMallocManaged
  2.95%  279.97ms         1  279.97ms  279.97ms  279.97ms  cuCtxCreate
  1.57%  148.78ms      3226  46.117us  5.0880us  400.47us  cudaFree
  0.54%  50.846ms      3038  16.736us  5.1160us  92.572us  cuLaunchKernel
  0.44%  42.163ms         4  10.541ms  8.6314ms  15.602ms  cuLinkAddData
  0.04%  4.0243ms         4  1.0061ms  24.839us  3.9388ms  cuLinkCreate
  0.01%  1.1808ms         4  295.21us  197.69us  407.42us  cuModuleLoadData
  0.01%  1.0407ms         4  260.18us  222.89us  289.28us  cuLinkComplete
  0.00%  384.00us         1  384.00us  384.00us  384.00us  cuDeviceTotalMem
  0.00%  199.14us        91  2.1880us     117ns  77.475us  cuDeviceGetAttribute
  0.00%  42.899us         2  21.449us  21.220us  21.679us  cuDeviceGetName
  0.00%  6.2270us         4  1.5560us     350ns  4.9160us  cuLinkDestroy
  0.00%  2.7970us         4     699ns     239ns  1.8740us  cuDeviceGetCount
  0.00%  2.7490us         4     687ns     601ns     788ns  cuModuleGetFunction
  0.00%  1.1210us         4     280ns     169ns     536ns  cuDeviceGet
  0.00%     600ns         1     600ns     600ns     600ns  cuInit
  0.00%     580ns         1     580ns     580ns     580ns  cuDriverGetVersion
  0.00%     292ns         1     292ns     292ns     292ns  cuDeviceComputeCapability
  0.00%     240ns         1     240ns     240ns     240ns  cuCtxGetCurrent