Advertisement
Guest User

DLBoff

a guest
Apr 30th, 2015
269
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 35.77 KB | None | 0 0
  1. Log file opened on Thu Apr 30 12:00:44 2015
  2. Host: nid01946 pid: 23523 rank ID: 0 number of ranks: 1024
  3. GROMACS: gmx mdrun, VERSION 5.0.2
  4.  
  5. GROMACS is written by:
  6. Emile Apol Rossen Apostolov Herman J.C. Berendsen Par Bjelkmar
  7. Aldert van Buuren Rudi van Drunen Anton Feenstra Sebastian Fritsch
  8. Gerrit Groenhof Christoph Junghans Peter Kasson Carsten Kutzner
  9. Per Larsson Justin A. Lemkul Magnus Lundborg Pieter Meulenhoff
  10. Erik Marklund Teemu Murtola Szilard Pall Sander Pronk
  11. Roland Schulz Alexey Shvetsov Michael Shirts Alfons Sijbers
  12. Peter Tieleman Christian Wennberg Maarten Wolf
  13. and the project leaders:
  14. Mark Abraham, Berk Hess, Erik Lindahl, and David van der Spoel
  15.  
  16. Copyright (c) 1991-2000, University of Groningen, The Netherlands.
  17. Copyright (c) 2001-2014, The GROMACS development team at
  18. Uppsala University, Stockholm University and
  19. the Royal Institute of Technology, Sweden.
  20. check out http://www.gromacs.org for more information.
  21.  
  22. GROMACS is free software; you can redistribute it and/or modify it
  23. under the terms of the GNU Lesser General Public License
  24. as published by the Free Software Foundation; either version 2.1
  25. of the License, or (at your option) any later version.
  26.  
  27. GROMACS: gmx mdrun, VERSION 5.0.2
  28. Executable: mdrun_mpi
  29. Library dir: /sw/xk6/gromacs/5.0.2/cle5.2_gnu4.8.2/share/gromacs/top
  30. Command line:
  31. mdrun_mpi -gpu_id 000000 -npme 256 -dlb no -pin on -resethway -noconfout -v -s opt.tpr -deffnm test
  32.  
  33. Gromacs version: VERSION 5.0.2
  34. Precision: single
  35. Memory model: 64 bit
  36. MPI library: MPI
  37. OpenMP support: enabled
  38. GPU support: enabled
  39. invsqrt routine: gmx_software_invsqrt(x)
  40. SIMD instructions: AVX_128_FMA
  41. FFT library: commercial-fftw-3.3.4-fma-sse2-avx
  42. RDTSCP usage: disabled
  43. C++11 compilation: disabled
  44. TNG support: enabled
  45. Tracing support: disabled
  46. Built on: Thu Mar 12 18:27:12 EDT 2015
  47. Built by: ff1@titan-ext8 [CMAKE]
  48. Build OS/arch: Linux 3.0.101-0.46-default x86_64
  49. Build CPU vendor: AuthenticAMD
  50. Build CPU brand: AMD Opteron(tm) Processor 6140
  51. Build CPU family: 16 Model: 9 Stepping: 1
  52. Build CPU features: apic clfsh cmov cx8 cx16 htt lahf_lm misalignsse mmx msr nonstop_tsc pdpe1gb popcnt pse rdtscp sse2 sse3 sse4a
  53. C compiler: /opt/cray/craype/2.2.1/bin/cc GNU 4.8.2
  54. C compiler flags: -mavx -mfma4 -mxop -Wno-maybe-uninitialized -Wextra -Wno-missing-field-initializers -Wno-sign-compare -Wpointer-arith -Wall -Wno-unused -Wunused-value -Wunused-parameter -O3 -DNDEBUG -fomit-frame-pointer -funroll-all-loops -fexcess-precision=fast -Wno-array-bounds
  55. C++ compiler: /opt/cray/craype/2.2.1/bin/CC GNU 4.8.2
  56. C++ compiler flags: -mavx -mfma4 -mxop -Wextra -Wno-missing-field-initializers -Wpointer-arith -Wall -Wno-unused-function -O3 -DNDEBUG -fomit-frame-pointer -funroll-all-loops -fexcess-precision=fast -Wno-array-bounds
  57. Boost version: 1.55.0 (internal)
  58. CUDA compiler: /opt/nvidia/cudatoolkit/5.5.51-1.0502.9594.3.1/bin/nvcc nvcc: NVIDIA (R) Cuda compiler driver;Copyright (c) 2005-2013 NVIDIA Corporation;Built on Thu_Mar__6_02:21:19_PST_2014;Cuda compilation tools, release 5.5, V5.5.0
  59. CUDA compiler flags:-gencode;arch=compute_20,code=sm_20;-gencode;arch=compute_20,code=sm_21;-gencode;arch=compute_30,code=sm_30;-gencode;arch=compute_35,code=sm_35;-gencode;arch=compute_35,code=compute_35;-use_fast_math;; ;-mavx;-mfma4;-mxop;-Wextra;-Wno-missing-field-initializers;-Wpointer-arith;-Wall;-Wno-unused-function;-O3;-DNDEBUG;-fomit-frame-pointer;-funroll-all-loops;-fexcess-precision=fast;-Wno-array-bounds;
  60. CUDA driver: 5.50
  61. CUDA runtime: 5.50
  62.  
  63.  
  64.  
  65. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  66. B. Hess and C. Kutzner and D. van der Spoel and E. Lindahl
  67. GROMACS 4: Algorithms for highly efficient, load-balanced, and scalable
  68. molecular simulation
  69. J. Chem. Theory Comput. 4 (2008) pp. 435-447
  70. -------- -------- --- Thank You --- -------- --------
  71.  
  72.  
  73. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  74. D. van der Spoel, E. Lindahl, B. Hess, G. Groenhof, A. E. Mark and H. J. C.
  75. Berendsen
  76. GROMACS: Fast, Flexible and Free
  77. J. Comp. Chem. 26 (2005) pp. 1701-1719
  78. -------- -------- --- Thank You --- -------- --------
  79.  
  80.  
  81. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  82. E. Lindahl and B. Hess and D. van der Spoel
  83. GROMACS 3.0: A package for molecular simulation and trajectory analysis
  84. J. Mol. Mod. 7 (2001) pp. 306-317
  85. -------- -------- --- Thank You --- -------- --------
  86.  
  87.  
  88. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  89. H. J. C. Berendsen, D. van der Spoel and R. van Drunen
  90. GROMACS: A message-passing parallel molecular dynamics implementation
  91. Comp. Phys. Comm. 91 (1995) pp. 43-56
  92. -------- -------- --- Thank You --- -------- --------
  93.  
  94.  
  95. Number of hardware threads detected (16) does not match the number reported by OpenMP (1).
  96. Consider setting the launch configuration manually!
  97. Changing nstlist from 20 to 40, rlist from 1.2 to 1.239
  98.  
  99. Input Parameters:
  100. integrator = md
  101. tinit = 0
  102. dt = 0.002
  103. nsteps = 10000
  104. init-step = 0
  105. simulation-part = 1
  106. comm-mode = Linear
  107. nstcomm = 100
  108. bd-fric = 0
  109. ld-seed = 60975668
  110. emtol = 10
  111. emstep = 0.01
  112. niter = 20
  113. fcstep = 0
  114. nstcgsteep = 1000
  115. nbfgscorr = 10
  116. rtpi = 0.05
  117. nstxout = 5000
  118. nstvout = 5000
  119. nstfout = 5000
  120. nstlog = 1000
  121. nstcalcenergy = 100
  122. nstenergy = 1000
  123. nstxout-compressed = 0
  124. compressed-x-precision = 1000
  125. cutoff-scheme = Verlet
  126. nstlist = 40
  127. ns-type = Grid
  128. pbc = xyz
  129. periodic-molecules = FALSE
  130. verlet-buffer-tolerance = 0.005
  131. rlist = 1.239
  132. rlistlong = 1.239
  133. nstcalclr = 20
  134. coulombtype = PME
  135. coulomb-modifier = Potential-shift
  136. rcoulomb-switch = 0
  137. rcoulomb = 1.2
  138. epsilon-r = 1
  139. epsilon-rf = inf
  140. vdw-type = Cut-off
  141. vdw-modifier = Force-switch
  142. rvdw-switch = 1
  143. rvdw = 1.2
  144. DispCorr = No
  145. table-extension = 1
  146. fourierspacing = 0.12
  147. fourier-nx = 144
  148. fourier-ny = 144
  149. fourier-nz = 64
  150. pme-order = 4
  151. ewald-rtol = 1e-05
  152. ewald-rtol-lj = 0.001
  153. lj-pme-comb-rule = Geometric
  154. ewald-geometry = 0
  155. epsilon-surface = 0
  156. implicit-solvent = No
  157. gb-algorithm = Still
  158. nstgbradii = 1
  159. rgbradii = 1
  160. gb-epsilon-solvent = 80
  161. gb-saltconc = 0
  162. gb-obc-alpha = 1
  163. gb-obc-beta = 0.8
  164. gb-obc-gamma = 4.85
  165. gb-dielectric-offset = 0.009
  166. sa-algorithm = Ace-approximation
  167. sa-surface-tension = 2.05016
  168. tcoupl = Nose-Hoover
  169. nsttcouple = 20
  170. nh-chain-length = 1
  171. print-nose-hoover-chain-variables = FALSE
  172. pcoupl = Parrinello-Rahman
  173. pcoupltype = Semiisotropic
  174. nstpcouple = 20
  175. tau-p = 5
  176. compressibility (3x3):
  177. compressibility[ 0]={ 4.50000e-05, 0.00000e+00, 0.00000e+00}
  178. compressibility[ 1]={ 0.00000e+00, 4.50000e-05, 0.00000e+00}
  179. compressibility[ 2]={ 0.00000e+00, 0.00000e+00, 4.50000e-05}
  180. ref-p (3x3):
  181. ref-p[ 0]={ 1.00000e+00, 0.00000e+00, 0.00000e+00}
  182. ref-p[ 1]={ 0.00000e+00, 1.00000e+00, 0.00000e+00}
  183. ref-p[ 2]={ 0.00000e+00, 0.00000e+00, 1.00000e+00}
  184. refcoord-scaling = COM
  185. posres-com (3):
  186. posres-com[0]= 0.00000e+00
  187. posres-com[1]= 0.00000e+00
  188. posres-com[2]= 0.00000e+00
  189. posres-comB (3):
  190. posres-comB[0]= 0.00000e+00
  191. posres-comB[1]= 0.00000e+00
  192. posres-comB[2]= 0.00000e+00
  193. QMMM = FALSE
  194. QMconstraints = 0
  195. QMMMscheme = 0
  196. MMChargeScaleFactor = 1
  197. qm-opts:
  198. ngQM = 0
  199. constraint-algorithm = Lincs
  200. continuation = TRUE
  201. Shake-SOR = FALSE
  202. shake-tol = 0.0001
  203. lincs-order = 4
  204. lincs-iter = 1
  205. lincs-warnangle = 30
  206. nwall = 0
  207. wall-type = 9-3
  208. wall-r-linpot = -1
  209. wall-atomtype[0] = -1
  210. wall-atomtype[1] = -1
  211. wall-density[0] = 0
  212. wall-density[1] = 0
  213. wall-ewald-zfac = 3
  214. pull = no
  215. rotation = FALSE
  216. interactiveMD = FALSE
  217. disre = No
  218. disre-weighting = Conservative
  219. disre-mixed = FALSE
  220. dr-fc = 1000
  221. dr-tau = 0
  222. nstdisreout = 100
  223. orire-fc = 0
  224. orire-tau = 0
  225. nstorireout = 100
  226. free-energy = no
  227. cos-acceleration = 0
  228. deform (3x3):
  229. deform[ 0]={ 0.00000e+00, 0.00000e+00, 0.00000e+00}
  230. deform[ 1]={ 0.00000e+00, 0.00000e+00, 0.00000e+00}
  231. deform[ 2]={ 0.00000e+00, 0.00000e+00, 0.00000e+00}
  232. simulated-tempering = FALSE
  233. E-x:
  234. n = 0
  235. E-xt:
  236. n = 0
  237. E-y:
  238. n = 0
  239. E-yt:
  240. n = 0
  241. E-z:
  242. n = 0
  243. E-zt:
  244. n = 0
  245. swapcoords = no
  246. adress = FALSE
  247. userint1 = 0
  248. userint2 = 0
  249. userint3 = 0
  250. userint4 = 0
  251. userreal1 = 0
  252. userreal2 = 0
  253. userreal3 = 0
  254. userreal4 = 0
  255. grpopts:
  256. nrdf: 261777 192987
  257. ref-t: 303.15 303.15
  258. tau-t: 1 1
  259. annealing: No No
  260. annealing-npoints: 0 0
  261. acc: 0 0 0
  262. nfreeze: N N N
  263. energygrp-flags[ 0]: 0
  264.  
  265. Initializing Domain Decomposition on 1024 ranks
  266. Dynamic load balancing: no
  267. Will sort the charge groups at every domain (re)decomposition
  268. Initial maximum inter charge-group distances:
  269. two-body bonded interactions: 0.420 nm, LJ-14, atoms 42821 42830
  270. multi-body bonded interactions: 0.420 nm, Proper Dih., atoms 42821 42830
  271. Minimum cell size due to bonded interactions: 0.462 nm
  272. Maximum distance for 5 constraints, at 120 deg. angles, all-trans: 0.222 nm
  273. Estimated maximum distance required for P-LINCS: 0.222 nm
  274. Using 256 separate PME ranks, per user request
  275. To account for pressure scaling, scaling the initial minimum size with 1.05
  276. Optimizing the DD grid for 768 cells with a minimum initial size of 0.485 nm
  277. The maximum allowed number of cells is: X 33 Y 33 Z 15
  278. Domain decomposition grid 16 x 16 x 3, separate PME ranks 256
  279. PME domain decomposition: 16 x 16 x 1
  280. Interleaving PP and PME ranks
  281. This rank does only particle-particle work.
  282.  
  283. Domain decomposition rank 0, coordinates 0 0 0
  284.  
  285. Using two step summing over 128 groups of on average 6.0 ranks
  286.  
  287. Using 1024 MPI processes
  288. Using 2 OpenMP threads per MPI process
  289.  
  290. Detecting CPU SIMD instructions.
  291. Present hardware specification:
  292. Vendor: AuthenticAMD
  293. Brand: AMD Opteron(TM) Processor 6274
  294. Family: 21 Model: 1 Stepping: 2
  295. Features: aes apic avx clfsh cmov cx8 cx16 fma4 htt lahf_lm misalignsse mmx msr nonstop_tsc pclmuldq pdpe1gb popcnt pse rdtscp sse2 sse3 sse4a sse4.1 sse4.2 ssse3 xop
  296. SIMD instructions most likely to fit this hardware: AVX_128_FMA
  297. SIMD instructions selected at GROMACS compile time: AVX_128_FMA
  298.  
  299.  
  300. The current CPU can measure timings more accurately than the code in
  301. mdrun_mpi was configured to use. This might affect your simulation
  302. speed as accurate timings are needed for load-balancing.
  303. Please consider rebuilding mdrun_mpi with the GMX_USE_RDTSCP=OFF CMake option.
  304.  
  305.  
  306. 1 GPU detected on host nid01946:
  307. #0: NVIDIA Tesla K20X, compute cap.: 3.5, ECC: yes, stat: compatible
  308.  
  309. 1 GPU user-selected for this run.
  310. Mapping of GPUs to the 6 PP ranks in this node: #0, #0, #0, #0, #0, #0
  311.  
  312. NOTE: You assigned GPUs to multiple MPI processes.
  313. Will do PME sum in reciprocal space for electrostatic interactions.
  314.  
  315. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  316. U. Essmann, L. Perera, M. L. Berkowitz, T. Darden, H. Lee and L. G. Pedersen
  317. A smooth particle mesh Ewald method
  318. J. Chem. Phys. 103 (1995) pp. 8577-8592
  319. -------- -------- --- Thank You --- -------- --------
  320.  
  321. Will do ordinary reciprocal space Ewald sum.
  322. Using a Gaussian width (1/beta) of 0.384195 nm for Ewald
  323. Cut-off's: NS: 1.239 Coulomb: 1.2 LJ: 1.2
  324. System total charge: 0.000
  325. Generated table with 1119 data points for Ewald.
  326. Tabscale = 500 points/nm
  327. Generated table with 1119 data points for LJ6Shift.
  328. Tabscale = 500 points/nm
  329. Generated table with 1119 data points for LJ12Shift.
  330. Tabscale = 500 points/nm
  331. Generated table with 1119 data points for 1-4 COUL.
  332. Tabscale = 500 points/nm
  333. Generated table with 1119 data points for 1-4 LJ6.
  334. Tabscale = 500 points/nm
  335. Generated table with 1119 data points for 1-4 LJ12.
  336. Tabscale = 500 points/nm
  337.  
  338. Using CUDA 8x8 non-bonded kernels
  339.  
  340. Potential shift: LJ r^-12: -2.648e-01 r^-6: -5.349e-01, Ewald -1.000e-05
  341. Initialized non-bonded Ewald correction tables, spacing: 7.82e-04 size: 1536
  342.  
  343.  
  344. Overriding thread affinity set outside mdrun_mpi
  345.  
  346. Pinning threads with an auto-selected logical core stride of 1
  347.  
  348. Initializing Parallel LINear Constraint Solver
  349.  
  350. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  351. B. Hess
  352. P-LINCS: A Parallel Linear Constraint Solver for molecular simulation
  353. J. Chem. Theory Comput. 4 (2008) pp. 116-122
  354. -------- -------- --- Thank You --- -------- --------
  355.  
  356. The number of constraints is 67980
  357. There are inter charge-group constraints,
  358. will communicate selected coordinates each lincs iteration
  359.  
  360. ++++ PLEASE READ AND CITE THE FOLLOWING REFERENCE ++++
  361. S. Miyamoto and P. A. Kollman
  362. SETTLE: An Analytical Version of the SHAKE and RATTLE Algorithms for Rigid
  363. Water Models
  364. J. Comp. Chem. 13 (1992) pp. 952-962
  365. -------- -------- --- Thank You --- -------- --------
  366.  
  367.  
  368. Linking all bonded interactions to atoms
  369. There are 739685 inter charge-group exclusions,
  370. will use an extra communication step for exclusion forces for PME
  371.  
  372. The initial number of communication pulses is: X 2 Y 2 Z 1
  373. The initial domain decomposition cell size is: X 1.00 nm Y 1.00 nm Z 2.54 nm
  374.  
  375. The maximum allowed distance for charge groups involved in interactions is:
  376. non-bonded interactions 1.239 nm
  377. (the following are initial values, they could change due to box deformation)
  378. two-body bonded interactions (-rdd) 1.239 nm
  379. multi-body bonded interactions (-rdd) 1.002 nm
  380. atoms separated by up to 5 constraints (-rcon) 1.002 nm
  381.  
  382.  
  383. Making 3D domain decomposition grid 16 x 16 x 3, home cell index 0 0 0
  384.  
  385. Center of mass motion removal mode is Linear
  386. We have the following groups for center of mass motion removal:
  387. 0: NPROT
  388. 1: SOL_ION
  389. There are: 206415 Atoms
  390. Charge group distribution at step 0: 260 264 256 284 267 281 271 280 244 252 268 272 257 272 273 277 249 272 266 276 277 254 274 274 268 261 250 275 254 277 267 280 278 273 284 275 256 295 258 271 260 268 285 271 270 272 290 248 263 287 287 263 265 262 266 267 264 272 269 260 271 273 276 243 284 244 254 282 277 279 255 288 276 258 264 261 275 258 269 298 280 261 265 259 287 253 260 254 266 282 273 275 258 257 260 262 267 269 266 261 278 270 256 271 275 254 255 254 252 275 273 273 282 270 267 270 267 267 271 265 260 282 286 265 298 266 269 271 269 294 279 271 266 293 264 254 286 264 280 274 277 262 286 274 284 277 277 281 284 253 267 274 269 262 265 277 251 282 285 271 250 271 272 290 253 251 270 248 270 271 267 285 278 279 253 275 249 278 267 268 252 286 268 245 271 262 275 271 268 274 276 270 272 260 276 251 259 272 281 273 268 279 303 265 260 284 263 263 256 262 266 275 251 267 248 256 277 252 256 263 254 266 267 277 247 265 262 258 277 247 269 277 265 247 264 281 260 267 288 280 276 270 267 276 258 283 244 262 262 267 279 260 261 283 248 282 263 286 271 296 280 269 284 276 277 254 258 286 265 263 268 259 261 280 271 274 267 280 266 267 277 271 285 283 256 277 279 264 275 281 271 280 281 266 267 288 256 286 276 243 286 269 276 270 278 257 270 262 261 269 273 284 267 285 278 270 270 257 261 264 241 284 277 269 259 275 258 259 293 263 283 282 270 268 270 286 264 268 272 266 281 260 271 287 274 265 274 262 277 274 260 273 260 257 257 282 267 283 264 277 259 268 263 263 274 258 253 274 267 271 264 262 276 255 270 263 286 277 267 254 274 277 279 259 268 261 267 261 287 264 277 274 269 262 273 278 254 277 255 246 286 270 246 272 266 262 260 264 280 282 273 264 248 276 266 269 269 262 274 260 268 268 272 261 286 253 250 274 282 276 276 266 264 271 256 268 273 262 271 261 277 255 256 265 274 280 272 258 270 266 276 262 284 262 294 258 263 240 269 276 274 283 266 268 256 260 268 273 282 257 258 267 263 271 255 285 264 265 290 270 271 271 276 288 276 267 281 264 278 263 267 264 257 279 264 246 289 267 276 280 274 257 263 259 272 262 268 261 265 286 266 275 284 254 256 265 270 267 253 264 281 261 271 284 256 252 252 261 286 271 270 263 274 267 275 267 266 273 282 259 257 273 269 286 256 264 260 270 265 281 289 252 271 275 273 283 297 269 257 253 267 262 274 258 268 254 280 264 268 271 266 285 255 271 274 262 269 294 267 274 272 266 267 285 260 252 259 268 275 276 248 282 294 278 273 267 268 266 273 272 277 282 268 286 246 272 269 273 265 280 282 275 276 270 252 264 265 253 297 278 267 264 269 275 258 273 251 260 239 271 253 295 271 264 261 274 270 274 272 251 275 263 257 245 259 260 280 266 278 274 263 266 260 268 266 247 263 261 301 275 264 268 256 270 274 256 246 258 263 273 242 280 251 287 257 257 285 261 279 267 272 279 281 248 256 269 280 269 284 257 268 263 283 264 286 276 267 261 273 272 246 274 252 266 255 271 265 268 274 288 261 275 242 262 268 264 268 282 283 281 259 286 274 268 281 272 259 277 277 264 277 256 271 287 251 261 287 252 255 278 257 273 284 279 270 288 269 263 256 271 266 275 280 262 285 259 269 270 269 264 258 262 278 275 242 275 269 270
  391. Initial temperature: 303.008 K
  392.  
  393. Started mdrun on rank 0 Thu Apr 30 12:00:46 2015
  394. Step Time Lambda
  395. 0 0.00000 0.00000
  396.  
  397. Energies (kJ/mol)
  398. Bond U-B Proper Dih. Improper Dih. LJ-14
  399. 5.27858e+04 2.89239e+05 1.51310e+05 1.50125e+03 3.17014e+04
  400. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  401. -4.55645e+05 -3.43455e+04 -1.43186e+06 8.83147e+03 -1.38648e+06
  402. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  403. 5.74416e+05 -8.12065e+05 3.03832e+02 -5.33608e+01 4.19699e-06
  404.  
  405. DD step 39 load imb.: force 29.7% pme mesh/force 17.438
  406.  
  407. step 120: timed with pme grid 144 144 64, coulomb cutoff 1.200: 166.6 M-cycles
  408. step 200: timed with pme grid 128 128 60, coulomb cutoff 1.269: 175.2 M-cycles
  409. step 280: timed with pme grid 112 112 56, coulomb cutoff 1.431: 119.9 M-cycles
  410. step 360: timed with pme grid 104 104 48, coulomb cutoff 1.586: 116.2 M-cycles
  411. step 440: timed with pme grid 96 96 44, coulomb cutoff 1.730: 114.2 M-cycles
  412. step 520: timed with pme grid 84 84 40, coulomb cutoff 1.908: 117.4 M-cycles
  413. step 600: timed with pme grid 72 72 36, coulomb cutoff 2.226: 141.5 M-cycles
  414. step 680: timed with pme grid 120 120 60, coulomb cutoff 1.336: 106.2 M-cycles
  415. step 760: timed with pme grid 120 120 56, coulomb cutoff 1.359: 118.6 M-cycles
  416. step 840: timed with pme grid 112 112 52, coulomb cutoff 1.464: 91.9 M-cycles
  417. step 920: timed with pme grid 108 108 52, coulomb cutoff 1.484: 93.5 M-cycles
  418. step 1000: timed with pme grid 104 104 52, coulomb cutoff 1.541: 94.6 M-cycles
  419. DD step 999 load imb.: force 15.9% pme mesh/force 1.410
  420.  
  421. Step Time Lambda
  422. 1000 2.00000 0.00000
  423.  
  424. Energies (kJ/mol)
  425. Bond U-B Proper Dih. Improper Dih. LJ-14
  426. 5.21345e+04 2.88625e+05 1.50659e+05 1.37270e+03 3.17588e+04
  427. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  428. -4.54459e+05 -3.70754e+04 -1.42121e+06 3.14730e+03 -1.38504e+06
  429. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  430. 5.73837e+05 -8.11208e+05 3.03526e+02 -8.36934e+01 4.18231e-06
  431.  
  432. step 1080: timed with pme grid 100 100 48, coulomb cutoff 1.603: 96.4 M-cycles
  433. step 1160: timed with pme grid 96 96 48, coulomb cutoff 1.670: 97.7 M-cycles
  434. step 1240: timed with pme grid 96 96 42, coulomb cutoff 1.812: 166.1 M-cycles
  435. step 1320: timed with pme grid 96 96 40, coulomb cutoff 1.903: 109.6 M-cycles
  436. step 1400: timed with pme grid 80 80 40, coulomb cutoff 2.004: 114.6 M-cycles
  437. step 1480: timed with pme grid 80 80 36, coulomb cutoff 2.114: 118.8 M-cycles
  438. optimal pme grid 112 112 52, coulomb cutoff 1.464
  439. DD step 1999 load imb.: force 15.9% pme mesh/force 1.470
  440.  
  441. Step Time Lambda
  442. 2000 4.00000 0.00000
  443.  
  444. Energies (kJ/mol)
  445. Bond U-B Proper Dih. Improper Dih. LJ-14
  446. 5.19854e+04 2.89192e+05 1.51105e+05 1.43011e+03 3.15647e+04
  447. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  448. -4.56618e+05 -3.52030e+04 -1.42515e+06 4.32765e+03 -1.38736e+06
  449. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  450. 5.71687e+05 -8.15675e+05 3.02389e+02 8.34893e+00 4.24018e-06
  451.  
  452. DD step 2999 load imb.: force 15.9% pme mesh/force 1.400
  453.  
  454. Step Time Lambda
  455. 3000 6.00000 0.00000
  456.  
  457. Energies (kJ/mol)
  458. Bond U-B Proper Dih. Improper Dih. LJ-14
  459. 5.16121e+04 2.87980e+05 1.50814e+05 1.36319e+03 3.16895e+04
  460. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  461. -4.56425e+05 -3.49671e+04 -1.42480e+06 4.33399e+03 -1.38840e+06
  462. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  463. 5.73973e+05 -8.14427e+05 3.03598e+02 1.20287e+02 4.18102e-06
  464.  
  465. DD step 3999 load imb.: force 17.3% pme mesh/force 1.484
  466.  
  467. Step Time Lambda
  468. 4000 8.00000 0.00000
  469.  
  470. Energies (kJ/mol)
  471. Bond U-B Proper Dih. Improper Dih. LJ-14
  472. 5.20433e+04 2.87124e+05 1.50400e+05 1.47182e+03 3.18113e+04
  473. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  474. -4.55448e+05 -3.32324e+04 -1.42930e+06 4.37165e+03 -1.39076e+06
  475. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  476. 5.72377e+05 -8.18381e+05 3.02754e+02 2.13668e+01 4.17176e-06
  477.  
  478.  
  479. step 5000: resetting all time and cycle counters
  480.  
  481. Restarted time on rank 0 Thu Apr 30 12:01:12 2015
  482. DD step 4999 load imb.: force 16.4% pme mesh/force 1.422
  483.  
  484. Step Time Lambda
  485. 5000 10.00000 0.00000
  486.  
  487. Energies (kJ/mol)
  488. Bond U-B Proper Dih. Improper Dih. LJ-14
  489. 5.16872e+04 2.88760e+05 1.51092e+05 1.43978e+03 3.19016e+04
  490. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  491. -4.56363e+05 -3.32659e+04 -1.42767e+06 4.20674e+03 -1.38821e+06
  492. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  493. 5.71527e+05 -8.16685e+05 3.02304e+02 1.64446e+02 4.19913e-06
  494.  
  495. DD step 5999 load imb.: force 18.2% pme mesh/force 1.468
  496.  
  497. Step Time Lambda
  498. 6000 12.00000 0.00000
  499.  
  500. Energies (kJ/mol)
  501. Bond U-B Proper Dih. Improper Dih. LJ-14
  502. 5.22732e+04 2.87474e+05 1.51307e+05 1.43893e+03 3.17843e+04
  503. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  504. -4.55696e+05 -3.70099e+04 -1.42417e+06 4.25554e+03 -1.38834e+06
  505. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  506. 5.74135e+05 -8.14206e+05 3.03684e+02 -5.60901e+01 4.22240e-06
  507.  
  508. DD step 6999 load imb.: force 15.9% pme mesh/force 1.454
  509.  
  510. Step Time Lambda
  511. 7000 14.00000 0.00000
  512.  
  513. Energies (kJ/mol)
  514. Bond U-B Proper Dih. Improper Dih. LJ-14
  515. 5.19503e+04 2.87643e+05 1.50784e+05 1.38757e+03 3.17938e+04
  516. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  517. -4.55690e+05 -3.62389e+04 -1.42482e+06 4.32089e+03 -1.38887e+06
  518. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  519. 5.70943e+05 -8.17924e+05 3.01995e+02 -5.96339e+01 4.19518e-06
  520.  
  521. DD step 7999 load imb.: force 18.2% pme mesh/force 1.507
  522.  
  523. Step Time Lambda
  524. 8000 16.00000 0.00000
  525.  
  526. Energies (kJ/mol)
  527. Bond U-B Proper Dih. Improper Dih. LJ-14
  528. 5.18841e+04 2.86730e+05 1.51415e+05 1.34451e+03 3.15781e+04
  529. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  530. -4.55412e+05 -3.51798e+04 -1.42895e+06 4.27413e+03 -1.39232e+06
  531. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  532. 5.70891e+05 -8.21424e+05 3.01968e+02 -7.15082e+01 4.15269e-06
  533.  
  534. DD step 8999 load imb.: force 19.5% pme mesh/force 1.403
  535.  
  536. Step Time Lambda
  537. 9000 18.00000 0.00000
  538.  
  539. Energies (kJ/mol)
  540. Bond U-B Proper Dih. Improper Dih. LJ-14
  541. 5.16824e+04 2.85526e+05 1.51395e+05 1.46127e+03 3.18591e+04
  542. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  543. -4.55749e+05 -3.72311e+04 -1.42143e+06 4.41192e+03 -1.38807e+06
  544. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  545. 5.70458e+05 -8.17613e+05 3.01739e+02 -1.93373e+02 4.17878e-06
  546.  
  547. DD step 9999 load imb.: force 57.1% pme mesh/force 1.327
  548.  
  549. Step Time Lambda
  550. 10000 20.00000 0.00000
  551.  
  552. Energies (kJ/mol)
  553. Bond U-B Proper Dih. Improper Dih. LJ-14
  554. 5.13784e+04 2.86722e+05 1.50904e+05 1.42419e+03 3.16852e+04
  555. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  556. -4.55302e+05 -3.55655e+04 -1.42845e+06 4.28195e+03 -1.39292e+06
  557. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  558. 5.71427e+05 -8.21497e+05 3.02251e+02 3.47003e+01 4.21527e-06
  559.  
  560. <====== ############### ==>
  561. <==== A V E R A G E S ====>
  562. <== ############### ======>
  563.  
  564. Statistics over 10001 steps using 101 frames
  565.  
  566. Energies (kJ/mol)
  567. Bond U-B Proper Dih. Improper Dih. LJ-14
  568. 5.19135e+04 2.87588e+05 1.50862e+05 1.42090e+03 3.16791e+04
  569. Coulomb-14 LJ (SR) Coulomb (SR) Coul. recip. Potential
  570. -4.55717e+05 -3.54011e+04 -1.42553e+06 4.27163e+03 -1.38891e+06
  571. Kinetic En. Total Energy Temperature Pressure (bar) Constr. rmsd
  572. 5.73119e+05 -8.15791e+05 3.03146e+02 -1.07888e+00 0.00000e+00
  573.  
  574. Box-X Box-Y Box-Z
  575. 1.60162e+01 1.60162e+01 7.62424e+00
  576.  
  577. Total Virial (kJ/mol)
  578. 1.86395e+05 1.30921e+03 1.26611e+02
  579. 1.30525e+03 1.86667e+05 -8.35739e+01
  580. 1.10488e+02 -1.00632e+02 2.00255e+05
  581.  
  582. Pressure (bar)
  583. 1.90159e+00 -2.20499e+01 -3.35582e+00
  584. -2.19824e+01 -2.19105e+00 4.04245e+00
  585. -3.08197e+00 4.33214e+00 -2.94717e+00
  586.  
  587. T-NPROT T-SOL_ION
  588. 3.03145e+02 3.03148e+02
  589.  
  590.  
  591. P P - P M E L O A D B A L A N C I N G
  592.  
  593. PP/PME load balancing changed the cut-off and PME settings:
  594. particle-particle PME
  595. rcoulomb rlist grid spacing 1/beta
  596. initial 1.200 nm 1.239 nm 144 144 64 0.119 nm 0.384 nm
  597. final 1.464 nm 1.503 nm 112 112 52 0.146 nm 0.469 nm
  598. cost-ratio 1.78 0.49
  599. (note that these numbers concern only part of the total PP and PME load)
  600.  
  601.  
  602. M E G A - F L O P S A C C O U N T I N G
  603.  
  604. NB=Group-cutoff nonbonded kernels NxN=N-by-N cluster Verlet kernels
  605. RF=Reaction-Field VdW=Van der Waals QSTab=quadratic-spline table
  606. W3=SPC/TIP3p W4=TIP4p (single or pairs)
  607. V&F=Potential and force V=Potential only F=Force only
  608.  
  609. Computing: M-Number M-Flops % Flops
  610. -----------------------------------------------------------------------------
  611. NB VdW [V&F] 1088.367630 1088.368 0.0
  612. Pair Search distance check 3543.037616 31887.339 0.0
  613. NxN Ewald Elec. + LJ [F] 1951171.586304 152191383.732 96.8
  614. NxN Ewald Elec. + LJ [V&F] 20102.927232 2593277.613 1.6
  615. 1,4 nonbonded interactions 1575.315000 141778.350 0.1
  616. Calc Weights 3096.844245 111486.393 0.1
  617. Spread Q Bspline 66066.010560 132132.021 0.1
  618. Gather F Bspline 66066.010560 396396.063 0.3
  619. 3D-FFT 126015.598080 1008124.785 0.6
  620. Solve PME 1003.720704 64238.125 0.0
  621. Reset In Box 26.008290 78.025 0.0
  622. CG-CoM 26.008290 78.025 0.0
  623. Bonds 212.942580 12563.612 0.0
  624. Propers 1815.312990 415706.675 0.3
  625. Impropers 5.901180 1227.445 0.0
  626. Virial 60.484725 1088.725 0.0
  627. Stop-CM 10.527165 105.272 0.0
  628. Calc-Ekin 103.413915 2792.176 0.0
  629. Lincs 428.631939 25717.916 0.0
  630. Lincs-Mat 3089.729280 12358.917 0.0
  631. Constraint-V 1432.461888 11459.695 0.0
  632. Constraint-Vir 50.382551 1209.181 0.0
  633. Settle 191.732670 61929.652 0.0
  634. -----------------------------------------------------------------------------
  635. Total 157218108.105 100.0
  636. -----------------------------------------------------------------------------
  637.  
  638.  
  639. D O M A I N D E C O M P O S I T I O N S T A T I S T I C S
  640.  
  641. av. #atoms communicated per step for force: 2 x 1538159.5
  642. av. #atoms communicated per step for LINCS: 2 x 46118.7
  643.  
  644. Average load imbalance: 22.7 %
  645. Part of the total run time spent waiting due to load imbalance: 10.2 %
  646. Average PME mesh/force load: 1.559
  647. Part of the total run time spent waiting due to PP/PME imbalance: 22.9 %
  648.  
  649. NOTE: 10.2 % of the available CPU time was lost due to load imbalance
  650. in the domain decomposition.
  651. You might want to use dynamic load balancing (option -dlb.)
  652.  
  653. NOTE: 22.9 % performance was lost because the PME ranks
  654. had more work to do than the PP ranks.
  655. You might want to increase the number of PME ranks
  656. or increase the cut-off and the grid spacing.
  657.  
  658.  
  659. R E A L C Y C L E A N D T I M E A C C O U N T I N G
  660.  
  661. On 768 MPI ranks doing PP, each using 2 OpenMP threads, and
  662. on 256 MPI ranks doing PME, each using 2 OpenMP threads
  663.  
  664. Computing: Num Num Call Wall time Giga-Cycles
  665. Ranks Threads Count (s) total sum %
  666. -----------------------------------------------------------------------------
  667. Domain decomp. 768 2 126 0.453 1532.381 3.8
  668. DD comm. load 768 2 26 0.001 2.453 0.0
  669. Send X to PME 768 2 5001 0.012 40.640 0.1
  670. Neighbor search 768 2 126 0.111 376.646 0.9
  671. Launch GPU ops. 768 2 10002 0.799 2699.791 6.7
  672. Comm. coord. 768 2 4875 0.705 2382.211 5.9
  673. Force 768 2 5001 0.695 2347.498 5.8
  674. Wait + Comm. F 768 2 5001 1.360 4596.121 11.5
  675. PME mesh * 256 2 5001 7.009 7894.546 19.7
  676. PME wait for PP * 1.900 2140.337 5.3
  677. Wait + Recv. PME F 768 2 5001 2.006 6778.703 16.9
  678. Wait GPU nonlocal 768 2 5001 0.772 2608.639 6.5
  679. Wait GPU local 768 2 5001 0.554 1872.996 4.7
  680. NB X/F buffer ops. 768 2 19752 0.293 989.738 2.5
  681. Write traj. 768 2 2 0.063 211.430 0.5
  682. Update 768 2 5001 0.092 311.436 0.8
  683. Constraints 768 2 5001 0.569 1922.314 4.8
  684. Comm. energies 768 2 251 0.360 1215.508 3.0
  685. Rest 0.064 216.195 0.5
  686. -----------------------------------------------------------------------------
  687. Total 8.909 40139.599 100.0
  688. -----------------------------------------------------------------------------
  689. (*) Note that with separate PME ranks, the walltime column actually sums to
  690. twice the total reported, but the cycle count total and % are correct.
  691. -----------------------------------------------------------------------------
  692. Breakdown of PME mesh computation
  693. -----------------------------------------------------------------------------
  694. PME redist. X/F 256 2 10002 1.230 1386.038 3.5
  695. PME spread/gather 256 2 10002 1.362 1534.361 3.8
  696. PME 3D-FFT 256 2 10002 0.476 536.491 1.3
  697. PME 3D-FFT Comm. 256 2 20004 3.880 4370.588 10.9
  698. PME solve Elec 256 2 5001 0.036 40.068 0.1
  699. -----------------------------------------------------------------------------
  700.  
  701. Core t (s) Wall t (s) (%)
  702. Time: 17141.042 8.909 192406.7
  703. (ns/day) (hour/ns)
  704. Performance: 97.003 0.247
  705. Finished mdrun on rank 0 Thu Apr 30 12:01:21 2015
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement