bash-4.2$ /u/bmbelgod/openmpi-2.0.2/x86_64/bin/mpirun -np 4 th main.lua
warning: fbcunn not found. Falling back to cunn
warning: fbcunn not found. Falling back to cunn
warning: fbcunn not found. Falling back to cunn
warning: fbcunn not found. Falling back to cunn
Initialize dlcomm
Initialize dlcomm
Initialize dlcomm
Initialize dlcomm
--------------------------------------------------------------------------
WARNING: There is at least non-excluded one OpenFabrics device found,
but there are no active ports detected (or Open MPI was unable to use
them).  This is most certainly not what you wanted.  Check your
cables, subnet manager configuration, etc.  The openib BTL will be
ignored for this job.

  Local host: dccxc266
--------------------------------------------------------------------------
[1500929256.061170] [dccxc266:24955:0]         sys.c:744  MXM  WARN  Conflicting CPU frequencies detected, using: 3291.95
[1500929256.062400] [dccxc266:24953:0]         sys.c:744  MXM  WARN  Conflicting CPU frequencies detected, using: 3350.55
[1500929256.062559] [dccxc266:24954:0]         sys.c:744  MXM  WARN  Conflicting CPU frequencies detected, using: 3350.55
[1500929256.064678] [dccxc266:24952:0]         sys.c:744  MXM  WARN  Conflicting CPU frequencies detected, using: 3350.55
[1500929256.067230] [dccxc266:24954:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.067257] [dccxc266:24954:0]         shm.c:33   MXM  WARN  Unable to close the KNEM device file
[1500929256.067399] [dccxc266:24953:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.067429] [dccxc266:24953:0]         shm.c:33   MXM  WARN  Unable to close the KNEM device file
[1500929256.067494] [dccxc266:24955:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.067520] [dccxc266:24955:0]         shm.c:33   MXM  WARN  Unable to close the KNEM device file
[1500929256.069231] [dccxc266:24952:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.071822] [dccxc266:24954:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.072493] [dccxc266:24953:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.072574] [dccxc266:24955:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[1500929256.072583] [dccxc266:24955:0]         shm.c:33   MXM  WARN  Unable to close the KNEM device file
[1500929256.072974] [dccxc266:24952:0]      ib_dev.c:676  MXM  ERROR There are no Mellanox cards detected.
[warn] Epoll ADD(4) on fd 38 failed.  Old events were 0; read change was 0 (none); write change was 1 (add): Bad file descriptor
[warn] Epoll ADD(4) on fd 33 failed.  Old events were 0; read change was 0 (none); write change was 1 (add): Bad file descriptor
[warn] Epoll ADD(4) on fd 41 failed.  Old events were 0; read change was 0 (none); write change was 1 (add): Bad file descriptor
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node dccxc266 exited on signal 13 (Broken pipe).
--------------------------------------------------------------------------
[dccxc266.pok.ibm.com:24947] 3 more processes have sent help message help-mpi-btl-openib.txt / no active ports found
[dccxc266.pok.ibm.com:24947] Set MCA parameter "orte_base_help_aggregate" to 0 to see all help / error messages