[ib2:17395] mca: base: components_register: registering framework pmix components
[ib2:17395] mca: base: components_register: found loaded component flux
[ib2:17395] mca: base: components_register: component flux register function successful
[ib2:17395] mca: base: components_register: found loaded component pmix3x
[ib2:17395] mca: base: components_register: component pmix3x register function successful
[ib2:17395] mca: base: components_open: opening pmix components
[ib2:17395] mca: base: components_open: found loaded component flux
[ib2:17395] mca: base: components_open: found loaded component pmix3x
[ib2:17395] mca: base: components_open: component pmix3x open function successful
[ib2:17395] mca:base:select: Auto-selecting pmix components
[ib2:17395] mca:base:select:( pmix) Querying component [flux]
[ib2:17395] mca:base:select:( pmix) Querying component [pmix3x]
[ib2:17395] mca:base:select:( pmix) Query of component [pmix3x] set priority to 5
[ib2:17395] mca:base:select:( pmix) Selected component [pmix3x]
[ib2:17395] mca: base: close: unloading component flux
[ib2:17395] psec: native init
[ib2:17395] pmix_register_event_hdlr shifting to progress thread
[ib2:17395] pmix: register event_hdlr with 1 infos
[ib2:17395] pmix: _add_hdlr
[ib2:17395] PMIX server errreg_cbfunc - error handler registered status=0, reference=0
[ib2:17395] mca_base_component_repository_open: unable to open mca_oob_ud: libmca_common_verbs.so.0: cannot open shared object file: No such file or directory (ignored)
[ib2:17395] HASH:STORE rank 0 key opal.puri
[ib2:17395] HASH:STORE rank 0 key opal.puri
[ib2:17395] HASH:STORE rank 0 key opal.puri
[ib2:17395] [[32836,0],0] setup application for job [32836,1]
[ib2:17395] HASH:STORE rank -2 key pmix.srv.nspace
[ib2:17395] HASH:STORE rank -2 key pmix.srv.rank
[ib2:17395] HASH:STORE rank -2 key pmix.jobid
[ib2:17395] HASH:STORE rank -2 key pmix.offset
[ib2:17395] pmix:extract:nodes: checking list: ib[1:2]
[ib2:17395] regex:extract:nodes: parsing range ib 2 (null)
[ib2:17395] regex:parse:ranges: parse range 2 (2)
[ib2:17395] HASH:FETCH rank -2 key ib2
[ib2:17395] HASH:FETCH data for key ib2 not found
[ib2:17395] HASH:STORE rank -2 key ib2
[ib2:17395] HASH:STORE rank 0 key pmix.hname
[ib2:17395] HASH:STORE rank -2 key pmix.nlist
[ib2:17395] HASH:STORE rank -2 key pmix.nodeid
[ib2:17395] HASH:STORE rank -2 key pmix.node.size
[ib2:17395] HASH:STORE rank -2 key pmix.num.nodes
[ib2:17395] HASH:STORE rank -2 key pmix.univ.size
[ib2:17395] HASH:STORE rank -2 key pmix.job.size
[ib2:17395] HASH:STORE rank -2 key pmix.job.napps
[ib2:17395] HASH:STORE rank -2 key pmix.local.size
[ib2:17395] HASH:STORE rank -2 key pmix.max.size
[ib2:17395] HASH:STORE rank -2 key pmix.toposig
[ib2:17395] HASH:STORE rank -2 key pmix.pmem
[ib2:17395] HASH:STORE rank -2 key pmix.mapby
[ib2:17395] HASH:STORE rank -2 key pmix.rankby
[ib2:17395] HASH:STORE rank -2 key pmix.bindto
[ib2:17395] HASH:STORE rank -2 key pmix.lpeers
[ib2:17395] HASH:STORE rank -2 key pmix.lldr
[ib2:17395] HASH:STORE rank 0 key pmix.locstr
[ib2:17395] HASH:STORE rank 0 key pmix.grank
[ib2:17395] HASH:STORE rank 0 key pmix.lrank
[ib2:17395] HASH:STORE rank 0 key pmix.nrank
[ib2:17395] HASH:STORE rank 0 key pmix.nodeid
[ib2:17395] HASH:STORE rank 0 key pmix.hname
[ib2:17395] HASH:STORE rank -2 key pmix.srvr.tmpdir
[ib2:17395] HASH:STORE rank -2 key pmix.sing.listnr
[ib2:17395] HASH:STORE rank -2 key pmix.srv.monitor
[ib2:17424] mca: base: components_register: registering framework pmix components
[ib2:17424] mca: base: components_register: found loaded component flux
[ib2:17424] mca: base: components_register: component flux register function successful
[ib2:17424] mca: base: components_register: found loaded component pmix3x
[ib2:17424] mca: base: components_register: component pmix3x register function successful
[ib2:17424] mca: base: components_open: opening pmix components
[ib2:17424] mca: base: components_open: found loaded component flux
[ib2:17424] mca: base: components_open: found loaded component pmix3x
[ib2:17424] mca: base: components_open: component pmix3x open function successful
[ib2:17424] mca:base:select: Auto-selecting pmix components
[ib2:17424] mca:base:select:( pmix) Querying component [flux]
[ib2:17424] mca:base:select:( pmix) Querying component [pmix3x]
[ib2:17424] mca:base:select:( pmix) Query of component [pmix3x] set priority to 100
[ib2:17424] mca:base:select:( pmix) Selected component [pmix3x]
[ib2:17424] mca: base: close: unloading component flux
[ib2:17424] PMIx_client initialized
[ib2:17424] PMIx_client init
[ib2:17424] psec: native init
[ib2:17395] HASH:STORE rank -2 key pmix.bfrops.mod
[ib2:17395] psec: native validate_cred NON-NULL
[ib2:17395] psec: socket cred contains invalid gid 0
[ib2:17395] validation of credential failed: INVALID-CREDENTIAL
[ib2:17424] PMIX ERROR: ERROR STRING NOT FOUND in file ptl_tcp.c at line 692
[ib2:17424] OPAL ERROR: Unreachable in file pmix3x_client.c at line 113
*** An error occurred in MPI_Init
*** on a NULL communicator
*** MPI_ERRORS_ARE_FATAL (processes in this communicator will now abort,
***    and potentially your MPI job)
[ib2:17424] Local abort before MPI_INIT completed completed successfully, but am not able to aggregate error messages, and not able to guarantee that all other processes were killed!
2018/07/04 11:44:36 Application exiten with an error: exit status 1
[ib2:17395] sys call unlink(2) fail
[ib2:17395] mca: base: close: component pmix3x closed
[ib2:17395] mca: base: close: unloading component pmix3x