API tools faq
paste
Advertisement
amsheppard1980

HPV00 mthca Port 0 to HPV01 mthca Port 1

amsheppard1980
Aug 20th, 2016
137
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 10.65 KB | None | 0 0
raw download clone embed print report
  1. root@hpv00:~# service opensm restart && service opensm status
  2. ● opensm.service - LSB: Start opensm subnet manager.
  3. Loaded: loaded (/etc/init.d/opensm)
  4. Active: active (running) since Sat 2016-08-20 10:05:24 ADT; 6ms ago
  5. Process: 2616 ExecStop=/etc/init.d/opensm stop (code=exited, status=0/SUCCESS)
  6. Process: 2623 ExecStart=/etc/init.d/opensm start (code=exited, status=0/SUCCESS)
  7. CGroup: /system.slice/opensm.service
  8. ├─2628 /usr/sbin/opensm -g 0x0002c90200223ac9 -f /var/log/opensm.0x0002c90200223ac9.log
  9. └─2631 /usr/sbin/opensm -g 0x0002c90200223aca -f /var/log/opensm.0x0002c90200223aca.log
  10.  
  11. Aug 20 10:05:24 hpv00 OpenSM[2628]: Entering DISCOVERING state
  12. Aug 20 10:05:24 hpv00 opensm[2623]: Starting opensm on 0x0002c90200223aca:
  13. Aug 20 10:05:24 hpv00 OpenSM[2631]: Loading Cached Option:guid = 0x0002c90200223ac9
  14. Aug 20 10:05:24 hpv00 OpenSM[2631]: Loading Cached Option:sweep_interval = 5
  15. Aug 20 10:05:24 hpv00 OpenSM[2631]: Loading Cached Option:reassign_lids = TRUE
  16. Aug 20 10:05:24 hpv00 OpenSM[2631]: Loading Cached Option:force_heavy_sweep = TRUE
  17. Aug 20 10:05:24 hpv00 OpenSM[2631]: Loading Cached Option:sm_priority = 15
  18. Aug 20 10:05:24 hpv00 OpenSM[2631]: /var/log/opensm.0x0002c90200223aca.log log file opened
  19. Aug 20 10:05:24 hpv00 OpenSM[2631]: OpenSM 3.3.18
  20. Aug 20 10:05:24 hpv00 OpenSM[2631]: Entering DISCOVERING state
  21. root@hpv00:~# cat /var/log/opensm.0x0002c90200223aca.log
  22. Aug 20 10:05:24 458428 [8DCEF700] 0x03 -> OpenSM 3.3.18
  23. Aug 20 10:05:24 458469 [8DCEF700] 0x80 -> OpenSM 3.3.18
  24. Aug 20 10:05:24 458931 [8DCEF700] 0x02 -> osm_vendor_init: 1000 pending umads specified
  25. Aug 20 10:05:24 459061 [8DCEF700] 0x80 -> Entering DISCOVERING state
  26. Aug 20 10:05:24 459179 [8DCEF700] 0x02 -> osm_vendor_bind: Mgmt class 0x81 binding to port GUID 0x2c90200223aca
  27. Aug 20 10:05:24 487283 [8DCEF700] 0x02 -> osm_vendor_bind: Mgmt class 0x03 binding to port GUID 0x2c90200223aca
  28. Aug 20 10:05:24 487432 [8DCEF700] 0x02 -> osm_vendor_bind: Mgmt class 0x04 binding to port GUID 0x2c90200223aca
  29. Aug 20 10:05:24 487524 [8DCEF700] 0x02 -> osm_vendor_bind: Mgmt class 0x21 binding to port GUID 0x2c90200223aca
  30. Aug 20 10:05:24 487630 [8DCEF700] 0x02 -> osm_opensm_bind: Setting IS_SM on port 0x0002c90200223aca
  31. Aug 20 10:05:24 488665 [876B2700] 0x80 -> SM port is down
  32. root@hpv00:~# echo "### hpv00 port 0 connected to hp01 port 1 #####" && echo "### report from hpv00 #####" && ibstatus && ibstat && ibv_devinfo && iblinkinfo && lspci -Qvvs 0a:00.0
  33. ### hpv00 port 0 connected to hp01 port 1 #####
  34. ### report from hpv00 #####
  35. Infiniband device 'mthca0' port 1 status:
  36. default gid: fe80:0000:0000:0000:0002:c902:0022:3ac9
  37. base lid: 0x1
  38. sm lid: 0x1
  39. state: 4: ACTIVE
  40. phys state: 5: LinkUp
  41. rate: 10 Gb/sec (4X)
  42. link_layer: InfiniBand
  43.  
  44. Infiniband device 'mthca0' port 2 status:
  45. default gid: fe80:0000:0000:0000:0002:c902:0022:3aca
  46. base lid: 0x2
  47. sm lid: 0x1
  48. state: 1: DOWN
  49. phys state: 2: Polling
  50. rate: 10 Gb/sec (4X)
  51. link_layer: InfiniBand
  52.  
  53. CA 'mthca0'
  54. CA type: MT25208
  55. Number of ports: 2
  56. Firmware version: 5.3.0
  57. Hardware version: 20
  58. Node GUID: 0x0002c90200223ac8
  59. System image GUID: 0x0002c90200223acb
  60. Port 1:
  61. State: Active
  62. Physical state: LinkUp
  63. Rate: 10
  64. Base lid: 1
  65. LMC: 0
  66. SM lid: 1
  67. Capability mask: 0x02510a6a
  68. Port GUID: 0x0002c90200223ac9
  69. Link layer: InfiniBand
  70. Port 2:
  71. State: Down
  72. Physical state: Polling
  73. Rate: 10
  74. Base lid: 2
  75. LMC: 0
  76. SM lid: 1
  77. Capability mask: 0x02510a6a
  78. Port GUID: 0x0002c90200223aca
  79. Link layer: InfiniBand
  80. hca_id: mthca0
  81. transport: InfiniBand (0)
  82. fw_ver: 5.3.0
  83. node_guid: 0002:c902:0022:3ac8
  84. sys_image_guid: 0002:c902:0022:3acb
  85. vendor_id: 0x02c9
  86. vendor_part_id: 25218
  87. hw_ver: 0x20
  88. board_id: MT_0370130002
  89. phys_port_cnt: 2
  90. port: 1
  91. state: PORT_ACTIVE (4)
  92. max_mtu: 2048 (4)
  93. active_mtu: 2048 (4)
  94. sm_lid: 1
  95. port_lid: 1
  96. port_lmc: 0x00
  97. link_layer: InfiniBand
  98.  
  99. port: 2
  100. state: PORT_DOWN (1)
  101. max_mtu: 2048 (4)
  102. active_mtu: 2048 (4)
  103. sm_lid: 1
  104. port_lid: 2
  105. port_lmc: 0x00
  106. link_layer: InfiniBand
  107.  
  108. CA: MT25218 InfiniHostEx Mellanox Technologies:
  109. 0x0002c9020022371a 2 2[ ] ==( 4X 2.5 Gbps Active/ LinkUp)==> 1 1[ ] "MT25218 InfiniHostEx Mellanox Technologies" ( Could be 5.0 Gbps)
  110. CA: MT25218 InfiniHostEx Mellanox Technologies:
  111. 0x0002c90200223ac9 1 1[ ] ==( 4X 2.5 Gbps Active/ LinkUp)==> 2 2[ ] "MT25218 InfiniHostEx Mellanox Technologies" ( Could be 5.0 Gbps)
  112. 0a:00.0 InfiniBand: Mellanox Technologies MT25208 [InfiniHost III Ex] (rev 20)
  113. Subsystem: Mellanox Technologies MT25208 [InfiniHost III Ex]
  114. Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
  115. Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
  116. Latency: 0, Cache Line Size: 64 bytes
  117. Interrupt: pin A routed to IRQ 16
  118. Region 0: Memory at fc300000 (64-bit, non-prefetchable) [size=1M]
  119. Region 2: Memory at d8000000 (64-bit, prefetchable) [size=8M]
  120. Capabilities: [40] Power Management version 2
  121. Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
  122. Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
  123. Capabilities: [48] Vital Product Data
  124. Product Name: Lion mini DDR
  125. Read-only fields:
  126. [PN] Part number: MHGA28-XTC
  127. [EC] Engineering changes: A3
  128. [SN] Serial number: MT0627X00390
  129. [V0] Vendor specific: PCIe x8
  130. [RV] Reserved: checksum good, 0 byte(s) reserved
  131. Read/write fields:
  132. [V1] Vendor specific: N/A
  133. [YA] Asset tag: N/A
  134. [RW] Read-write area: 107 byte(s) free
  135. End
  136. Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
  137. Address: 0000000000000000 Data: 0000
  138. Capabilities: [84] MSI-X: Enable+ Count=32 Masked-
  139. Vector table: BAR=0 offset=00082000
  140. PBA: BAR=0 offset=00082200
  141. Capabilities: [60] Express (v1) Endpoint, MSI 00
  142. DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 unlimited
  143. ExtTag+ AttnBtn- AttnInd- PwrInd- RBE- FLReset-
  144. DevCtl: Report errors: Correctable- Non-Fatal- Fatal+ Unsupported-
  145. RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
  146. MaxPayload 128 bytes, MaxReadReq 512 bytes
  147. DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
  148. LnkCap: Port #8, Speed 2.5GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited, L1 unlimited
  149. ClockPM- Surprise- LLActRep- BwNot-
  150. LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
  151. ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
  152. LnkSta: Speed 2.5GT/s, Width x8, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
  153. Kernel driver in use: ib_mthca
  154. ### ### ### ### ### ###
  155. root@hpv01:~# echo "### hpv01 port 1 to hpv00 port 0 #####" && ibstatus && ibstat && ibv_devinfo && lspci -Qvvs 0a:00.0
  156. ### hpv01 port 1 to hpv00 port 0 #####
  157. Infiniband device 'mthca0' port 1 status:
  158. default gid: fe80:0000:0000:0000:0002:c902:0022:3719
  159. base lid: 0x2
  160. sm lid: 0x1
  161. state: 1: DOWN
  162. phys state: 2: Polling
  163. rate: 10 Gb/sec (4X)
  164. link_layer: InfiniBand
  165.  
  166. Infiniband device 'mthca0' port 2 status:
  167. default gid: fe80:0000:0000:0000:0002:c902:0022:371a
  168. base lid: 0x2
  169. sm lid: 0x1
  170. state: 4: ACTIVE
  171. phys state: 5: LinkUp
  172. rate: 10 Gb/sec (4X)
  173. link_layer: InfiniBand
  174.  
  175. CA 'mthca0'
  176. CA type: MT25208
  177. Number of ports: 2
  178. Firmware version: 5.3.0
  179. Hardware version: 20
  180. Node GUID: 0x0002c90200223718
  181. System image GUID: 0x0002c9020022371b
  182. Port 1:
  183. State: Down
  184. Physical state: Polling
  185. Rate: 10
  186. Base lid: 2
  187. LMC: 0
  188. SM lid: 1
  189. Capability mask: 0x02510a68
  190. Port GUID: 0x0002c90200223719
  191. Link layer: InfiniBand
  192. Port 2:
  193. State: Active
  194. Physical state: LinkUp
  195. Rate: 10
  196. Base lid: 2
  197. LMC: 0
  198. SM lid: 1
  199. Capability mask: 0x02510a68
  200. Port GUID: 0x0002c9020022371a
  201. Link layer: InfiniBand
  202. hca_id: mthca0
  203. transport: InfiniBand (0)
  204. fw_ver: 5.3.0
  205. node_guid: 0002:c902:0022:3718
  206. sys_image_guid: 0002:c902:0022:371b
  207. vendor_id: 0x02c9
  208. vendor_part_id: 25218
  209. hw_ver: 0x20
  210. board_id: MT_0370130002
  211. phys_port_cnt: 2
  212. port: 1
  213. state: PORT_DOWN (1)
  214. max_mtu: 2048 (4)
  215. active_mtu: 2048 (4)
  216. sm_lid: 1
  217. port_lid: 2
  218. port_lmc: 0x00
  219. link_layer: InfiniBand
  220.  
  221. port: 2
  222. state: PORT_ACTIVE (4)
  223. max_mtu: 2048 (4)
  224. active_mtu: 2048 (4)
  225. sm_lid: 1
  226. port_lid: 2
  227. port_lmc: 0x00
  228. link_layer: InfiniBand
  229.  
  230. 0a:00.0 InfiniBand: Mellanox Technologies MT25208 [InfiniHost III Ex] (rev 20)
  231. Subsystem: Mellanox Technologies MT25208 [InfiniHost III Ex]
  232. Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
  233. Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
  234. Latency: 0, Cache Line Size: 64 bytes
  235. Interrupt: pin A routed to IRQ 16
  236. Region 0: Memory at fc300000 (64-bit, non-prefetchable) [size=1M]
  237. Region 2: Memory at d8000000 (64-bit, prefetchable) [size=8M]
  238. Capabilities: [40] Power Management version 2
  239. Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
  240. Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
  241. Capabilities: [48] Vital Product Data
  242. Product Name: Lion mini DDR
  243. Read-only fields:
  244. [PN] Part number: MHGA28-XTC
  245. [EC] Engineering changes: A3
  246. [SN] Serial number: MT0627X00154
  247. [V0] Vendor specific: PCIe x8
  248. [RV] Reserved: checksum good, 0 byte(s) reserved
  249. Read/write fields:
  250. [V1] Vendor specific: N/A
  251. [YA] Asset tag: N/A
  252. [RW] Read-write area: 107 byte(s) free
  253. End
  254. Capabilities: [90] MSI: Enable- Count=1/32 Maskable- 64bit+
  255. Address: 0000000000000000 Data: 0000
  256. Capabilities: [84] MSI-X: Enable+ Count=32 Masked-
  257. Vector table: BAR=0 offset=00082000
  258. PBA: BAR=0 offset=00082200
  259. Capabilities: [60] Express (v1) Endpoint, MSI 00
  260. DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 unlimited
  261. ExtTag+ AttnBtn- AttnInd- PwrInd- RBE- FLReset-
  262. DevCtl: Report errors: Correctable- Non-Fatal- Fatal+ Unsupported-
  263. RlxdOrd- ExtTag- PhantFunc- AuxPwr- NoSnoop-
  264. MaxPayload 128 bytes, MaxReadReq 512 bytes
  265. DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
  266. LnkCap: Port #8, Speed 2.5GT/s, Width x8, ASPM L0s, Exit Latency L0s unlimited, L1 unlimited
  267. ClockPM- Surprise- LLActRep- BwNot-
  268. LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk-
  269. ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
  270. LnkSta: Speed 2.5GT/s, Width x8, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
  271. Kernel driver in use: ib_mthca
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!