Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- 2020-09-07T09:10:19.407Z cpu8:1049379)WARNING: NVMEIO:2223 Controller 256 receives async event: type 1, info 1, log page ID 2.
- 2020-09-07T09:10:19.411Z cpu5:1049210)WARNING: NVMEDEV:4771 Critical warning 0x2 detected, failing C:256.
- 2020-09-07T09:10:19.425Z cpu7:1057193)WARNING: NVMEPSA:254 psaCmd 0x455a72f905c0 failed to submit. Controller 256 in state: 9.
- 2020-09-07T09:10:19.425Z cpu14:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73659d40, vmkPsaCmd: 0x455a72f905c0, cmdId.initiator=0x430cab61bb40, CmdSN: 0x383, status: 0x80d
- 2020-09-07T09:10:19.425Z cpu14:1049275)WARNING: NvmeScsi: 139: SCSI opcode 0xff (0x455a72f905c0) on path vmhba5:C0:T0:L0 to namespace t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 failed with NVMe host error
- 2020-09-07T09:10:19.425Z cpu14:1049275)WARNING: status: 0xe translating to SCSI error H:0x1
- 2020-09-07T09:10:19.425Z cpu14:1049275)NMP: nmp_ThrottleLogForDevice:3856: Cmd 0x2a (0x455a72f905c0, 1057178) to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" on path "vmhba5:C0:T0:L0" Failed:
- 2020-09-07T09:10:19.425Z cpu14:1049275)NMP: nmp_ThrottleLogForDevice:3865: H:0x1 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0. Act:FAILOVER. cmdId.initiator=0x430cab61bb40 CmdSN 0x383
- 2020-09-07T09:10:19.425Z cpu14:1049275)WARNING: NMP: nmp_DeviceRetryCommand:133: Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update for failover with I/O blocked. No prior reservation $
- 2020-09-07T09:10:20.350Z cpu14:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73797d40, vmkPsaCmd: 0x455a74778fc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:20.350Z cpu4:1048871)LVM: 5999: Received APD EventType: APD_START (3) for device <t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00:1> (gen 1)
- 2020-09-07T09:10:20.350Z cpu4:1048871)LVM: 5602: Handling APD EventType: APD_START (3) for device <t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00:1> (unlocked, gen 1, cur apd state UNKNOWN, cur dev state 1)
- 2020-09-07T09:10:20.350Z cpu4:1048871)HBX: 6711: APD EventType: APD_START (3) for vol 'nvme'
- 2020-09-07T09:10:20.350Z cpu4:1048871)ScsiDevice: 6586: Device state of t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 set to APD_START; token num:1
- 2020-09-07T09:10:20.350Z cpu4:1048871)StorageApdHandler: 1202: APD start for 0x4304318bee80 [t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00]
- 2020-09-07T09:10:20.350Z cpu3:1048857)StorageApdHandler: 418: APD start event for 0x4304318bee80 [t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00]
- 2020-09-07T09:10:20.350Z cpu3:1048857)StorageApdHandlerEv: 110: Device or filesystem with identifier [t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00] has entered the All Paths Down state.
- 2020-09-07T09:10:20.350Z cpu4:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f905c0
- 2020-09-07T09:10:20.350Z cpu4:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:10:20.350Z cpu4:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:10:21.350Z cpu14:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737f72c0, vmkPsaCmd: 0x455a74623bc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:21.350Z cpu7:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f905c0
- 2020-09-07T09:10:21.350Z cpu7:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:10:21.350Z cpu7:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:10:21.483Z cpu1:1050571)WARNING: NVMEVSI:373 The controller 256 has not been initializated.
- 2020-09-07T09:10:22.350Z cpu14:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737804c0, vmkPsaCmd: 0x455a74623bc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:23.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7367d740, vmkPsaCmd: 0x455a414e4740, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:24.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7377bcc0, vmkPsaCmd: 0x455a414e4740, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:25.350Z cpu10:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737f6540, vmkPsaCmd: 0x455a74623bc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:26.350Z cpu10:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737f8f40, vmkPsaCmd: 0x455a746ceac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:27.352Z cpu10:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7363cdc0, vmkPsaCmd: 0x455a746ceac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:28.350Z cpu4:1048871)WARNING: NVMEPSA:262 psaCmd 0x455a746ceac0 failed to submit. Controller 256 in state: 9, for 10 submits.
- 2020-09-07T09:10:28.350Z cpu10:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737186c0, vmkPsaCmd: 0x455a746ceac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:28.833Z cpu9:1048620)ScsiDeviceIO: 4052: Cmd(0x455a72f842c0) 0x2a, cmdId.initiator=0x4304318bc580 CmdSN 0x250fb from world 1048601 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x5 D:0x0
- 2020-09-07T09:10:28.833Z cpu9:1048620)P:0x0 Aborted at device layer. Cmd count Active:1 Queued:186
- 2020-09-07T09:10:29.352Z cpu10:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7369ea40, vmkPsaCmd: 0x455a746ceac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:29.352Z cpu10:1049275)NMP: nmp_ThrottleLogForDevice:3794: last error status from device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 repeated 10 times
- 2020-09-07T09:10:29.832Z cpu9:1048620)ScsiDeviceIO: 4052: Cmd(0x455a72e03cc0) 0x2a, cmdId.initiator=0x4304318bc580 CmdSN 0x250fd from world 1048601 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x5 D:0x0
- 2020-09-07T09:10:29.832Z cpu9:1048620)P:0x0 Aborted at device layer. Cmd count Active:1 Queued:186
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a74778fc0) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3b0 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a41419f40) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3a8 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a4158d340) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3a1 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a747b09c0) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3df from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a746a0bc0) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x391 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu4:1049546)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" is blocked. Not starting I/O from device.
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a41462c40) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x368 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a72f045c0) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x36b from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu4:1048615)ScsiDeviceIO: 3999: Cmd(0x455a72e7a8c0) 0x2a, cmdId.initiator=0x4304318bc580 CmdSN 0x250fc from world 1048601 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu4:1048615)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a7470a5c0) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3d6 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.832Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a4145d240) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3fb from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.832Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.833Z cpu5:1048616)ScsiDeviceIO: 3999: Cmd(0x455a746a51c0) 0x2a, cmdId.initiator=0x430cab61bb40 CmdSN 0x3c1 from world 1057178 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x8 D:0x0
- 2020-09-07T09:10:29.833Z cpu5:1048616)P:0x0 Aborted at device layer
- 2020-09-07T09:10:29.933Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.933Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.934Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.934Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.936Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.936Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.936Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.936Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.937Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.937Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.939Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.939Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.941Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.941Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.942Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.942Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.944Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.944Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.947Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.947Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.948Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.948Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.950Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.950Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.950Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.950Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.953Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.953Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.955Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.955Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.957Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:29.960Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:29.960Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.042Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.042Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.176Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.176Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.340Z cpu4:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.340Z cpu4:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.352Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7364b4c0, vmkPsaCmd: 0x455a72e7a8c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:10:30.352Z cpu10:1049307)WARNING: NMP: nmpDeviceAttemptFailover:603: Retry world restore device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - no more commands to retry
- 2020-09-07T09:10:30.514Z cpu5:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.514Z cpu5:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.734Z cpu5:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.734Z cpu5:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.832Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.832Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.907Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.907Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:30.979Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:30.979Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.051Z cpu10:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.051Z cpu10:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.208Z cpu10:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.208Z cpu10:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.376Z cpu10:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.376Z cpu10:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.491Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.491Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.637Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.637Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.860Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.860Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:31.974Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:31.974Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:32.080Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:32.080Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:32.196Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:32.196Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:32.307Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:32.307Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:32.404Z cpu8:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:32.404Z cpu8:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:32.571Z cpu10:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:32.571Z cpu10:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:32.807Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:32.807Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:33.059Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:33.059Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:33.092Z cpu2:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:10:33.092Z cpu2:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:33.319Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:33.319Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:33.571Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:33.571Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:33.813Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:33.813Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:34.069Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:34.069Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:34.325Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:34.325Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:34.572Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:34.572Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:34.842Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:34.842Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:35.094Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:35.094Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:35.345Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:35.345Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:35.561Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:35.561Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:35.821Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:35.821Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:36.065Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:36.065Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:36.328Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:36.328Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:36.552Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:36.552Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:36.807Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:36.807Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.062Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.062Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.294Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.294Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.564Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.564Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.716Z cpu1:1048816)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:10:37.716Z cpu1:1048816) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.934Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.934Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.934Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.934Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.939Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.939Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.948Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.948Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:37.967Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:37.967Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.002Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.002Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.102Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.102Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.202Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.202Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.350Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.350Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.515Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.515Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.691Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.691Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:38.862Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:38.862Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:39.075Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:39.075Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:39.287Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:39.287Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:39.472Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:39.472Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:39.679Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:39.679Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:39.882Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:39.882Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:40.051Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:40.051Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:40.268Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:40.268Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:40.479Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:40.479Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:40.669Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:40.669Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:40.901Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:40.901Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:41.129Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:41.129Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:41.337Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:41.337Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:41.552Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:41.552Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:41.747Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:41.747Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:41.956Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:41.956Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:42.167Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:42.167Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:42.374Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:42.374Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:42.566Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:42.566Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:42.776Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:42.776Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:42.979Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:42.979Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:43.095Z cpu9:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:10:43.095Z cpu9:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:43.175Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:43.175Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:43.396Z cpu0:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:43.396Z cpu0:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:43.655Z cpu2:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:43.655Z cpu2:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:43.906Z cpu2:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:43.906Z cpu2:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:44.156Z cpu12:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:44.156Z cpu12:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:44.372Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:44.372Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:44.616Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:44.616Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:44.870Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:44.870Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:45.141Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:45.141Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:45.397Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:45.397Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:45.708Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:45.708Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.006Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.006Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.025Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.025Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.038Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.038Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.060Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.060Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.099Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.099Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.143Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.143Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.215Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.215Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.297Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.297Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.388Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.388Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.487Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.487Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.595Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.595Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.738Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.738Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:46.912Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:46.912Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:47.118Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:47.118Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:47.348Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:47.348Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:47.563Z cpu11:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:10:47.563Z cpu11:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:53.098Z cpu9:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:10:53.098Z cpu9:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:10:53.839Z cpu1:1049656)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:10:53.839Z cpu1:1049656) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:03.100Z cpu7:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:03.100Z cpu7:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:08.344Z cpu9:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:11:08.344Z cpu9:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:13.104Z cpu7:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:13.104Z cpu7:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:13.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7364b4c0, vmkPsaCmd: 0x455a72e294c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:13.350Z cpu14:1048874)WARNING: NMP: nmp_IssueCommandToDevice:5914: I/O could not be issued to device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" due to Not found
- 2020-09-07T09:11:13.350Z cpu14:1048874)WARNING: NMP: nmp_DeviceRetryCommand:133: Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update for failover with I/O blocked. No prior reservation $
- 2020-09-07T09:11:13.350Z cpu14:1048874)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" is blocked. Not starting I/O from device.
- 2020-09-07T09:11:13.350Z cpu4:1049382)DVFilter: 6344: Checking disconnected filters for timeouts
- 2020-09-07T09:11:13.350Z cpu8:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f4fac0
- 2020-09-07T09:11:13.350Z cpu7:1049306)NMP: nmp_ResetDeviceLogThrottling:3776: last error status from device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 repeated 2 times
- 2020-09-07T09:11:13.350Z cpu8:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:11:13.350Z cpu8:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:11:14.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7377bcc0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:14.350Z cpu4:1049275)NMP: nmp_ThrottleLogForDevice:3856: Cmd 0x0 (0x455a747be5c0, 0) to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" on path "vmhba5:C0:T0:L0" Failed:
- 2020-09-07T09:11:14.350Z cpu4:1049275)NMP: nmp_ThrottleLogForDevice:3865: H:0x1 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0. Act:NONE. cmdId.initiator=0x451a0939bc88 CmdSN 0x0
- 2020-09-07T09:11:14.350Z cpu8:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f4fac0
- 2020-09-07T09:11:14.350Z cpu8:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:11:14.350Z cpu8:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:11:15.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7367d740, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:16.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737804c0, vmkPsaCmd: 0x455a74696bc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:17.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737f72c0, vmkPsaCmd: 0x455a74696bc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:18.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a44fffe80, vmkPsaCmd: 0x455a414c8f40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:19.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736ff7c0, vmkPsaCmd: 0x455a414c8f40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:20.350Z cpu8:1048871)WARNING: NVMEPSA:262 psaCmd 0x455a414c8f40 failed to submit. Controller 256 in state: 9, for 20 submits.
- 2020-09-07T09:11:20.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7367a8c0, vmkPsaCmd: 0x455a414c8f40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:21.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7372db40, vmkPsaCmd: 0x455a414c8f40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:22.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7376e1c0, vmkPsaCmd: 0x455a414c8f40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:23.107Z cpu6:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:23.107Z cpu6:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:23.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7373f6c0, vmkPsaCmd: 0x455a72e03cc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:24.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737a7640, vmkPsaCmd: 0x455a72e03cc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:24.350Z cpu7:1049275)NMP: nmp_ThrottleLogForDevice:3794: last error status from device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 repeated 10 times
- 2020-09-07T09:11:25.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73618040, vmkPsaCmd: 0x455a72e03cc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:26.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73740ec0, vmkPsaCmd: 0x455a72e03cc0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:27.244Z cpu14:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:11:27.244Z cpu14:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:27.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736cba40, vmkPsaCmd: 0x455a72f842c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:28.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736d8040, vmkPsaCmd: 0x455a72f842c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:29.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7365e840, vmkPsaCmd: 0x455a41412c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:30.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737f2340, vmkPsaCmd: 0x455a41412c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:30.718Z cpu4:1048816)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:30.718Z cpu4:1048816) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:31.350Z cpu6:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736bcd40, vmkPsaCmd: 0x455a41412c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:32.350Z cpu6:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7373c9c0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:33.110Z cpu7:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:33.110Z cpu7:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:33.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737b1cc0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:34.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737b1cc0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:35.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737b1cc0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:36.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737b1cc0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:37.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737b1cc0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:38.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737f2340, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:39.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7365e840, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:40.350Z cpu7:1048871)WARNING: NVMEPSA:262 psaCmd 0x455a72f103c0 failed to submit. Controller 256 in state: 9, for 40 submits.
- 2020-09-07T09:11:40.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736d8040, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:41.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736cba40, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:42.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73740ec0, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:43.113Z cpu4:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:43.113Z cpu4:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:43.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73618040, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:43.840Z cpu7:1049656)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:43.840Z cpu7:1049656) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:44.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737a7640, vmkPsaCmd: 0x455a72f103c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:44.350Z cpu12:1049275)NMP: nmp_ThrottleLogForDevice:3794: last error status from device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 repeated 20 times
- 2020-09-07T09:11:44.350Z cpu2:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f4fac0
- 2020-09-07T09:11:44.350Z cpu2:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:11:44.350Z cpu2:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:11:45.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7373f6c0, vmkPsaCmd: 0x455a72e1b3c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:46.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736df3c0, vmkPsaCmd: 0x455a72e1b3c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:47.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73788ec0, vmkPsaCmd: 0x455a72f1c6c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:48.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73619840, vmkPsaCmd: 0x455a41492440, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:49.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72ff09c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:50.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:51.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:52.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:53.117Z cpu4:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:53.117Z cpu4:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:53.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:53.352Z cpu9:1048925)ScsiDeviceIO: 4052: Cmd(0x455a72f4fac0) 0x12, cmdId.initiator=0x451a0951bcb8 CmdSN 0x50a9 from world 0 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x5 D:0x0 P:0x0
- 2020-09-07T09:11:53.352Z cpu9:1048925)Aborted at NMP layer. Cmd count Active:1 Queued:0
- 2020-09-07T09:11:53.352Z cpu9:1048925)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" is blocked. Not starting I/O from device.
- 2020-09-07T09:11:53.352Z cpu13:1048874)ScsiVmas: 1052: Inquiry for VPD page 00 to device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 failed with error Timeout
- 2020-09-07T09:11:53.921Z cpu4:1057766)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:11:53.921Z cpu4:1057766) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:54.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73788ec0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:54.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:603: Retry world restore device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - no more commands to retry
- 2020-09-07T09:11:54.350Z cpu4:1049306)WARNING: NMP: nmp_IssueCommandToDevice:5914: I/O could not be issued to device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" due to Not found
- 2020-09-07T09:11:54.350Z cpu4:1049306)WARNING: NMP: nmp_DeviceRetryCommand:133: Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update for failover with I/O blocked. No prior reservation e$
- 2020-09-07T09:11:54.350Z cpu4:1049306)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" is blocked. Not starting I/O from device.
- 2020-09-07T09:11:55.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736df3c0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:55.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f4fac0
- 2020-09-07T09:11:55.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:11:55.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:11:56.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7373f6c0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:56.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f4fac0
- 2020-09-07T09:11:56.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:11:56.350Z cpu12:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:11:57.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737a7640, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:58.256Z cpu10:1049546)WARNING: HBX: 3679: 'nvme': HB at offset 3637248 - Reclaiming timed out HB failed: Timeout:
- 2020-09-07T09:11:58.256Z cpu10:1049546)WARNING: [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:11:58.350Z cpu7:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73618040, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:11:59.350Z cpu4:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736cba40, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:00.350Z cpu0:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736d8040, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:01.350Z cpu6:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7365e840, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:02.350Z cpu6:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73618040, vmkPsaCmd: 0x455a74683ac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:03.120Z cpu5:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:12:03.120Z cpu5:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:12:03.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737a2b40, vmkPsaCmd: 0x455a74683ac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:04.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737b4b40, vmkPsaCmd: 0x455a74683ac0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:05.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73618040, vmkPsaCmd: 0x455a41404140, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:06.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736cba40, vmkPsaCmd: 0x455a72e294c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:07.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737a7640, vmkPsaCmd: 0x455a72e294c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:08.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a75c0, vmkPsaCmd: 0x455a414f4b40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:09.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7365e840, vmkPsaCmd: 0x455a41404140, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:10.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a7379e4c0, vmkPsaCmd: 0x455a41404140, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:11.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a73788ec0, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:12.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:13.121Z cpu8:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:12:13.121Z cpu8:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:12:13.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:13.350Z cpu13:1049306)NMP: nmp_ResetDeviceLogThrottling:3770: Error status H:0x0 D:0x2 P:0x0 Sense Data: 0x5 0x24 0x0 from dev "mpx.vmhba32:C0:T0:L0" occurred 1 times(of 0 commands)
- 2020-09-07T09:12:13.350Z cpu12:1049275)WARNING: NvmeScsi: 139: SCSI opcode 0xff (0x455a41453c40) on path vmhba5:C0:T0:L0 to namespace t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 failed with NVMe host error
- 2020-09-07T09:12:13.350Z cpu12:1049275)WARNING: status: 0xe translating to SCSI error H:0x1
- 2020-09-07T09:12:14.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:15.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:16.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:17.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a736a6540, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:18.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:18.440Z cpu1:1050932)FSS: 147: Reservation state of LOCKER-5f54eb38-91d86cc1-1422-ac1f6be46fbe moved from Idle to Ready
- 2020-09-07T09:12:19.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:20.350Z cpu12:1048871)WARNING: NVMEPSA:262 psaCmd 0x455a72e74ec0 failed to submit. Controller 256 in state: 9, for 80 submits.
- 2020-09-07T09:12:20.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:21.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:22.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:23.123Z cpu4:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:12:23.123Z cpu4:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:12:23.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:23.722Z cpu7:1048816)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:12:23.722Z cpu7:1048816) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:12:24.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:24.350Z cpu12:1049275)NMP: nmp_ThrottleLogForDevice:3794: last error status from device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 repeated 40 times
- 2020-09-07T09:12:25.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:26.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:26.350Z cpu10:1049307)WARNING: NMP: nmpDeviceAttemptFailover:640: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - issuing command 0x455a72f4fac0
- 2020-09-07T09:12:26.350Z cpu10:1049307)WARNING: NMP: nmpDeviceAttemptFailover:715: Retry world failover device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - failed to issue command due to Not found (APD), try again...
- 2020-09-07T09:12:26.350Z cpu10:1049307)WARNING: NMP: nmpDeviceAttemptFailover:765: Logical device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00": awaiting fast path state update...
- 2020-09-07T09:12:27.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:28.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:29.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:30.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:30.893Z cpu0:1050571)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:12:30.893Z cpu0:1050571) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:12:31.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a72e74ec0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:32.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:33.126Z cpu7:1056307)HBX: 3057: 'nvme': HB at offset 3637248 - Waiting for timed out HB:
- 2020-09-07T09:12:33.126Z cpu7:1056307) [HB state abcdef02 offset 3637248 gen 11 stampUS 49744488729 uuid 5f5536cb-3a142866-b2b7-ac1f6be46fbe jrnl <FB 0> drv 24.82 lockImpl 3 ip 10.1.43.2]
- 2020-09-07T09:12:33.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a41453c40, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:33.353Z cpu9:1048925)ScsiDeviceIO: 4052: Cmd(0x455a72f4fac0) 0x12, cmdId.initiator=0x451a0951bcc8 CmdSN 0x50aa from world 0 to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" failed H:0x5 D:0x0 P:0x0
- 2020-09-07T09:12:33.353Z cpu9:1048925)Aborted at NMP layer. Cmd count Active:1 Queued:0
- 2020-09-07T09:12:33.353Z cpu9:1048925)WARNING: NMP: nmp_DeviceStartLoop:740: NMP Device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" is blocked. Not starting I/O from device.
- 2020-09-07T09:12:34.350Z cpu12:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737429c0, vmkPsaCmd: 0x455a747be5c0, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:12:34.350Z cpu6:1049307)WARNING: NMP: nmpDeviceAttemptFailover:603: Retry world restore device "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" - no more commands to retry
- 2020-09-07T09:12:40.351Z cpu0:1048857)LVM: 5999: Received APD EventType: APD_TIMEOUT (5) for device <t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00:1> (gen 2)
- 2020-09-07T09:12:40.351Z cpu0:1048857)LVM: 5602: Handling APD EventType: APD_TIMEOUT (5) for device <t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00:1> (unlocked, gen 2, cur apd state APD_START, cur dev state 1)
- 2020-09-07T09:12:40.351Z cpu0:1048857)HBX: 6711: APD EventType: APD_TIMEOUT (5) for vol 'nvme'
- 2020-09-07T09:12:40.351Z cpu0:1048857)StorageApdHandler: 608: APD timeout event for 0x4304318bee80 [t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00]
- 2020-09-07T09:12:40.351Z cpu0:1048857)StorageApdHandlerEv: 126: Device or filesystem with identifier [t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00] has entered the All Paths Down Timeout state after being in the All Paths Down s$
- 2020-09-07T09:12:43.352Z cpu6:1048816)BC: 413: write to vmware.log (f532 28 3 5f55ed96 c2ed5415 1fac8493 be6fe46b 7c00004 24 0 0 0 0 0) 3640 bytes failed: No connection
- 2020-09-07T09:12:43.352Z cpu6:1048816)Log: 1487: Generating backtrace for 1048816: bcflushd
- 2020-09-07T09:12:43.352Z cpu6:1048816)Backtrace for current CPU #6, worldID=1048816, fp=0x1000f0
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781baa0:[0x4200108e6028]LogBacktraceInt@vmkernel#nover+0xf0 stack: 0x60050, 0x420010e1cbfa, 0xa7190a, 0x42001083f4ca, 0x0
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781bad0:[0x42001083f4c9]BCFileIO@vmkernel#nover+0x1b6 stack: 0x2d2b, 0x74a012b0, 0x6c2e657261776d76, 0x676f, 0x1
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781bd40:[0x42001083fe63]BCWriteBuffer@vmkernel#nover+0x1f0 stack: 0xffffffffffffffff, 0x420010b548fb, 0x0, 0x7f000, 0x16d762000
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781bf50:[0x42001083ffc7]BCFlushFile@vmkernel#nover+0x44 stack: 0x41ffd093f640, 0x420010840003, 0x41ffd093f660, 0x4200108400ae, 0x0
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781bf80:[0x4200108400ad]BCFlushAll@vmkernel#nover+0xca stack: 0x451a0781bfaf, 0x451a07821000, 0x451a076a1100, 0x451a07821100, 0x0
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781bfd0:[0x420010840104]BCFlusherWorld@vmkernel#nover+0x9 stack: 0x0, 0x0, 0x0, 0x4200108c44c4, 0x0
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781bfe0:[0x420010b5e2f9]CpuSched_StartWorld@vmkernel#nover+0x82 stack: 0x0, 0x4200108c44c4, 0x0, 0x0, 0x0
- 2020-09-07T09:12:43.352Z cpu6:1048816)0x451a0781c000:[0x4200108c44c3]Debug_IsInitialized@vmkernel#nover+0xc stack: 0x0, 0x0, 0x0, 0x0, 0x0
- 2020-09-07T09:12:56.055Z cpu12:1057177)NetPort: 1774: disabled port 0x6000015
- 2020-09-07T09:12:56.055Z cpu12:1057177)Net: 3566: disconnected client from port 0x6000015
- 2020-09-07T09:12:56.056Z cpu12:1057177)NetPort: 1774: disabled port 0x4000016
- 2020-09-07T09:12:56.056Z cpu12:1057177)Net: 3566: disconnected client from port 0x4000016
- 2020-09-07T09:12:56.057Z cpu12:1057177)VSCSI: 6938: handle 8206(vscsi0:0):Destroying Device for world 1057178 (pendCom 0)
- 2020-09-07T09:12:56.057Z cpu12:1057177)Fil3: 5296: No connection unlocking [type 10c00001 offset 7626752 v 26, hb offset 3637248
- gen 11, mode 1, owner 5f5536cb-3a142866-b2b7-ac1f6be46fbe mtime 61841
- num 0 gblnum 0 gblgen 0 gblbrk 0]
- 2020-09-07T09:12:56.058Z cpu12:1057177)Fil3: 5296: No connection unlocking [type 10c00001 offset 7561216 v 18, hb offset 3637248
- gen 11, mode 1, owner 5f5536cb-3a142866-b2b7-ac1f6be46fbe mtime 61842
- num 0 gblnum 0 gblgen 0 gblbrk 0]
- 2020-09-07T09:12:56.090Z cpu2:1048636)WARNING: SwapExtend: vm 1048636: 448: Failed to truncate swapfile /vmfs/volumes/5f55ed96-c2ed5415-8493-ac1f6be46fbe/USB/USB-b67570aa.vswp to 0 bytes: No connection
- 2020-09-07T09:12:56.090Z cpu2:1048636)Fil3: 5296: No connection unlocking [type 10c00001 offset 7733248 v 39, hb offset 3637248
- gen 11, mode 1, owner 5f5536cb-3a142866-b2b7-ac1f6be46fbe mtime 61843
- num 0 gblnum 0 gblgen 0 gblbrk 0]
- 2020-09-07T09:12:56.090Z cpu2:1048636)WARNING: SwapFileOps: 604: Failed to unlink /vmfs/volumes/5f55ed96-c2ed5415-8493-ac1f6be46fbe/USB/USB-b67570aa.vswp: No connection
- 2020-09-07T09:12:56.092Z cpu12:1057177)BC: 413: read from USB.vmx~ (f532 28 3 5f55ed96 c2ed5415 1fac8493 be6fe46b 7800004 23 0 0 0 0 0) 3584 bytes failed: No connection
- 2020-09-07T09:12:56.092Z cpu12:1057177)Log: 1487: Generating backtrace for 1057177: vmx
- 2020-09-07T09:12:56.092Z cpu12:1057177)Backtrace for current CPU #12, worldID=1057177, fp=0x102199
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269b3f0:[0x4200108e6028]LogBacktraceInt@vmkernel#nover+0xf0 stack: 0x60008, 0x420010e1cbf0, 0xc1923, 0x42001083f4ca, 0x451a2269b550
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269b420:[0x42001083f4c9]BCFileIO@vmkernel#nover+0x1b6 stack: 0x0, 0x0, 0x7e786d762e425355, 0x0, 0x0
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269b690:[0x42001084089a]BCReadBuffer@vmkernel#nover+0x4db stack: 0x22e8e0, 0x4307c1e00000, 0x22e8e2, 0x420010840583, 0x22e8e4
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269b980:[0x420010841744]BC_GetPageRef@vmkernel#nover+0x99 stack: 0xc1923, 0x430a58212f10, 0x451a2269bdb8, 0xbad0020, 0x4308d4da2400
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269b9e0:[0x42001083cf9f]FSSVec_GetPageRef@vmkernel#nover+0x20 stack: 0x451a2269ba40, 0x420000000000, 0x0, 0x0, 0x1
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269b9f0:[0x4200108423d7]BC_StartFHID@vmkernel#nover+0xec stack: 0x0, 0x0, 0x1, 0x4bc0226000, 0xe1f
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269bd90:[0x420010843240]BC_WriteFHID@vmkernel#nover+0xc5 stack: 0x0, 0x0, 0x4000000000000, 0x3fffffffff, 0x0
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269be20:[0x420010c6a7a7]UserFileWritev@vmkernel#nover+0x90 stack: 0x4307e3a02010, 0xe1f00000007, 0x451a2269be90, 0xe1f, 0x4307e3a02010
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269be80:[0x420010c6d837]LinuxFileDesc_Write@vmkernel#nover+0xe4 stack: 0x455a449b1cb8, 0x4bc0226000, 0xe1f, 0x451a2269be98, 0x430700000001
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269bf00:[0x420010c1e784]User_LinuxSyscallHandler@vmkernel#nover+0x109 stack: 0x451a2269bfd0, 0x0, 0x0, 0x0, 0x0
- 2020-09-07T09:12:56.092Z cpu12:1057177)0x451a2269bf40:[0x420010953067]gate_entry@vmkernel#nover+0x68 stack: 0x0, 0x1, 0x4bbe46341d, 0xe1f, 0xe1f
- 2020-09-07T09:12:56.092Z cpu12:1057177)Fil3: 5296: No connection unlocking [type 10c00001 offset 7716864 v 37, hb offset 3637248
- gen 11, mode 1, owner 5f5536cb-3a142866-b2b7-ac1f6be46fbe mtime 61844
- num 0 gblnum 0 gblgen 0 gblbrk 0]
- 2020-09-07T09:12:56.092Z cpu12:1057177)Fil3: 5296: No connection unlocking [type 10c00001 offset 7553024 v 46, hb offset 3637248
- gen 11, mode 1, owner 5f5536cb-3a142866-b2b7-ac1f6be46fbe mtime 61845
- num 0 gblnum 0 gblgen 0 gblbrk 0]
- 2020-09-07T09:12:56.093Z cpu12:1057177)BC: 413: write to vmware.log (f532 28 3 5f55ed96 c2ed5415 1fac8493 be6fe46b 7c00004 24 0 0 0 0 0) 23532 bytes failed: No connection
- 2020-09-07T09:12:56.093Z cpu12:1057177)Log: 1487: Generating backtrace for 1057177: vmx
- 2020-09-07T09:12:56.093Z cpu12:1057177)Backtrace for current CPU #12, worldID=1057177, fp=0x102199
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269b990:[0x4200108e6028]LogBacktraceInt@vmkernel#nover+0xf0 stack: 0x20050, 0x420010e1cbfa, 0xa7190a, 0x42001083f4ca, 0xa7190a
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269b9c0:[0x42001083f4c9]BCFileIO@vmkernel#nover+0x1b6 stack: 0x4308d4dbe960, 0x457, 0x6c2e657261776d76, 0x42001000676f, 0x451a2269ba78
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bc30:[0x42001083fe63]BCWriteBuffer@vmkernel#nover+0x1f0 stack: 0xa7190a, 0x108e942e, 0x0, 0x3d000, 0x1040469000
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269be40:[0x42001083ffc7]BCFlushFile@vmkernel#nover+0x44 stack: 0x0, 0xa7190a, 0x2, 0x420010842d0d, 0x0
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269be70:[0x420010842d0c]BC_FlushFHID@vmkernel#nover+0x4d stack: 0x4307e3a02010, 0x420010c24f25, 0x4307e3a02450, 0x4307e3a0cfe0, 0x0
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269be90:[0x420010c24f24]UserObj_FDClose@vmkernel#nover+0x165 stack: 0x0, 0x455a449c8398, 0x4307e3a02010, 0x451a2269bf40, 0x3
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bef0:[0x420010c6da36]LinuxFileDesc_Close@vmkernel#nover+0x1b stack: 0x0, 0x42001093ae5c, 0x451a2269bfd0, 0x0, 0x0
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bf00:[0x420010c1e784]User_LinuxSyscallHandler@vmkernel#nover+0x109 stack: 0x451a2269bfd0, 0x0, 0x0, 0x0, 0x0
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bf40:[0x420010953067]gate_entry@vmkernel#nover+0x68 stack: 0x0, 0x3, 0x4bbe178fcd, 0x4b7c86adf0, 0x4b7ca1d158
- 2020-09-07T09:12:56.093Z cpu12:1057177)BC: 413: write to vmware.log (f532 28 3 5f55ed96 c2ed5415 1fac8493 be6fe46b 7c00004 24 0 0 0 0 0) 23532 bytes failed: No connection
- 2020-09-07T09:12:56.093Z cpu12:1057177)Log: 1487: Generating backtrace for 1057177: vmx
- 2020-09-07T09:12:56.093Z cpu12:1057177)Backtrace for current CPU #12, worldID=1057177, fp=0x102199
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269b8d0:[0x4200108e6028]LogBacktraceInt@vmkernel#nover+0xf0 stack: 0x20050, 0x420010e1cbfa, 0xa7190a, 0x42001083f4ca, 0x4200108e6028
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269b900:[0x42001083f4c9]BCFileIO@vmkernel#nover+0x1b6 stack: 0x42001083f4ca, 0xc1e0e570, 0x6c2e657261776d76, 0x42001000676f, 0x451a2269b940
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bb70:[0x42001083fe63]BCWriteBuffer@vmkernel#nover+0x1f0 stack: 0xa7190a, 0x4307c1e0e570, 0x190, 0x3d000, 0x1040469000
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bd80:[0x42001083ffc7]BCFlushFile@vmkernel#nover+0x44 stack: 0x4308d4dbe960, 0x4308d4dbea54, 0xa7190a, 0x420010841c44, 0x1
- 2020-09-07T09:12:56.093Z cpu12:1057177)0x451a2269bdb0:[0x420010841c43]BC_CloseFile@vmkernel#nover+0xb4 stack: 0x431000000000, 0x0, 0xa7190a, 0x4308d4dbe960, 0x2
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269be00:[0x42001083928a]FSS_CloseFile@vmkernel#nover+0x87 stack: 0x10, 0x43082fd66290, 0x4308d4dbe960, 0x455a449c8398, 0x455a447d5e50
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269be50:[0x420010c42eb0]UserVmfs_Close@vmkernel#nover+0x35 stack: 0x4307e3a02010, 0x420010c23100, 0x4d0, 0xbad0040, 0x0
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269be70:[0x420010c230ff]UserObj_ReleaseWithoutCartel@vmkernel#nover+0x10 stack: 0x0, 0x420010c24f36, 0x4307e3a02450, 0x4307e3a0cfe0, 0x0
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269be90:[0x420010c24f35]UserObj_FDClose@vmkernel#nover+0x176 stack: 0x0, 0x455a449c8398, 0x4307e3a02010, 0x451a2269bf40, 0x3
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269bef0:[0x420010c6da36]LinuxFileDesc_Close@vmkernel#nover+0x1b stack: 0x0, 0x42001093ae5c, 0x451a2269bfd0, 0x0, 0x0
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269bf00:[0x420010c1e784]User_LinuxSyscallHandler@vmkernel#nover+0x109 stack: 0x451a2269bfd0, 0x0, 0x0, 0x0, 0x0
- 2020-09-07T09:12:56.094Z cpu12:1057177)0x451a2269bf40:[0x420010953067]gate_entry@vmkernel#nover+0x68 stack: 0x0, 0x3, 0x4bbe178fcd, 0x4b7c86adf0, 0x4b7ca1d158
- 2020-09-07T09:12:56.094Z cpu12:1057177)ALERT: BC: 3144: File vmware.log closed with dirty buffers. Possible data loss.
- 2020-09-07T09:12:56.097Z cpu1:1048647)WARNING: SwapExtend: vm 1048647: 448: Failed to truncate swapfile /vmfs/volumes/5f55ed96-c2ed5415-8493-ac1f6be46fbe/USB/vmx-USB-fc1426c6b8abf99f4b4c1dca98a87159d724d847-1.vswp to 0 bytes: No connection
- 2020-09-07T09:12:56.097Z cpu1:1048647)WARNING: SwapFileOps: 604: Failed to unlink /vmfs/volumes/5f55ed96-c2ed5415-8493-ac1f6be46fbe/USB/vmx-USB-fc1426c6b8abf99f4b4c1dca98a87159d724d847-1.vswp: No connection
- 2020-09-07T09:13:02.268Z cpu1:1050508)FSS: 147: Reservation state of LOCKER-5f54eb38-91d86cc1-1422-ac1f6be46fbe moved from Idle to Ready
- 2020-09-07T09:13:03.097Z cpu1:1048781)WARNING: Vol3: 2811: 'nvme': Failed to clear journal address since JBC could not be Locked. This could result in leak of journal block at <type 6 addr 0>.
- 2020-09-07T09:13:03.097Z cpu1:1048781)WARNING: Vol3: 2879: 'nvme': Failed to clear journal address in on-disk HB. This could result in leak of journal block at <type 6 addr 0>.
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 3 (typeID 1) at offset 9592832 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 3 unlock at 9592832 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 9 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 5 (typeID 1) at offset 9609216 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 5 unlock at 9609216 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 7 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 6 (typeID 1) at offset 9617408 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 6 unlock at 9617408 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 7 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 7 (typeID 1) at offset 9625600 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 7 unlock at 9625600 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 7 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 80 (typeID 1) at offset 10223616 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 80 unlock at 10223616 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 81 (typeID 1) at offset 10231808 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 81 unlock at 10231808 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 82 (typeID 1) at offset 10240000 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 82 unlock at 10240000 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 83 (typeID 1) at offset 10248192 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 83 unlock at 10248192 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 84 (typeID 1) at offset 10256384 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 84 unlock at 10256384 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 85 (typeID 1) at offset 10264576 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 85 unlock at 10264576 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 86 (typeID 1) at offset 10272768 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 86 unlock at 10272768 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 87 (typeID 1) at offset 10280960 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 87 unlock at 10280960 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 8 (typeID 1) at offset 9633792 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 8 unlock at 9633792 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 7 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 9 (typeID 1) at offset 9641984 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 9 unlock at 9641984 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 5 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 10 (typeID 1) at offset 9650176 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 10 unlock at 9650176 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 5 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 11 (typeID 1) at offset 9658368 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 11 unlock at 9658368 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 12 (typeID 1) at offset 9666560 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 12 unlock at 9666560 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 13 (typeID 1) at offset 9674752 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 13 unlock at 9674752 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 14 (typeID 1) at offset 9682944 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 14 unlock at 9682944 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 15 (typeID 1) at offset 9691136 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 15 unlock at 9691136 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 88 (typeID 1) at offset 10289152 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 88 unlock at 10289152 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 89 (typeID 1) at offset 10297344 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 89 unlock at 10297344 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 90 (typeID 1) at offset 10305536 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 90 unlock at 10305536 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 91 (typeID 1) at offset 10313728 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 91 unlock at 10313728 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 92 (typeID 1) at offset 10321920 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 92 unlock at 10321920 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 93 (typeID 1) at offset 10330112 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 93 unlock at 10330112 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 16 (typeID 1) at offset 9699328 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 16 unlock at 9699328 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 17 (typeID 1) at offset 9707520 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 17 unlock at 9707520 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 18 (typeID 1) at offset 9715712 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 18 unlock at 9715712 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 19 (typeID 1) at offset 9723904 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 19 unlock at 9723904 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 20 (typeID 1) at offset 9732096 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 20 unlock at 9732096 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 21 (typeID 1) at offset 9740288 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 21 unlock at 9740288 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 22 (typeID 1) at offset 9748480 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 22 unlock at 9748480 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 23 (typeID 1) at offset 9756672 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 23 unlock at 9756672 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 24 (typeID 1) at offset 9764864 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 24 unlock at 9764864 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 25 (typeID 1) at offset 9773056 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 25 unlock at 9773056 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 26 (typeID 1) at offset 9781248 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 26 unlock at 9781248 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 27 (typeID 1) at offset 9789440 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 27 unlock at 9789440 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 28 (typeID 1) at offset 9797632 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 28 unlock at 9797632 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 29 (typeID 1) at offset 9805824 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 29 unlock at 9805824 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 30 (typeID 1) at offset 9814016 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 30 unlock at 9814016 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 31 (typeID 1) at offset 9822208 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 31 unlock at 9822208 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 112 (typeID 1) at offset 10485760 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 112 unlock at 10485760 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 113 (typeID 1) at offset 10493952 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 113 unlock at 10493952 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 114 (typeID 1) at offset 10502144 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 114 unlock at 10502144 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 115 (typeID 1) at offset 10510336 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 115 unlock at 10510336 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 116 (typeID 1) at offset 10518528 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 116 unlock at 10518528 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 117 (typeID 1) at offset 10526720 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 117 unlock at 10526720 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 118 (typeID 1) at offset 10534912 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 118 unlock at 10534912 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 119 (typeID 1) at offset 10543104 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 119 unlock at 10543104 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1792 (typeID 1) at offset 25165824 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1792 unlock at 25165824 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 120 (typeID 1) at offset 10551296 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 120 unlock at 10551296 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 121 (typeID 1) at offset 10559488 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 121 unlock at 10559488 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 122 (typeID 1) at offset 10567680 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 122 unlock at 10567680 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 123 (typeID 1) at offset 10575872 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 123 unlock at 10575872 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 124 (typeID 1) at offset 10584064 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 124 unlock at 10584064 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 125 (typeID 1) at offset 10592256 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 125 unlock at 10592256 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 126 (typeID 1) at offset 10600448 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 126 unlock at 10600448 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 127 (typeID 1) at offset 10608640 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 127 unlock at 10608640 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 48 (typeID 1) at offset 9961472 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 48 unlock at 9961472 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 49 (typeID 1) at offset 9969664 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 49 unlock at 9969664 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 50 (typeID 1) at offset 9977856 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 50 unlock at 9977856 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 51 (typeID 1) at offset 9986048 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 51 unlock at 9986048 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 52 (typeID 1) at offset 9994240 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 52 unlock at 9994240 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 53 (typeID 1) at offset 10002432 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 53 unlock at 10002432 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 54 (typeID 1) at offset 10010624 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 54 unlock at 10010624 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 55 (typeID 1) at offset 10018816 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 55 unlock at 10018816 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 56 (typeID 1) at offset 10027008 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 56 unlock at 10027008 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 57 (typeID 1) at offset 10035200 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 57 unlock at 10035200 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 58 (typeID 1) at offset 10043392 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 58 unlock at 10043392 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 59 (typeID 1) at offset 10051584 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 59 unlock at 10051584 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 60 (typeID 1) at offset 10059776 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 60 unlock at 10059776 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 61 (typeID 1) at offset 10067968 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 61 unlock at 10067968 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 62 (typeID 1) at offset 10076160 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 62 unlock at 10076160 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 63 (typeID 1) at offset 10084352 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 63 unlock at 10084352 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1824 (typeID 1) at offset 25427968 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1824 unlock at 25427968 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1825 (typeID 1) at offset 25436160 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1825 unlock at 25436160 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1826 (typeID 1) at offset 25444352 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1826 unlock at 25444352 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1827 (typeID 1) at offset 25452544 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1827 unlock at 25452544 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1828 (typeID 1) at offset 25460736 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1828 unlock at 25460736 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1829 (typeID 1) at offset 25468928 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1829 unlock at 25468928 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1830 (typeID 1) at offset 25477120 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1830 unlock at 25477120 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1831 (typeID 1) at offset 25485312 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1831 unlock at 25485312 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 64 (typeID 1) at offset 10092544 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 64 unlock at 10092544 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1832 (typeID 1) at offset 25493504 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1832 unlock at 25493504 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1833 (typeID 1) at offset 25501696 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1833 unlock at 25501696 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1834 (typeID 1) at offset 25509888 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1834 unlock at 25509888 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1835 (typeID 1) at offset 25518080 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1835 unlock at 25518080 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1836 (typeID 1) at offset 25526272 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1836 unlock at 25526272 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1837 (typeID 1) at offset 25534464 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1837 unlock at 25534464 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1838 (typeID 1) at offset 25542656 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1838 unlock at 25542656 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1839 (typeID 1) at offset 25550848 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1839 unlock at 25550848 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 0 (typeID 2) at offset 161546240 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 0 unlock at 161546240 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 13 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 0 (typeID 7) at offset 9502720 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 0 unlock at 9502720 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 15 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 1 (typeID 7) at offset 9510912 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 1 unlock at 9510912 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 3 (typeID 7) at offset 9527296 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 3 unlock at 9527296 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.097Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 4 (typeID 7) at offset 9535488 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.098Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 4 unlock at 9535488 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.098Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 7 (typeID 7) at offset 9560064 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.098Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 7 unlock at 9560064 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.098Z cpu1:1048781)Res3: 2455: 'nvme': Failed to unlock cluster 114 (typeID 7) at offset 25116672 (allowRetry: 0): No connection
- 2020-09-07T09:13:03.098Z cpu1:1048781)Res3: 3142: 'nvme': RC cNum 114 unlock at 25116672 failed; didRequeue 0 force 1 attempt 1 of 5, ret:No connection,lockgen 11, token 3 HBgen 11
- 2020-09-07T09:13:03.098Z cpu0:1048781)Vol3: 1982: Couldn't read volume header from 5f55ed96-bd314c2d-4d96-ac1f6be46fbe: No connection
- 2020-09-07T09:13:03.098Z cpu0:1048781)WARNING: LVM: 6349: Failed to close device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00:1: Busy
- 2020-09-07T09:13:03.098Z cpu0:1048781)Vol3: 4135: Error closing the volume: Failure. Eviction fails.
- 2020-09-07T09:13:13.350Z cpu3:1049306)NMP: nmp_ResetDeviceLogThrottling:3776: last error status from device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 repeated 10 times
- 2020-09-07T09:15:45.569Z cpu12:1058015)SchedVsi: 2098: Group: host/vim/vmvisor/sfcb(721): min=122 max=122, units: mb
- 2020-09-07T09:15:45.569Z cpu12:1058015)SchedVsi: 2098: Group: host/vim/vmvisor/sfcb_aux(722): min=182 max=182, units: mb
- 2020-09-07T09:15:45.601Z cpu1:1058023)SchedVsi: 2098: Group: host/vim/vmvisor/plugins/vmware_int(59726): max=70 min=70 minLimit=unlimited shares=1000, units: mb
- 2020-09-07T09:15:45.601Z cpu1:1058023)SchedVsi: 2098: Group: host/vim/vmvisor/plugins/vmware_raw(59727): max=70 min=70 minLimit=unlimited shares=1000, units: mb
- 2020-09-07T09:15:45.601Z cpu1:1058023)SchedVsi: 2098: Group: host/vim/vmvisor/plugins/vmware_base(59728): max=80 min=80 minLimit=unlimited shares=1000, units: mb
- 2020-09-07T09:15:45.601Z cpu1:1058023)SchedVsi: 2098: Group: host/vim/vmvisor/plugins/iodm_group(59729): max=70 min=70 minLimit=unlimited shares=1000, units: mb
- 2020-09-07T09:15:45.601Z cpu1:1058023)SchedVsi: 2098: Group: host/vim/vmvisor/plugins/vmware_aux(59730): max=70 min=70 minLimit=unlimited shares=1000, units: mb
- 2020-09-07T09:15:45.601Z cpu1:1058023)SchedVsi: 2098: Group: host/vim/vmvisor/plugins/vmw_ipmi(59731): max=100 min=100 minLimit=unlimited shares=1000, units: mb
- 2020-09-07T09:15:45.796Z cpu0:1058050)SchedVsi: 2098: Group: host/vim/vmvisor/wsman(744): min=46 max=46, units: mb
- 2020-09-07T09:16:13.350Z cpu15:1048874)ScsiVmas: 1052: Inquiry for VPD page 00 to device t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 failed with error No connection
- 2020-09-07T09:16:13.350Z cpu13:1049275)WARNING: NVMEPSA:63 Complete vmkNvmeCmd: 0x455a737849c0, vmkPsaCmd: 0x455a414f3240, cmdId.initiator=0x451a0939bc88, CmdSN: 0x0, status: 0x80d
- 2020-09-07T09:16:13.350Z cpu13:1049275)WARNING: NvmeScsi: 139: SCSI opcode 0xff (0x455a414f3240) on path vmhba5:C0:T0:L0 to namespace t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00 failed with NVMe host error
- 2020-09-07T09:16:13.350Z cpu13:1049275)WARNING: status: 0xe translating to SCSI error H:0x1
- 2020-09-07T09:16:13.350Z cpu13:1049275)NMP: nmp_ThrottleLogForDevice:3856: Cmd 0x0 (0x455a414f3240, 0) to dev "t10.NVMe____WDS100T3X0C2D00SJG0______________________160D0D448B441B00" on path "vmhba5:C0:T0:L0" Failed:
- 2020-09-07T09:16:13.350Z cpu13:1049275)NMP: nmp_ThrottleLogForDevice:3865: H:0x1 D:0x0 P:0x0 Invalid sense data: 0x0 0x0 0x0. Act:NONE. cmdId.initiator=0x451a0939bc88 CmdSN 0x0
- 2020-09-07T09:17:18.790Z cpu0:1050517)FSS: 147: Reservation state of LOCKER-5f54eb38-91d86cc1-1422-ac1f6be46fbe moved from Idle to Ready
- 2020-09-07T09:17:36.206Z cpu0:1048611)ScsiDeviceIO: 4035: Cmd(0x455a746547c0) 0x1a, CmdSN 0x516c from world 0 to dev "mpx.vmhba32:C0:T0:L0" failed H:0x0 D:0x2 P:0x0 Valid sense data: 0x5 0x24 0x0.
- 2020-09-07T09:17:36.237Z cpu3:1052376)NetPort: 1774: disabled port 0x600000d
- 2020-09-07T09:17:36.237Z cpu3:1052376)Net: 3566: disconnected client from port 0x600000d
- 2020-09-07T09:17:36.237Z cpu3:1052376)NetPort: 1774: disabled port 0x400000e
- 2020-09-07T09:17:36.237Z cpu3:1052376)Net: 3566: disconnected client from port 0x400000e
- 2020-09-07T09:17:36.238Z cpu3:1052376)VSCSI: 6938: handle 8193(vscsi0:0):Destroying Device for world 1052377 (pendCom 0)
- 2020-09-07T09:17:36.238Z cpu3:1052376)VSCSI: 6938: handle 8194(vscsi0:1):Destroying Device for world 1052377 (pendCom 0)
- 2020-09-07T09:17:36.238Z cpu3:1052376)VSCSI: 6938: handle 8195(vscsi0:2):Destroying Device for world 1052377 (pendCom 0)
- 2020-09-07T09:17:36.238Z cpu3:1052376)VSCSI: 6938: handle 8196(vscsi0:3):Destroying Device for world 1052377 (pendCom 0)
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement