API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jun 23rd, 2017
74
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 60.27 KB | None | 0 0
raw download clone embed print report
  1. Oct 29 21:01:57 fishserver2 kernel: [ 3210.603235] md: md127 stopped.
  2. Oct 29 21:01:57 fishserver2 kernel: [ 3210.603240] md: unbind<sdi1>
  3. Oct 29 21:01:57 fishserver2 kernel: [ 3210.610575] md: export_rdev(sdi1)
  4. Oct 29 21:01:57 fishserver2 kernel: [ 3210.610602] md: unbind<sdh1>
  5. Oct 29 21:01:57 fishserver2 kernel: [ 3210.618549] md: export_rdev(sdh1)
  6. Oct 29 21:01:57 fishserver2 kernel: [ 3210.618573] md: unbind<sdg1>
  7. Oct 29 21:01:57 fishserver2 kernel: [ 3210.626525] md: export_rdev(sdg1)
  8. Oct 29 21:01:57 fishserver2 kernel: [ 3210.626546] md: unbind<sde1>
  9. Oct 29 21:01:57 fishserver2 kernel: [ 3210.634501] md: export_rdev(sde1)
  10. Oct 29 21:01:57 fishserver2 kernel: [ 3210.634523] md: unbind<sdf1>
  11. Oct 29 21:01:57 fishserver2 kernel: [ 3210.642477] md: export_rdev(sdf1)
  12. Oct 29 21:01:57 fishserver2 kernel: [ 3210.642498] md: unbind<sdb1>
  13. Oct 29 21:01:58 fishserver2 kernel: [ 3210.650453] md: export_rdev(sdb1)
  14. Oct 29 21:01:58 fishserver2 kernel: [ 3210.650474] md: unbind<sdc1>
  15. Oct 29 21:01:58 fishserver2 kernel: [ 3210.658429] md: export_rdev(sdc1)
  16. Oct 29 21:01:58 fishserver2 kernel: [ 3210.658451] md: unbind<sdd1>
  17. Oct 29 21:01:58 fishserver2 kernel: [ 3210.666405] md: export_rdev(sdd1)
  18. Oct 29 21:01:58 fishserver2 kernel: [ 3210.666459] md127: detected capacity change from 10502084755456 to 0
  19. Oct 29 21:02:12 fishserver2 kernel: [ 3224.947168] md: bind<sdb1>
  20. Oct 29 21:02:12 fishserver2 kernel: [ 3224.947716] md: bind<sdc1>
  21. Oct 29 21:02:12 fishserver2 kernel: [ 3224.948254] md: bind<sdd1>
  22. Oct 29 21:02:12 fishserver2 kernel: [ 3224.948841] md: bind<sde1>
  23. Oct 29 21:02:12 fishserver2 kernel: [ 3224.949372] md: bind<sdf1>
  24. Oct 29 21:02:12 fishserver2 kernel: [ 3224.949918] md: bind<sdg1>
  25. Oct 29 21:02:12 fishserver2 kernel: [ 3224.950482] md: bind<sdh1>
  26. Oct 29 21:02:12 fishserver2 kernel: [ 3224.950596] md: bind<sdi1>
  27. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951094] raid5: device sdh1 operational as raid disk 6
  28. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951096] raid5: device sdg1 operational as raid disk 5
  29. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951097] raid5: device sdf1 operational as raid disk 4
  30. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951098] raid5: device sde1 operational as raid disk 3
  31. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951100] raid5: device sdd1 operational as raid disk 2
  32. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951101] raid5: device sdc1 operational as raid disk 1
  33. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951102] raid5: device sdb1 operational as raid disk 0
  34. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951458] raid5: allocated 8472kB for md0
  35. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951474] 6: w=1 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  36. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951476] 5: w=2 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  37. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951477] 4: w=3 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  38. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951479] 3: w=4 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  39. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951480] 2: w=5 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  40. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951482] 1: w=6 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  41. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951483] 0: w=7 pa=0 pr=8 m=1 a=2 r=8 op1=0 op2=0
  42. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951485] raid5: raid level 5 set md0 active with 7 out of 8 devices, algorithm 2
  43. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951486] RAID5 conf printout:
  44. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951487] --- rd:8 wd:7
  45. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951488] disk 0, o:1, dev:sdb1
  46. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951489] disk 1, o:1, dev:sdc1
  47. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951490] disk 2, o:1, dev:sdd1
  48. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951491] disk 3, o:1, dev:sde1
  49. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951492] disk 4, o:1, dev:sdf1
  50. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951493] disk 5, o:1, dev:sdg1
  51. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951494] disk 6, o:1, dev:sdh1
  52. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951513] md0: detected capacity change from 0 to 10502084755456
  53. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951591] RAID5 conf printout:
  54. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951592] --- rd:8 wd:7
  55. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951594] disk 0, o:1, dev:sdb1
  56. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951596] disk 1, o:1, dev:sdc1
  57. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951598] disk 2, o:1, dev:sdd1
  58. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951600] disk 3, o:1, dev:sde1
  59. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951601] disk 4, o:1, dev:sdf1
  60. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951603] disk 5, o:1, dev:sdg1
  61. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951604] disk 6, o:1, dev:sdh1
  62. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951606] disk 7, o:1, dev:sdi1
  63. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951622] md: recovery of RAID array md0
  64. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951624] md: minimum _guaranteed_ speed: 1000 KB/sec/disk.
  65. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951625] md: using maximum available idle IO bandwidth (but not more than 200000 KB/sec) for recovery.
  66. Oct 29 21:02:12 fishserver2 kernel: [ 3224.951635] md: using 128k window, over a total of 1465134592 blocks.
  67. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248669] sas: command 0xffff88031bd20000, task 0xffff8803181f8c40, timed out: BLK_EH_NOT_HANDLED
  68. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248674] sas: command 0xffff88031bd21500, task 0xffff8803181f8700, timed out: BLK_EH_NOT_HANDLED
  69. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248677] sas: command 0xffff88031bd21300, task 0xffff8803181f8e00, timed out: BLK_EH_NOT_HANDLED
  70. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248680] sas: command 0xffff88031b402d00, task 0xffff8803181f8000, timed out: BLK_EH_NOT_HANDLED
  71. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248683] sas: command 0xffff88031b403e00, task 0xffff8803181f8fc0, timed out: BLK_EH_NOT_HANDLED
  72. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248686] sas: command 0xffff88031bd21200, task 0xffff8803181f8a80, timed out: BLK_EH_NOT_HANDLED
  73. Oct 29 21:02:42 fishserver2 kernel: [ 3255.248688] sas: command 0xffff88031bd20200, task 0xffff8803181f8540, timed out: BLK_EH_NOT_HANDLED
  74. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260601] sas: command 0xffff880316e3cd00, task 0xffff8803181f81c0, timed out: BLK_EH_NOT_HANDLED
  75. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260605] sas: command 0xffff880316e3cc00, task 0xffff8803181f88c0, timed out: BLK_EH_NOT_HANDLED
  76. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260608] sas: command 0xffff88031b402a00, task 0xffff8803181f8380, timed out: BLK_EH_NOT_HANDLED
  77. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260611] sas: command 0xffff88031b402e00, task 0xffff8803181f9180, timed out: BLK_EH_NOT_HANDLED
  78. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260620] sas: Enter sas_scsi_recover_host
  79. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260622] sas: trying to find task 0xffff8803181f8c40
  80. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260624] sas: sas_scsi_find_task: aborting task 0xffff8803181f8c40
  81. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260627] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  82. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260630] sas: sas_scsi_find_task: querying task 0xffff8803181f8c40
  83. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260632] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  84. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260635] sas: sas_scsi_find_task: task 0xffff8803181f8c40 failed to abort
  85. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260637] sas: task 0xffff8803181f8c40 is not at LU: I_T recover
  86. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260639] sas: I_T nexus reset for dev 0000000000000000
  87. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260641] sas: I_T 0000000000000000 recovered
  88. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260645] sas: trying to find task 0xffff8803181f8700
  89. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260647] sas: sas_scsi_find_task: aborting task 0xffff8803181f8700
  90. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260649] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  91. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260652] sas: sas_scsi_find_task: querying task 0xffff8803181f8700
  92. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260654] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  93. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260656] sas: sas_scsi_find_task: task 0xffff8803181f8700 failed to abort
  94. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260659] sas: task 0xffff8803181f8700 is not at LU: I_T recover
  95. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260661] sas: I_T nexus reset for dev 0100000000000000
  96. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260663] sas: I_T 0100000000000000 recovered
  97. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260674] sas: trying to find task 0xffff8803181f8000
  98. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260676] sas: sas_scsi_find_task: aborting task 0xffff8803181f8000
  99. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260679] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  100. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260681] sas: sas_scsi_find_task: querying task 0xffff8803181f8000
  101. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260684] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  102. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260686] sas: sas_scsi_find_task: task 0xffff8803181f8000 failed to abort
  103. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260688] sas: task 0xffff8803181f8000 is not at LU: I_T recover
  104. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260690] sas: I_T nexus reset for dev 0200000000000000
  105. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260692] sas: I_T 0200000000000000 recovered
  106. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260705] sas: trying to find task 0xffff8803181f8a80
  107. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260706] sas: sas_scsi_find_task: aborting task 0xffff8803181f8a80
  108. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260707] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  109. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260708] sas: sas_scsi_find_task: querying task 0xffff8803181f8a80
  110. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260710] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  111. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260711] sas: sas_scsi_find_task: task 0xffff8803181f8a80 failed to abort
  112. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260712] sas: task 0xffff8803181f8a80 is not at LU: I_T recover
  113. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260713] sas: I_T nexus reset for dev 0600000000000000
  114. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260714] sas: I_T 0600000000000000 recovered
  115. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260720] sas: trying to find task 0xffff8803181f81c0
  116. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260721] sas: sas_scsi_find_task: aborting task 0xffff8803181f81c0
  117. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260722] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  118. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260723] sas: sas_scsi_find_task: querying task 0xffff8803181f81c0
  119. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260724] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  120. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260726] sas: sas_scsi_find_task: task 0xffff8803181f81c0 failed to abort
  121. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260727] sas: task 0xffff8803181f81c0 is not at LU: I_T recover
  122. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260728] sas: I_T nexus reset for dev 0300000000000000
  123. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260729] sas: I_T 0300000000000000 recovered
  124. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260730] sas: trying to find task 0xffff8803181f88c0
  125. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260731] sas: sas_scsi_find_task: aborting task 0xffff8803181f88c0
  126. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260732] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  127. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260733] sas: sas_scsi_find_task: querying task 0xffff8803181f88c0
  128. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260735] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  129. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260736] sas: sas_scsi_find_task: task 0xffff8803181f88c0 failed to abort
  130. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260737] sas: task 0xffff8803181f88c0 is not at LU: I_T recover
  131. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260738] sas: I_T nexus reset for dev 0400000000000000
  132. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260739] sas: I_T 0400000000000000 recovered
  133. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260740] sas: trying to find task 0xffff8803181f8380
  134. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260741] sas: sas_scsi_find_task: aborting task 0xffff8803181f8380
  135. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260742] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  136. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260743] sas: sas_scsi_find_task: querying task 0xffff8803181f8380
  137. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260744] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  138. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260746] sas: sas_scsi_find_task: task 0xffff8803181f8380 failed to abort
  139. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260747] sas: task 0xffff8803181f8380 is not at LU: I_T recover
  140. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260748] sas: I_T nexus reset for dev 0500000000000000
  141. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260749] sas: I_T 0500000000000000 recovered
  142. Oct 29 21:02:42 fishserver2 kernel: [ 3255.260761] sas: --- Exit sas_scsi_recover_host
  143. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168660] sas: command 0xffff88031bd20000, task 0xffff8803181f9180, timed out: BLK_EH_NOT_HANDLED
  144. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168664] sas: command 0xffff88031bd21300, task 0xffff8803181f8380, timed out: BLK_EH_NOT_HANDLED
  145. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168667] sas: command 0xffff88031bd21500, task 0xffff8803181f88c0, timed out: BLK_EH_NOT_HANDLED
  146. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168670] sas: command 0xffff88031b403e00, task 0xffff8803181f81c0, timed out: BLK_EH_NOT_HANDLED
  147. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168673] sas: command 0xffff88031b402d00, task 0xffff8803181f8540, timed out: BLK_EH_NOT_HANDLED
  148. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168676] sas: command 0xffff88031bd20200, task 0xffff8803181f8700, timed out: BLK_EH_NOT_HANDLED
  149. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168679] sas: command 0xffff88031bd21200, task 0xffff8803181f8c40, timed out: BLK_EH_NOT_HANDLED
  150. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168682] sas: command 0xffff880316e3cd00, task 0xffff8803181f8a80, timed out: BLK_EH_NOT_HANDLED
  151. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168685] sas: command 0xffff880316e3cc00, task 0xffff8803181f8fc0, timed out: BLK_EH_NOT_HANDLED
  152. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168688] sas: command 0xffff88031b402e00, task 0xffff8803181f8000, timed out: BLK_EH_NOT_HANDLED
  153. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168691] sas: command 0xffff88031b402a00, task 0xffff8803181f8e00, timed out: BLK_EH_NOT_HANDLED
  154. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168697] sas: Enter sas_scsi_recover_host
  155. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168699] sas: trying to find task 0xffff8803181f9180
  156. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168701] sas: sas_scsi_find_task: aborting task 0xffff8803181f9180
  157. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168704] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  158. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168707] sas: sas_scsi_find_task: querying task 0xffff8803181f9180
  159. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168709] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  160. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168712] sas: sas_scsi_find_task: task 0xffff8803181f9180 failed to abort
  161. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168714] sas: task 0xffff8803181f9180 is not at LU: I_T recover
  162. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168716] sas: I_T nexus reset for dev 0000000000000000
  163. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168718] sas: I_T 0000000000000000 recovered
  164. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168721] sas: trying to find task 0xffff8803181f8380
  165. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168723] sas: sas_scsi_find_task: aborting task 0xffff8803181f8380
  166. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168725] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  167. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168728] sas: sas_scsi_find_task: querying task 0xffff8803181f8380
  168. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168730] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  169. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168732] sas: sas_scsi_find_task: task 0xffff8803181f8380 failed to abort
  170. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168735] sas: task 0xffff8803181f8380 is not at LU: I_T recover
  171. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168737] sas: I_T nexus reset for dev 0100000000000000
  172. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168739] sas: I_T 0100000000000000 recovered
  173. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168750] sas: trying to find task 0xffff8803181f81c0
  174. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168752] sas: sas_scsi_find_task: aborting task 0xffff8803181f81c0
  175. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168755] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  176. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168757] sas: sas_scsi_find_task: querying task 0xffff8803181f81c0
  177. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168760] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  178. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168762] sas: sas_scsi_find_task: task 0xffff8803181f81c0 failed to abort
  179. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168767] sas: task 0xffff8803181f81c0 is not at LU: I_T recover
  180. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168768] sas: I_T nexus reset for dev 0200000000000000
  181. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168769] sas: I_T 0200000000000000 recovered
  182. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168774] sas: trying to find task 0xffff8803181f8700
  183. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168775] sas: sas_scsi_find_task: aborting task 0xffff8803181f8700
  184. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168777] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  185. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168778] sas: sas_scsi_find_task: querying task 0xffff8803181f8700
  186. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168779] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  187. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168780] sas: sas_scsi_find_task: task 0xffff8803181f8700 failed to abort
  188. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168781] sas: task 0xffff8803181f8700 is not at LU: I_T recover
  189. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168782] sas: I_T nexus reset for dev 0600000000000000
  190. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168783] sas: I_T 0600000000000000 recovered
  191. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168789] sas: trying to find task 0xffff8803181f8a80
  192. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168790] sas: sas_scsi_find_task: aborting task 0xffff8803181f8a80
  193. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168791] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  194. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168792] sas: sas_scsi_find_task: querying task 0xffff8803181f8a80
  195. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168794] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  196. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168795] sas: sas_scsi_find_task: task 0xffff8803181f8a80 failed to abort
  197. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168796] sas: task 0xffff8803181f8a80 is not at LU: I_T recover
  198. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168797] sas: I_T nexus reset for dev 0300000000000000
  199. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168798] sas: I_T 0300000000000000 recovered
  200. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168799] sas: trying to find task 0xffff8803181f8fc0
  201. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168800] sas: sas_scsi_find_task: aborting task 0xffff8803181f8fc0
  202. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168801] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  203. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168803] sas: sas_scsi_find_task: querying task 0xffff8803181f8fc0
  204. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168804] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  205. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168805] sas: sas_scsi_find_task: task 0xffff8803181f8fc0 failed to abort
  206. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168806] sas: task 0xffff8803181f8fc0 is not at LU: I_T recover
  207. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168807] sas: I_T nexus reset for dev 0400000000000000
  208. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168808] sas: I_T 0400000000000000 recovered
  209. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168809] sas: trying to find task 0xffff8803181f8000
  210. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168810] sas: sas_scsi_find_task: aborting task 0xffff8803181f8000
  211. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168812] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  212. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168813] sas: sas_scsi_find_task: querying task 0xffff8803181f8000
  213. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168814] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  214. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168815] sas: sas_scsi_find_task: task 0xffff8803181f8000 failed to abort
  215. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168816] sas: task 0xffff8803181f8000 is not at LU: I_T recover
  216. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168817] sas: I_T nexus reset for dev 0500000000000000
  217. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168818] sas: I_T 0500000000000000 recovered
  218. Oct 29 21:03:13 fishserver2 kernel: [ 3286.168829] sas: --- Exit sas_scsi_recover_host
  219. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076794] sas: command 0xffff88031bd20000, task 0xffff8803181f8e00, timed out: BLK_EH_NOT_HANDLED
  220. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076798] sas: command 0xffff88031bd21500, task 0xffff8803181f8000, timed out: BLK_EH_NOT_HANDLED
  221. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076801] sas: command 0xffff88031bd21300, task 0xffff8803181f8fc0, timed out: BLK_EH_NOT_HANDLED
  222. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076804] sas: command 0xffff88031b402d00, task 0xffff8803181f8a80, timed out: BLK_EH_NOT_HANDLED
  223. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076807] sas: command 0xffff88031b403e00, task 0xffff8803181f8c40, timed out: BLK_EH_NOT_HANDLED
  224. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076810] sas: command 0xffff88031bd21200, task 0xffff8803181f8380, timed out: BLK_EH_NOT_HANDLED
  225. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076813] sas: command 0xffff88031bd20200, task 0xffff8803181f9180, timed out: BLK_EH_NOT_HANDLED
  226. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076816] sas: command 0xffff880316e3cd00, task 0xffff8803181f8700, timed out: BLK_EH_NOT_HANDLED
  227. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076819] sas: command 0xffff880316e3cc00, task 0xffff8803181f8540, timed out: BLK_EH_NOT_HANDLED
  228. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076821] sas: command 0xffff88031b402a00, task 0xffff8803181f81c0, timed out: BLK_EH_NOT_HANDLED
  229. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076824] sas: command 0xffff88031b402e00, task 0xffff8803181f88c0, timed out: BLK_EH_NOT_HANDLED
  230. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076832] sas: Enter sas_scsi_recover_host
  231. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076834] sas: trying to find task 0xffff8803181f8e00
  232. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076837] sas: sas_scsi_find_task: aborting task 0xffff8803181f8e00
  233. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076840] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  234. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076842] sas: sas_scsi_find_task: querying task 0xffff8803181f8e00
  235. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076845] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  236. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076847] sas: sas_scsi_find_task: task 0xffff8803181f8e00 failed to abort
  237. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076850] sas: task 0xffff8803181f8e00 is not at LU: I_T recover
  238. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076852] sas: I_T nexus reset for dev 0000000000000000
  239. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076854] sas: I_T 0000000000000000 recovered
  240. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076857] sas: trying to find task 0xffff8803181f8000
  241. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076859] sas: sas_scsi_find_task: aborting task 0xffff8803181f8000
  242. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076861] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  243. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076864] sas: sas_scsi_find_task: querying task 0xffff8803181f8000
  244. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076866] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  245. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076869] sas: sas_scsi_find_task: task 0xffff8803181f8000 failed to abort
  246. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076871] sas: task 0xffff8803181f8000 is not at LU: I_T recover
  247. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076873] sas: I_T nexus reset for dev 0100000000000000
  248. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076875] sas: I_T 0100000000000000 recovered
  249. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076887] sas: trying to find task 0xffff8803181f8a80
  250. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076889] sas: sas_scsi_find_task: aborting task 0xffff8803181f8a80
  251. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076892] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  252. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076896] sas: sas_scsi_find_task: querying task 0xffff8803181f8a80
  253. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076897] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  254. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076898] sas: sas_scsi_find_task: task 0xffff8803181f8a80 failed to abort
  255. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076899] sas: task 0xffff8803181f8a80 is not at LU: I_T recover
  256. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076901] sas: I_T nexus reset for dev 0200000000000000
  257. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076902] sas: I_T 0200000000000000 recovered
  258. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076907] sas: trying to find task 0xffff8803181f8380
  259. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076908] sas: sas_scsi_find_task: aborting task 0xffff8803181f8380
  260. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076910] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  261. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076911] sas: sas_scsi_find_task: querying task 0xffff8803181f8380
  262. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076912] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  263. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076913] sas: sas_scsi_find_task: task 0xffff8803181f8380 failed to abort
  264. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076914] sas: task 0xffff8803181f8380 is not at LU: I_T recover
  265. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076915] sas: I_T nexus reset for dev 0600000000000000
  266. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076916] sas: I_T 0600000000000000 recovered
  267. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076922] sas: trying to find task 0xffff8803181f8700
  268. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076923] sas: sas_scsi_find_task: aborting task 0xffff8803181f8700
  269. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076925] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  270. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076926] sas: sas_scsi_find_task: querying task 0xffff8803181f8700
  271. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076927] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  272. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076928] sas: sas_scsi_find_task: task 0xffff8803181f8700 failed to abort
  273. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076929] sas: task 0xffff8803181f8700 is not at LU: I_T recover
  274. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076930] sas: I_T nexus reset for dev 0300000000000000
  275. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076931] sas: I_T 0300000000000000 recovered
  276. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076932] sas: trying to find task 0xffff8803181f8540
  277. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076933] sas: sas_scsi_find_task: aborting task 0xffff8803181f8540
  278. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076935] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  279. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076936] sas: sas_scsi_find_task: querying task 0xffff8803181f8540
  280. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076937] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  281. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076938] sas: sas_scsi_find_task: task 0xffff8803181f8540 failed to abort
  282. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076939] sas: task 0xffff8803181f8540 is not at LU: I_T recover
  283. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076940] sas: I_T nexus reset for dev 0400000000000000
  284. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076941] sas: I_T 0400000000000000 recovered
  285. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076942] sas: trying to find task 0xffff8803181f81c0
  286. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076943] sas: sas_scsi_find_task: aborting task 0xffff8803181f81c0
  287. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076945] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  288. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076946] sas: sas_scsi_find_task: querying task 0xffff8803181f81c0
  289. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076947] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  290. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076948] sas: sas_scsi_find_task: task 0xffff8803181f81c0 failed to abort
  291. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076949] sas: task 0xffff8803181f81c0 is not at LU: I_T recover
  292. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076950] sas: I_T nexus reset for dev 0500000000000000
  293. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076951] sas: I_T 0500000000000000 recovered
  294. Oct 29 21:03:44 fishserver2 kernel: [ 3317.076963] sas: --- Exit sas_scsi_recover_host
  295. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985008] sas: command 0xffff88031bd20000, task 0xffff8803181f88c0, timed out: BLK_EH_NOT_HANDLED
  296. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985013] sas: command 0xffff88031bd21300, task 0xffff8803181f81c0, timed out: BLK_EH_NOT_HANDLED
  297. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985016] sas: command 0xffff88031bd21500, task 0xffff8803181f8540, timed out: BLK_EH_NOT_HANDLED
  298. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985019] sas: command 0xffff88031b403e00, task 0xffff8803181f8700, timed out: BLK_EH_NOT_HANDLED
  299. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985022] sas: command 0xffff88031b402d00, task 0xffff8803181f9180, timed out: BLK_EH_NOT_HANDLED
  300. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985025] sas: command 0xffff88031bd20200, task 0xffff8803181f8000, timed out: BLK_EH_NOT_HANDLED
  301. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985028] sas: command 0xffff88031bd21200, task 0xffff8803181f8e00, timed out: BLK_EH_NOT_HANDLED
  302. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985031] sas: command 0xffff880316e3cd00, task 0xffff8803181f8380, timed out: BLK_EH_NOT_HANDLED
  303. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985035] sas: command 0xffff880316e3cc00, task 0xffff8803181f8c40, timed out: BLK_EH_NOT_HANDLED
  304. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985038] sas: command 0xffff88031b402e00, task 0xffff8803181f8a80, timed out: BLK_EH_NOT_HANDLED
  305. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985041] sas: command 0xffff88031b402a00, task 0xffff8803181f8fc0, timed out: BLK_EH_NOT_HANDLED
  306. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985049] sas: Enter sas_scsi_recover_host
  307. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985051] sas: trying to find task 0xffff8803181f88c0
  308. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985054] sas: sas_scsi_find_task: aborting task 0xffff8803181f88c0
  309. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985058] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  310. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985061] sas: sas_scsi_find_task: querying task 0xffff8803181f88c0
  311. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985063] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  312. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985066] sas: sas_scsi_find_task: task 0xffff8803181f88c0 failed to abort
  313. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985068] sas: task 0xffff8803181f88c0 is not at LU: I_T recover
  314. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985070] sas: I_T nexus reset for dev 0000000000000000
  315. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985072] sas: I_T 0000000000000000 recovered
  316. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985076] sas: trying to find task 0xffff8803181f81c0
  317. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985078] sas: sas_scsi_find_task: aborting task 0xffff8803181f81c0
  318. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985081] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  319. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985083] sas: sas_scsi_find_task: querying task 0xffff8803181f81c0
  320. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985086] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  321. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985088] sas: sas_scsi_find_task: task 0xffff8803181f81c0 failed to abort
  322. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985090] sas: task 0xffff8803181f81c0 is not at LU: I_T recover
  323. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985092] sas: I_T nexus reset for dev 0100000000000000
  324. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985094] sas: I_T 0100000000000000 recovered
  325. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985108] sas: trying to find task 0xffff8803181f8700
  326. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985110] sas: sas_scsi_find_task: aborting task 0xffff8803181f8700
  327. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985111] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  328. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985112] sas: sas_scsi_find_task: querying task 0xffff8803181f8700
  329. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985113] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  330. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985115] sas: sas_scsi_find_task: task 0xffff8803181f8700 failed to abort
  331. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985116] sas: task 0xffff8803181f8700 is not at LU: I_T recover
  332. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985117] sas: I_T nexus reset for dev 0200000000000000
  333. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985118] sas: I_T 0200000000000000 recovered
  334. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985124] sas: trying to find task 0xffff8803181f8000
  335. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985126] sas: sas_scsi_find_task: aborting task 0xffff8803181f8000
  336. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985127] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  337. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985128] sas: sas_scsi_find_task: querying task 0xffff8803181f8000
  338. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985129] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  339. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985131] sas: sas_scsi_find_task: task 0xffff8803181f8000 failed to abort
  340. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985132] sas: task 0xffff8803181f8000 is not at LU: I_T recover
  341. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985133] sas: I_T nexus reset for dev 0600000000000000
  342. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985134] sas: I_T 0600000000000000 recovered
  343. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985140] sas: trying to find task 0xffff8803181f8380
  344. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985141] sas: sas_scsi_find_task: aborting task 0xffff8803181f8380
  345. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985143] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  346. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985144] sas: sas_scsi_find_task: querying task 0xffff8803181f8380
  347. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985145] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  348. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985146] sas: sas_scsi_find_task: task 0xffff8803181f8380 failed to abort
  349. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985147] sas: task 0xffff8803181f8380 is not at LU: I_T recover
  350. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985149] sas: I_T nexus reset for dev 0300000000000000
  351. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985149] sas: I_T 0300000000000000 recovered
  352. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985151] sas: trying to find task 0xffff8803181f8c40
  353. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985152] sas: sas_scsi_find_task: aborting task 0xffff8803181f8c40
  354. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985153] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  355. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985155] sas: sas_scsi_find_task: querying task 0xffff8803181f8c40
  356. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985156] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  357. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985157] sas: sas_scsi_find_task: task 0xffff8803181f8c40 failed to abort
  358. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985158] sas: task 0xffff8803181f8c40 is not at LU: I_T recover
  359. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985159] sas: I_T nexus reset for dev 0400000000000000
  360. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985160] sas: I_T 0400000000000000 recovered
  361. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985161] sas: trying to find task 0xffff8803181f8a80
  362. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985162] sas: sas_scsi_find_task: aborting task 0xffff8803181f8a80
  363. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985164] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  364. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985165] sas: sas_scsi_find_task: querying task 0xffff8803181f8a80
  365. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985166] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  366. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985167] sas: sas_scsi_find_task: task 0xffff8803181f8a80 failed to abort
  367. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985168] sas: task 0xffff8803181f8a80 is not at LU: I_T recover
  368. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985169] sas: I_T nexus reset for dev 0500000000000000
  369. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985170] sas: I_T 0500000000000000 recovered
  370. Oct 29 21:04:15 fishserver2 kernel: [ 3347.985186] sas: --- Exit sas_scsi_recover_host
  371. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892912] sas: command 0xffff88031bd20000, task 0xffff8803181f8fc0, timed out: BLK_EH_NOT_HANDLED
  372. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892917] sas: command 0xffff88031bd21500, task 0xffff8803181f8a80, timed out: BLK_EH_NOT_HANDLED
  373. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892920] sas: command 0xffff88031bd21300, task 0xffff8803181f8c40, timed out: BLK_EH_NOT_HANDLED
  374. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892923] sas: command 0xffff88031b402d00, task 0xffff8803181f8380, timed out: BLK_EH_NOT_HANDLED
  375. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892926] sas: command 0xffff88031b403e00, task 0xffff8803181f8e00, timed out: BLK_EH_NOT_HANDLED
  376. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892929] sas: command 0xffff88031bd21200, task 0xffff8803181f81c0, timed out: BLK_EH_NOT_HANDLED
  377. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892932] sas: command 0xffff88031bd20200, task 0xffff8803181f88c0, timed out: BLK_EH_NOT_HANDLED
  378. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892935] sas: command 0xffff880316e3cd00, task 0xffff8803181f8000, timed out: BLK_EH_NOT_HANDLED
  379. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892939] sas: command 0xffff880316e3cc00, task 0xffff8803181f9180, timed out: BLK_EH_NOT_HANDLED
  380. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892942] sas: command 0xffff88031b402a00, task 0xffff8803181f8700, timed out: BLK_EH_NOT_HANDLED
  381. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892945] sas: command 0xffff88031b402e00, task 0xffff8803181f8540, timed out: BLK_EH_NOT_HANDLED
  382. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892953] sas: Enter sas_scsi_recover_host
  383. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892955] sas: trying to find task 0xffff8803181f8fc0
  384. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892958] sas: sas_scsi_find_task: aborting task 0xffff8803181f8fc0
  385. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892962] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  386. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892964] sas: sas_scsi_find_task: querying task 0xffff8803181f8fc0
  387. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892967] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  388. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892969] sas: sas_scsi_find_task: task 0xffff8803181f8fc0 failed to abort
  389. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892972] sas: task 0xffff8803181f8fc0 is not at LU: I_T recover
  390. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892974] sas: I_T nexus reset for dev 0000000000000000
  391. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892976] sas: I_T 0000000000000000 recovered
  392. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892980] sas: trying to find task 0xffff8803181f8a80
  393. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892982] sas: sas_scsi_find_task: aborting task 0xffff8803181f8a80
  394. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892985] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  395. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892987] sas: sas_scsi_find_task: querying task 0xffff8803181f8a80
  396. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892990] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  397. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892992] sas: sas_scsi_find_task: task 0xffff8803181f8a80 failed to abort
  398. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892994] sas: task 0xffff8803181f8a80 is not at LU: I_T recover
  399. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892996] sas: I_T nexus reset for dev 0100000000000000
  400. Oct 29 21:04:46 fishserver2 kernel: [ 3378.892998] sas: I_T 0100000000000000 recovered
  401. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893013] sas: trying to find task 0xffff8803181f8380
  402. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893014] sas: sas_scsi_find_task: aborting task 0xffff8803181f8380
  403. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893015] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  404. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893016] sas: sas_scsi_find_task: querying task 0xffff8803181f8380
  405. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893018] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  406. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893019] sas: sas_scsi_find_task: task 0xffff8803181f8380 failed to abort
  407. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893020] sas: task 0xffff8803181f8380 is not at LU: I_T recover
  408. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893021] sas: I_T nexus reset for dev 0200000000000000
  409. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893022] sas: I_T 0200000000000000 recovered
  410. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893028] sas: trying to find task 0xffff8803181f81c0
  411. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893030] sas: sas_scsi_find_task: aborting task 0xffff8803181f81c0
  412. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893031] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  413. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893032] sas: sas_scsi_find_task: querying task 0xffff8803181f81c0
  414. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893033] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  415. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893035] sas: sas_scsi_find_task: task 0xffff8803181f81c0 failed to abort
  416. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893036] sas: task 0xffff8803181f81c0 is not at LU: I_T recover
  417. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893037] sas: I_T nexus reset for dev 0600000000000000
  418. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893038] sas: I_T 0600000000000000 recovered
  419. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893044] sas: trying to find task 0xffff8803181f8000
  420. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893045] sas: sas_scsi_find_task: aborting task 0xffff8803181f8000
  421. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893047] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  422. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893048] sas: sas_scsi_find_task: querying task 0xffff8803181f8000
  423. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893049] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  424. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893050] sas: sas_scsi_find_task: task 0xffff8803181f8000 failed to abort
  425. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893051] sas: task 0xffff8803181f8000 is not at LU: I_T recover
  426. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893052] sas: I_T nexus reset for dev 0300000000000000
  427. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893053] sas: I_T 0300000000000000 recovered
  428. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893055] sas: trying to find task 0xffff8803181f9180
  429. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893056] sas: sas_scsi_find_task: aborting task 0xffff8803181f9180
  430. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893057] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  431. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893058] sas: sas_scsi_find_task: querying task 0xffff8803181f9180
  432. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893060] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  433. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893061] sas: sas_scsi_find_task: task 0xffff8803181f9180 failed to abort
  434. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893062] sas: task 0xffff8803181f9180 is not at LU: I_T recover
  435. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893063] sas: I_T nexus reset for dev 0400000000000000
  436. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893064] sas: I_T 0400000000000000 recovered
  437. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893065] sas: trying to find task 0xffff8803181f8700
  438. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893066] sas: sas_scsi_find_task: aborting task 0xffff8803181f8700
  439. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893068] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  440. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893069] sas: sas_scsi_find_task: querying task 0xffff8803181f8700
  441. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893070] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  442. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893071] sas: sas_scsi_find_task: task 0xffff8803181f8700 failed to abort
  443. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893072] sas: task 0xffff8803181f8700 is not at LU: I_T recover
  444. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893073] sas: I_T nexus reset for dev 0500000000000000
  445. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893074] sas: I_T 0500000000000000 recovered
  446. Oct 29 21:04:46 fishserver2 kernel: [ 3378.893090] sas: --- Exit sas_scsi_recover_host
  447. Oct 29 21:05:12 fishserver2 udevd[1236]: worker [5167] unexpectedly returned with status 0x0100
  448. Oct 29 21:05:12 fishserver2 udevd[1236]: worker [5167] failed while handling '/devices/virtual/block/md0'
  449. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800918] sas: command 0xffff88031bd20000, task 0xffff8803181f8540, timed out: BLK_EH_NOT_HANDLED
  450. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800923] sas: command 0xffff88031bd21300, task 0xffff8803181f8700, timed out: BLK_EH_NOT_HANDLED
  451. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800926] sas: command 0xffff88031bd21500, task 0xffff8803181f9180, timed out: BLK_EH_NOT_HANDLED
  452. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800929] sas: command 0xffff88031b403e00, task 0xffff8803181f8000, timed out: BLK_EH_NOT_HANDLED
  453. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800933] sas: command 0xffff88031b402d00, task 0xffff8803181f88c0, timed out: BLK_EH_NOT_HANDLED
  454. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800936] sas: command 0xffff88031bd20200, task 0xffff8803181f8a80, timed out: BLK_EH_NOT_HANDLED
  455. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800939] sas: command 0xffff88031bd21200, task 0xffff8803181f8fc0, timed out: BLK_EH_NOT_HANDLED
  456. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800942] sas: command 0xffff880316e3cd00, task 0xffff8803181f81c0, timed out: BLK_EH_NOT_HANDLED
  457. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800945] sas: command 0xffff880316e3cc00, task 0xffff8803181f8e00, timed out: BLK_EH_NOT_HANDLED
  458. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800948] sas: command 0xffff88031b402e00, task 0xffff8803181f8380, timed out: BLK_EH_NOT_HANDLED
  459. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800951] sas: command 0xffff88031b402a00, task 0xffff8803181f8c40, timed out: BLK_EH_NOT_HANDLED
  460. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800961] sas: Enter sas_scsi_recover_host
  461. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800963] sas: trying to find task 0xffff8803181f8540
  462. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800966] sas: sas_scsi_find_task: aborting task 0xffff8803181f8540
  463. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800970] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  464. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800972] sas: sas_scsi_find_task: querying task 0xffff8803181f8540
  465. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800975] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  466. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800977] sas: sas_scsi_find_task: task 0xffff8803181f8540 failed to abort
  467. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800980] sas: task 0xffff8803181f8540 is not at LU: I_T recover
  468. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800982] sas: I_T nexus reset for dev 0000000000000000
  469. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800984] sas: I_T 0000000000000000 recovered
  470. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800989] sas: trying to find task 0xffff8803181f8700
  471. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800991] sas: sas_scsi_find_task: aborting task 0xffff8803181f8700
  472. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800994] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  473. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800996] sas: sas_scsi_find_task: querying task 0xffff8803181f8700
  474. Oct 29 21:05:17 fishserver2 kernel: [ 3409.800998] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  475. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801001] sas: sas_scsi_find_task: task 0xffff8803181f8700 failed to abort
  476. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801003] sas: task 0xffff8803181f8700 is not at LU: I_T recover
  477. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801005] sas: I_T nexus reset for dev 0100000000000000
  478. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801007] sas: I_T 0100000000000000 recovered
  479. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801022] sas: trying to find task 0xffff8803181f8000
  480. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801024] sas: sas_scsi_find_task: aborting task 0xffff8803181f8000
  481. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801025] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  482. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801026] sas: sas_scsi_find_task: querying task 0xffff8803181f8000
  483. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801028] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  484. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801029] sas: sas_scsi_find_task: task 0xffff8803181f8000 failed to abort
  485. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801030] sas: task 0xffff8803181f8000 is not at LU: I_T recover
  486. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801031] sas: I_T nexus reset for dev 0200000000000000
  487. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801032] sas: I_T 0200000000000000 recovered
  488. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801038] sas: trying to find task 0xffff8803181f8a80
  489. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801040] sas: sas_scsi_find_task: aborting task 0xffff8803181f8a80
  490. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801041] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  491. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801042] sas: sas_scsi_find_task: querying task 0xffff8803181f8a80
  492. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801043] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  493. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801045] sas: sas_scsi_find_task: task 0xffff8803181f8a80 failed to abort
  494. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801046] sas: task 0xffff8803181f8a80 is not at LU: I_T recover
  495. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801047] sas: I_T nexus reset for dev 0600000000000000
  496. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801048] sas: I_T 0600000000000000 recovered
  497. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801054] sas: trying to find task 0xffff8803181f81c0
  498. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801055] sas: sas_scsi_find_task: aborting task 0xffff8803181f81c0
  499. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801057] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  500. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801058] sas: sas_scsi_find_task: querying task 0xffff8803181f81c0
  501. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801059] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  502. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801060] sas: sas_scsi_find_task: task 0xffff8803181f81c0 failed to abort
  503. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801061] sas: task 0xffff8803181f81c0 is not at LU: I_T recover
  504. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801062] sas: I_T nexus reset for dev 0300000000000000
  505. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801063] sas: I_T 0300000000000000 recovered
  506. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801065] sas: trying to find task 0xffff8803181f8e00
  507. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801066] sas: sas_scsi_find_task: aborting task 0xffff8803181f8e00
  508. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801067] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  509. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801068] sas: sas_scsi_find_task: querying task 0xffff8803181f8e00
  510. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801070] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  511. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801071] sas: sas_scsi_find_task: task 0xffff8803181f8e00 failed to abort
  512. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801072] sas: task 0xffff8803181f8e00 is not at LU: I_T recover
  513. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801073] sas: I_T nexus reset for dev 0400000000000000
  514. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801074] sas: I_T 0400000000000000 recovered
  515. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801075] sas: trying to find task 0xffff8803181f8380
  516. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801076] sas: sas_scsi_find_task: aborting task 0xffff8803181f8380
  517. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801078] drivers/scsi/mvsas/mv_sas.c 1669:mvs_abort_task:rc= 5
  518. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801079] sas: sas_scsi_find_task: querying task 0xffff8803181f8380
  519. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801080] drivers/scsi/mvsas/mv_sas.c 1608:mvs_query_task:rc= 5
  520. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801081] sas: sas_scsi_find_task: task 0xffff8803181f8380 failed to abort
  521. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801082] sas: task 0xffff8803181f8380 is not at LU: I_T recover
  522. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801083] sas: I_T nexus reset for dev 0500000000000000
  523. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801084] sas: I_T 0500000000000000 recovered
  524. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801093] end_request: I/O error, dev sdb, sector 71
  525. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801096] md: super_written gets error=-5, uptodate=0
  526. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801098] raid5: Disk failure on sdb1, disabling device.
  527. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801099] raid5: Operation continuing on 6 devices.
  528. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801128] sd 24:0:1:0: [sdc] Unhandled error code
  529. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801129] sd 24:0:1:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  530. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801131] sd 24:0:1:0: [sdc] CDB: Read(10): 28 00 00 00 0c 57 00 03 e8 00
  531. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801135] end_request: I/O error, dev sdc, sector 3159
  532. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801137] raid5:md0: read error not correctable (sector 3096 on sdc1).
  533. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801139] raid5: Disk failure on sdc1, disabling device.
  534. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801139] raid5: Operation continuing on 5 devices.
  535. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801141] raid5:md0: read error not correctable (sector 3104 on sdc1).
  536. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801143] raid5:md0: read error not correctable (sector 3112 on sdc1).
  537. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801144] raid5:md0: read error not correctable (sector 3120 on sdc1).
  538. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801146] raid5:md0: read error not correctable (sector 3128 on sdc1).
  539. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801147] raid5:md0: read error not correctable (sector 3136 on sdc1).
  540. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801148] raid5:md0: read error not correctable (sector 3144 on sdc1).
  541. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801150] raid5:md0: read error not correctable (sector 3152 on sdc1).
  542. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801151] raid5:md0: read error not correctable (sector 3160 on sdc1).
  543. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801153] raid5:md0: read error not correctable (sector 3168 on sdc1).
  544. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801196] sd 24:0:1:0: [sdc] Unhandled error code
  545. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801197] sd 24:0:1:0: [sdc] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  546. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801199] sd 24:0:1:0: [sdc] CDB: Read(10): 28 00 00 00 08 57 00 04 00 00
  547. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801202] end_request: I/O error, dev sdc, sector 2135
  548. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801248] sd 24:0:2:0: [sdd] Unhandled error code
  549. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801249] sd 24:0:2:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  550. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801250] sd 24:0:2:0: [sdd] CDB: Read(10): 28 00 00 00 0c 4f 00 03 f0 00
  551. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801254] end_request: I/O error, dev sdd, sector 3151
  552. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801256] raid5: Disk failure on sdd1, disabling device.
  553. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801256] raid5: Operation continuing on 4 devices.
  554. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801296] sd 24:0:2:0: [sdd] Unhandled error code
  555. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801297] sd 24:0:2:0: [sdd] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  556. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801299] sd 24:0:2:0: [sdd] CDB: Read(10): 28 00 00 00 08 4f 00 04 00 00
  557. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801303] end_request: I/O error, dev sdd, sector 2127
  558. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801345] sd 24:0:6:0: [sdh] Unhandled error code
  559. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801346] sd 24:0:6:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  560. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801348] sd 24:0:6:0: [sdh] CDB: Read(10): 28 00 00 00 0c 3f 00 04 00 00
  561. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801351] end_request: I/O error, dev sdh, sector 3135
  562. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801353] raid5: Disk failure on sdh1, disabling device.
  563. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801354] raid5: Operation continuing on 3 devices.
  564. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801395] sd 24:0:6:0: [sdh] Unhandled error code
  565. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801396] sd 24:0:6:0: [sdh] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  566. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801398] sd 24:0:6:0: [sdh] CDB: Read(10): 28 00 00 00 08 3f 00 04 00 00
  567. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801401] end_request: I/O error, dev sdh, sector 2111
  568. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801436] end_request: I/O error, dev sde, sector 71
  569. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801438] md: super_written gets error=-5, uptodate=0
  570. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801439] raid5: Disk failure on sde1, disabling device.
  571. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801440] raid5: Operation continuing on 2 devices.
  572. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801451] end_request: I/O error, dev sdf, sector 71
  573. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801453] md: super_written gets error=-5, uptodate=0
  574. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801454] raid5: Disk failure on sdf1, disabling device.
  575. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801455] raid5: Operation continuing on 1 devices.
  576. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801474] sd 24:0:5:0: [sdg] Unhandled error code
  577. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801475] sd 24:0:5:0: [sdg] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  578. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801477] sd 24:0:5:0: [sdg] CDB: Read(10): 28 00 00 00 0c 3f 00 04 00 00
  579. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801480] end_request: I/O error, dev sdg, sector 3135
  580. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801482] raid5: Disk failure on sdg1, disabling device.
  581. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801483] raid5: Operation continuing on 0 devices.
  582. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801524] sd 24:0:5:0: [sdg] Unhandled error code
  583. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801525] sd 24:0:5:0: [sdg] Result: hostbyte=DID_OK driverbyte=DRIVER_TIMEOUT
  584. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801526] sd 24:0:5:0: [sdg] CDB: Read(10): 28 00 00 00 08 3f 00 04 00 00
  585. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801530] end_request: I/O error, dev sdg, sector 2111
  586. Oct 29 21:05:17 fishserver2 kernel: [ 3409.801563] sas: --- Exit sas_scsi_recover_host
  587. fishserver2 ~ #
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!