API tools faq
paste
Guest User

mdadm error log

a guest
Oct 16th, 2013
48
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 186.01 KB | None | 0 0
raw download clone embed print report
  1. [ 299.903193] ------------[ cut here ]------------
  2. [ 299.908452] kernel BUG at drivers/scsi/scsi_lib.c:1048!
  3. [ 299.914383] invalid opcode: 0000 [#1] SMP
  4. [ 299.919212] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  5. [ 299.954410] CPU: 1 PID: 473 Comm: md7_raid5 Not tainted 3.11.4-201.fc19.x86_64 #1
  6. [ 299.962870] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  7. [ 299.973768] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  8. [ 299.982243] RIP: 0010:[<ffffffff814177a8>] [<ffffffff814177a8>] scsi_init_sgtable+0x68/0x70
  9. [ 299.982246] RSP: 0018:ffff880178f1fb80 EFLAGS: 00010002
  10. [ 299.982248] RAX: 00000000000000a8 RBX: ffff880177fe8558 RCX: 0000000000000001
  11. [ 299.982250] RDX: ffff880177fea3e0 RSI: ffff88017832ce68 RDI: ffff880177fea3c0
  12. [ 299.982252] RBP: ffff880178f1fb98 R08: 0000000000001000 R09: 0000160000000000
  13. [ 299.982254] R10: 0000000177d0a000 R11: 0000000000000000 R12: ffff880178f1b028
  14. [ 299.982256] R13: 0000000000000000 R14: 0000000000000020 R15: ffffea0005e09500
  15. [ 299.982260] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  16. [ 299.982262] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  17. [ 299.982265] CR2: 00000000020f13c8 CR3: 0000000177cf6000 CR4: 00000000001007e0
  18. [ 299.982271] Stack:
  19. [ 299.982277] ffff880177fe8500 ffff880178f1b028 0000000000000002 ffff880178f1fbd0
  20. [ 299.982282] ffffffff814177de ffff880178f1b028 ffff880177fe8500 0000000000000002
  21. [ 299.982287] ffff880177b21000 ffffea0005e09500 ffff880178f1fbf0 ffffffff81417969
  22. [ 299.982288] Call Trace:
  23. [ 299.982296] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  24. [ 299.982302] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  25. [ 299.982308] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  26. [ 299.982314] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  27. [ 299.982320] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  28. [ 299.982325] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  29. [ 299.982331] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  30. [ 299.982335] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  31. [ 299.982341] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  32. [ 299.982346] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  33. [ 299.982357] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  34. [ 299.982364] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  35. [ 299.982370] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  36. [ 299.982377] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  37. [ 299.982382] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  38. [ 299.982387] [<ffffffff81088640>] kthread+0xc0/0xd0
  39. [ 299.982392] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  40. [ 299.982399] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  41. [ 299.982404] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  42. [ 299.982449] Code: e6 48 8b 13 e8 1a 52 ec ff 3b 43 08 77 1d 89 43 08 41 8b 44 24 54 89 43 10 5b 41 5c 44 89 e8 41 5d 5d c3 41 bd 02 00 00 00 eb ee <0f> 0b 66 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 41 57 41 56
  43. [ 299.982454] RIP [<ffffffff814177a8>] scsi_init_sgtable+0x68/0x70
  44. [ 299.982456] RSP <ffff880178f1fb80>
  45. [ 299.982459] ---[ end trace c876bc257d957887 ]---
  46. [ 324.319955] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  47. [ 324.327334] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  48. [ 324.363861] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D 3.11.4-201.fc19.x86_64 #1
  49. [ 324.373950] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  50. [ 324.385402] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  51. [ 324.394419] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  52. [ 324.405568] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  53. [ 324.411870] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000c6
  54. [ 324.420217] RDX: 0000000000007a79 RSI: 0000000000000202 RDI: 0000000000000202
  55. [ 324.428564] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  56. [ 324.436912] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  57. [ 324.445259] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  58. [ 324.453607] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  59. [ 324.463306] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  60. [ 324.470096] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  61. [ 324.478443] Stack:
  62. [ 324.481045] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  63. [ 324.490283] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  64. [ 324.499523] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  65. [ 324.508762] Call Trace:
  66. [ 324.511855] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  67. [ 324.519037] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  68. [ 324.525635] [<ffffffff810697e8>] do_exit+0x658/0xa20
  69. [ 324.531647] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  70. [ 324.537562] [<ffffffff81015c1b>] die+0x4b/0x70
  71. [ 324.542989] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  72. [ 324.548905] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  73. [ 324.555309] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  74. [ 324.562295] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  75. [ 324.569378] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  76. [ 324.576072] [<ffffffff816580de>] invalid_op+0x1e/0x30
  77. [ 324.582182] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  78. [ 324.589168] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  79. [ 324.595570] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  80. [ 324.602850] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  81. [ 324.609154] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  82. [ 324.615459] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  83. [ 324.622348] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  84. [ 324.629042] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  85. [ 324.635638] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  86. [ 324.642234] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  87. [ 324.649416] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  88. [ 324.656016] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  89. [ 324.662898] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  90. [ 324.669789] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  91. [ 324.675997] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  92. [ 324.682885] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  93. [ 324.689580] [<ffffffff81088640>] kthread+0xc0/0xd0
  94. [ 324.695397] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  95. [ 324.702578] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  96. [ 324.708980] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  97. [ 324.716158] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  98. [ 349.069936] ------------[ cut here ]------------
  99. [ 349.075472] WARNING: CPU: 0 PID: 0 at kernel/watchdog.c:272 watchdog_overflow_callback+0x9c/0xd0()
  100. [ 349.086145] Watchdog detected hard LOCKUP on cpu 0
  101. [ 349.091389] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  102. [ 349.128467] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D 3.11.4-201.fc19.x86_64 #1
  103. [ 349.138361] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  104. [ 349.149813] 0000000000000009 ffff88017fc06c28 ffffffff8164783f ffff88017fc06c70
  105. [ 349.159054] ffff88017fc06c60 ffffffff8106715d ffff88017b00e400 0000000000000000
  106. [ 349.168297] ffff88017fc06d90 0000000000000000 ffff88017fc06ef8 ffff88017fc06cc0
  107. [ 349.177538] Call Trace:
  108. [ 349.180627] <NMI> [<ffffffff8164783f>] dump_stack+0x45/0x56
  109. [ 349.187583] [<ffffffff8106715d>] warn_slowpath_common+0x7d/0xa0
  110. [ 349.194665] [<ffffffff810671cc>] warn_slowpath_fmt+0x4c/0x50
  111. [ 349.201458] [<ffffffff81019eb5>] ? native_sched_clock+0x15/0x80
  112. [ 349.208540] [<ffffffff81019f29>] ? sched_clock+0x9/0x10
  113. [ 349.214844] [<ffffffff810f5350>] ? watchdog_enable_all_cpus.part.2+0x40/0x40
  114. [ 349.223192] [<ffffffff810f53ec>] watchdog_overflow_callback+0x9c/0xd0
  115. [ 349.230860] [<ffffffff81132dce>] __perf_event_overflow+0x8e/0x220
  116. [ 349.238138] [<ffffffff81131ba9>] ? perf_event_update_userpage+0x19/0x100
  117. [ 349.246098] [<ffffffff811338f4>] perf_event_overflow+0x14/0x20
  118. [ 349.253085] [<ffffffff8102da1d>] intel_pmu_handle_irq+0x1bd/0x3c0
  119. [ 349.260363] [<ffffffff81174c91>] ? unmap_kernel_range_noflush+0x11/0x20
  120. [ 349.276184] [<ffffffff81392dfe>] ? ghes_copy_tofrom_phys+0x10e/0x210
  121. [ 349.283754] [<ffffffff8164fe9b>] perf_event_nmi_handler+0x2b/0x50
  122. [ 349.291032] [<ffffffff8164f598>] nmi_handle.isra.3+0x88/0x180
  123. [ 349.297921] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  124. [ 349.304809] [<ffffffff8164f7f9>] do_nmi+0x169/0x310
  125. [ 349.310723] [<ffffffff8164ebc1>] end_repeat_nmi+0x1e/0x2e
  126. [ 349.317221] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  127. [ 349.324110] [<ffffffff8164e162>] ? _raw_spin_lock_irqsave+0x32/0x40
  128. [ 349.331582] [<ffffffff8164e162>] ? _raw_spin_lock_irqsave+0x32/0x40
  129. [ 349.339055] [<ffffffff8164e162>] ? _raw_spin_lock_irqsave+0x32/0x40
  130. [ 349.346524] <<EOE>> <IRQ> [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  131. [ 349.355968] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  132. [ 349.362857] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  133. [ 349.369354] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  134. [ 349.376241] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  135. [ 349.383227] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  136. [ 349.389627] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  137. [ 349.395541] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  138. [ 349.403013] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  139. [ 349.410093] <EOI> [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  140. [ 349.418118] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  141. [ 349.425006] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  142. [ 349.431310] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  143. [ 349.438199] [<ffffffff8163daf7>] rest_init+0x77/0x80
  144. [ 349.444211] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  145. [ 349.450709] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  146. [ 349.457693] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  147. [ 349.464970] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  148. [ 349.472541] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  149. [ 349.479718] ---[ end trace c876bc257d957888 ]---
  150. [ 349.485242] perf samples too long (3244624 > 2500), lowering kernel.perf_event_max_sample_rate to 50000
  151. [ 349.496402] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 426.465 msecs
  152. [ 352.343051] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  153. [ 352.350426] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  154. [ 352.386943] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  155. [ 352.397030] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  156. [ 352.408480] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  157. [ 352.417495] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  158. [ 352.428637] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  159. [ 352.434939] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000004
  160. [ 352.443286] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  161. [ 352.451634] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  162. [ 352.459980] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  163. [ 352.468328] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  164. [ 352.476676] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  165. [ 352.486373] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  166. [ 352.493162] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  167. [ 352.501510] Stack:
  168. [ 352.504110] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  169. [ 352.513341] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  170. [ 352.522569] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  171. [ 352.531808] Call Trace:
  172. [ 352.534899] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  173. [ 352.542079] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  174. [ 352.548674] [<ffffffff810697e8>] do_exit+0x658/0xa20
  175. [ 352.554686] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  176. [ 352.560601] [<ffffffff81015c1b>] die+0x4b/0x70
  177. [ 352.566027] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  178. [ 352.571940] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  179. [ 352.578342] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  180. [ 352.585328] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  181. [ 352.592411] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  182. [ 352.599104] [<ffffffff816580de>] invalid_op+0x1e/0x30
  183. [ 352.605213] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  184. [ 352.612197] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  185. [ 352.618598] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  186. [ 352.625876] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  187. [ 352.632179] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  188. [ 352.638483] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  189. [ 352.645371] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  190. [ 352.652065] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  191. [ 352.658660] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  192. [ 352.665255] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  193. [ 352.672434] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  194. [ 352.679033] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  195. [ 352.685922] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  196. [ 352.692812] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  197. [ 352.699019] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  198. [ 352.705906] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  199. [ 352.712599] [<ffffffff81088640>] kthread+0xc0/0xd0
  200. [ 352.718416] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  201. [ 352.725596] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  202. [ 352.731997] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  203. [ 352.739174] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  204. [ 358.722339] perf samples too long (3219283 > 5000), lowering kernel.perf_event_max_sample_rate to 25000
  205. [ 360.314620] INFO: rcu_sched self-detected stall on CPU { 1} (t=60000 jiffies g=3503 c=3502 q=2990)
  206. [ 360.325713] sending NMI to all CPUs:
  207. [ 360.330068] perf samples too long (3194135 > 10000), lowering kernel.perf_event_max_sample_rate to 13000
  208. [ 360.330069] NMI backtrace for cpu 1
  209. [ 360.330073] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  210. [ 360.330074] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  211. [ 360.330075] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  212. [ 360.330079] RIP: 0010:[<ffffffff81309670>] [<ffffffff81309670>] kasprintf+0x40/0x40
  213. [ 360.330080] RSP: 0018:ffff88017fd03df0 EFLAGS: 00000046
  214. [ 360.330081] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000003000000
  215. [ 360.330082] RDX: 0000000000000c00 RSI: 0000000000000080 RDI: ffffffff81ceb900
  216. [ 360.330083] RBP: ffff88017fd03e00 R08: ffffffff81cecbf8 R09: 0000000000000471
  217. [ 360.330084] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff81c50240
  218. [ 360.330085] R13: ffffffff81c50240 R14: ffff88017fd0eb80 R15: 0000000000000bae
  219. [ 360.330087] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  220. [ 360.330088] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  221. [ 360.330089] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  222. [ 360.330089] Stack:
  223. [ 360.330092] ffffffff81042680 ffffffff81cecc10 ffff88017fd03e60 ffffffff810feb7d
  224. [ 360.330094] ffff880177446320 0000000000000000 00000053d290f294 ffff880178f1e000
  225. [ 360.330097] 0000000000000001 ffff880177446320 0000000000000000 0000000000000001
  226. [ 360.330097] Call Trace:
  227. [ 360.330098] <IRQ>
  228. [ 360.330102] [<ffffffff81042680>] ? arch_trigger_all_cpu_backtrace+0x80/0x90
  229. [ 360.330105] [<ffffffff810feb7d>] rcu_check_callbacks+0x30d/0x5f0
  230. [ 360.330108] [<ffffffff810749b7>] update_process_times+0x47/0x80
  231. [ 360.330111] [<ffffffff810c0db5>] tick_sched_handle.isra.15+0x25/0x60
  232. [ 360.330113] [<ffffffff810c0e31>] tick_sched_timer+0x41/0x60
  233. [ 360.330116] [<ffffffff8108bc53>] __run_hrtimer+0x73/0x1d0
  234. [ 360.330118] [<ffffffff810c0df0>] ? tick_sched_handle.isra.15+0x60/0x60
  235. [ 360.330120] [<ffffffff8108c467>] hrtimer_interrupt+0xf7/0x240
  236. [ 360.330123] [<ffffffff81040a97>] local_apic_timer_interrupt+0x37/0x60
  237. [ 360.330126] [<ffffffff81658c7f>] smp_apic_timer_interrupt+0x3f/0x60
  238. [ 360.330129] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  239. [ 360.330130] <EOI>
  240. [ 360.330132] [<ffffffff8164def1>] ? _raw_spin_unlock_irqrestore+0x11/0x20
  241. [ 360.330135] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  242. [ 360.330137] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  243. [ 360.330139] [<ffffffff810697e8>] do_exit+0x658/0xa20
  244. [ 360.330142] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  245. [ 360.330144] [<ffffffff81015c1b>] die+0x4b/0x70
  246. [ 360.330147] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  247. [ 360.330149] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  248. [ 360.330152] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  249. [ 360.330154] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  250. [ 360.330156] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  251. [ 360.330159] [<ffffffff816580de>] invalid_op+0x1e/0x30
  252. [ 360.330161] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  253. [ 360.330164] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  254. [ 360.330166] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  255. [ 360.330168] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  256. [ 360.330170] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  257. [ 360.330173] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  258. [ 360.330175] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  259. [ 360.330178] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  260. [ 360.330180] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  261. [ 360.330182] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  262. [ 360.330185] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  263. [ 360.330189] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  264. [ 360.330192] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  265. [ 360.330195] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  266. [ 360.330197] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  267. [ 360.330200] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  268. [ 360.330202] [<ffffffff81088640>] kthread+0xc0/0xd0
  269. [ 360.330204] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  270. [ 360.330207] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  271. [ 360.330209] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  272. [ 360.330230] Code: 89 4c 24 30 4c 89 44 24 38 48 89 44 24 08 48 8d 44 24 18 4c 89 4c 24 40 c7 04 24 10 00 00 00 48 89 44 24 10 e8 42 ff ff ff c9 c3 <8d> 4e 3f 85 f6 55 0f 49 ce 48 89 e5 c1 f9 06 85 c9 7e 61 48 83
  273. [ 360.818308] INFO: NMI handler (perf_event_nmi_handler) took too long to run: 488.239 msecs
  274. [ 360.828201] NMI backtrace for cpu 0
  275. [ 360.832459] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  276. [ 360.842351] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  277. [ 360.853801] task: ffffffff81c13440 ti: ffffffff81c00000 task.ti: ffffffff81c00000
  278. [ 360.862816] RIP: 0010:[<ffffffff8164e162>] [<ffffffff8164e162>] _raw_spin_lock_irqsave+0x32/0x40
  279. [ 360.873471] RSP: 0018:ffff88017fc03e18 EFLAGS: 00000002
  280. [ 360.879772] RAX: 0000000000000296 RBX: ffff8801779cc100 RCX: 000000000000007a
  281. [ 360.888119] RDX: 0000000000000079 RSI: 0000000000000296 RDI: ffff8801779cc528
  282. [ 360.896466] RBP: ffff88017fc03e18 R08: 0000004cc72b05c0 R09: ffffffff81eb3280
  283. [ 360.904813] R10: 0000000000000000 R11: 0000000000000005 R12: 0000000000000000
  284. [ 360.913159] R13: 0000000000000000 R14: ffffffff812ddae0 R15: ffff8801779cc100
  285. [ 360.921506] FS: 0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
  286. [ 360.931195] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  287. [ 360.937985] CR2: 00007f8fdd332000 CR3: 0000000168ff7000 CR4: 00000000001007f0
  288. [ 360.946332] Stack:
  289. [ 360.948932] ffff88017fc03e68 ffffffff812ddb0f ffff88017fc03e60 ffff8801779cc100
  290. [ 360.958164] ffffffff81c13440 ffffffff81eb3280 ffff8801779cc5e0 0000000000000100
  291. [ 360.967394] ffffffff812ddae0 ffff8801779cc100 ffff88017fc03ea0 ffffffff81072b36
  292. [ 360.976631] Call Trace:
  293. [ 360.979718] <IRQ>
  294. [ 360.981943] [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  295. [ 360.989954] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  296. [ 360.996842] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  297. [ 361.003339] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  298. [ 361.010228] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  299. [ 361.017214] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  300. [ 361.023615] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  301. [ 361.029529] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  302. [ 361.037001] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  303. [ 361.044082] <EOI>
  304. [ 361.046307] [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  305. [ 361.054123] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  306. [ 361.061011] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  307. [ 361.067314] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  308. [ 361.074203] [<ffffffff8163daf7>] rest_init+0x77/0x80
  309. [ 361.080214] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  310. [ 361.086712] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  311. [ 361.093698] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  312. [ 361.100974] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  313. [ 361.108543] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  314. [ 361.115722] Code: 89 e5 9c 58 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00 f0 66 0f c1 17 0f b6 ce 38 d1 74 0e 0f 1f 44 00 00 f3 90 <0f> b6 17 38 d1 75 f7 48 89 f0 5d c3 66 90 0f 1f 44 00 00 55 48
  315. [ 367.959435] perf samples too long (3169189 > 19230), lowering kernel.perf_event_max_sample_rate to 7000
  316. [ 377.196531] perf samples too long (3144437 > 35714), lowering kernel.perf_event_max_sample_rate to 4000
  317. [ 384.369447] BUG: soft lockup - CPU#1 stuck for 21s! [md7_raid5:473]
  318. [ 384.376822] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  319. [ 384.413332] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  320. [ 384.423418] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  321. [ 384.434869] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  322. [ 384.443885] RIP: 0010:[<ffffffff812db8bd>] [<ffffffff812db8bd>] put_io_context_active+0xad/0xc0
  323. [ 384.454444] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  324. [ 384.460746] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 000000000000005b
  325. [ 384.469093] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  326. [ 384.477439] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  327. [ 384.485785] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  328. [ 384.494132] R13: 0000000000000000 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  329. [ 384.502479] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  330. [ 384.512168] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  331. [ 384.518956] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  332. [ 384.527303] Stack:
  333. [ 384.529903] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  334. [ 384.539140] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  335. [ 384.548380] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  336. [ 384.557612] Call Trace:
  337. [ 384.560702] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  338. [ 384.567297] [<ffffffff810697e8>] do_exit+0x658/0xa20
  339. [ 384.573308] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  340. [ 384.579223] [<ffffffff81015c1b>] die+0x4b/0x70
  341. [ 384.584650] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  342. [ 384.590565] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  343. [ 384.596965] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  344. [ 384.603950] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  345. [ 384.611032] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  346. [ 384.617724] [<ffffffff816580de>] invalid_op+0x1e/0x30
  347. [ 384.623833] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  348. [ 384.630817] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  349. [ 384.637218] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  350. [ 384.644494] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  351. [ 384.650797] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  352. [ 384.657101] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  353. [ 384.663990] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  354. [ 384.670684] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  355. [ 384.677279] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  356. [ 384.683874] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  357. [ 384.691054] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  358. [ 384.697651] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  359. [ 384.704539] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  360. [ 384.711427] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  361. [ 384.717633] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  362. [ 384.724522] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  363. [ 384.731215] [<ffffffff81088640>] kthread+0xc0/0xd0
  364. [ 384.737032] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  365. [ 384.744212] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  366. [ 384.750613] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  367. [ 384.757790] Code: 75 c5 4c 89 f6 4c 89 ef e8 41 26 37 00 4c 89 e7 e8 d9 fe ff ff 5b 41 5c 41 5d 41 5e 5d c3 4c 89 f6 4c 89 ef e8 25 26 37 00 f3 90 <e9> 70 ff ff ff 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
  368. [ 386.433627] perf samples too long (3119877 > 62500), lowering kernel.perf_event_max_sample_rate to 2000
  369. [ 395.670723] perf samples too long (3095509 > 125000), lowering kernel.perf_event_max_sample_rate to 1000
  370. [ 412.392544] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  371. [ 412.399917] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  372. [ 412.436435] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  373. [ 412.446522] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  374. [ 412.457972] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  375. [ 412.466987] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  376. [ 412.478130] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  377. [ 412.484432] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000c2
  378. [ 412.492779] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  379. [ 412.501125] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  380. [ 412.509472] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  381. [ 412.517818] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  382. [ 412.526165] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  383. [ 412.535853] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  384. [ 412.542641] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  385. [ 412.550987] Stack:
  386. [ 412.553587] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  387. [ 412.562819] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  388. [ 412.572060] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  389. [ 412.581300] Call Trace:
  390. [ 412.584390] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  391. [ 412.591570] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  392. [ 412.598166] [<ffffffff810697e8>] do_exit+0x658/0xa20
  393. [ 412.604177] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  394. [ 412.610091] [<ffffffff81015c1b>] die+0x4b/0x70
  395. [ 412.615517] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  396. [ 412.621431] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  397. [ 412.627832] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  398. [ 412.634818] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  399. [ 412.641900] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  400. [ 412.648593] [<ffffffff816580de>] invalid_op+0x1e/0x30
  401. [ 412.654702] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  402. [ 412.661687] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  403. [ 412.668088] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  404. [ 412.675366] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  405. [ 412.681669] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  406. [ 412.687973] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  407. [ 412.694860] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  408. [ 412.701553] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  409. [ 412.716108] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  410. [ 412.722703] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  411. [ 412.729882] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  412. [ 412.736479] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  413. [ 412.743366] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  414. [ 412.750255] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  415. [ 412.756462] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  416. [ 412.763350] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  417. [ 412.770043] [<ffffffff81088640>] kthread+0xc0/0xd0
  418. [ 412.775860] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  419. [ 412.783040] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  420. [ 412.789441] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  421. [ 412.796618] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  422. [ 440.415641] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  423. [ 440.423014] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  424. [ 440.459534] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  425. [ 440.469620] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  426. [ 440.481070] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  427. [ 440.490085] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  428. [ 440.501227] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  429. [ 440.507528] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000af
  430. [ 440.515875] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  431. [ 440.524221] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  432. [ 440.532568] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  433. [ 440.540915] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  434. [ 440.549263] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  435. [ 440.558951] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  436. [ 440.565739] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  437. [ 440.574084] Stack:
  438. [ 440.576684] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  439. [ 440.585919] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  440. [ 440.595158] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  441. [ 440.604396] Call Trace:
  442. [ 440.607486] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  443. [ 440.614666] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  444. [ 440.621261] [<ffffffff810697e8>] do_exit+0x658/0xa20
  445. [ 440.627274] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  446. [ 440.633187] [<ffffffff81015c1b>] die+0x4b/0x70
  447. [ 440.638614] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  448. [ 440.644527] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  449. [ 440.650929] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  450. [ 440.657914] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  451. [ 440.664996] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  452. [ 440.671690] [<ffffffff816580de>] invalid_op+0x1e/0x30
  453. [ 440.677798] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  454. [ 440.684783] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  455. [ 440.691185] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  456. [ 440.698461] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  457. [ 440.704764] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  458. [ 440.711068] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  459. [ 440.717955] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  460. [ 440.724647] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  461. [ 440.731242] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  462. [ 440.737838] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  463. [ 440.745018] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  464. [ 440.751616] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  465. [ 440.758504] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  466. [ 440.765392] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  467. [ 440.771597] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  468. [ 440.778485] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  469. [ 440.785177] [<ffffffff81088640>] kthread+0xc0/0xd0
  470. [ 440.790993] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  471. [ 440.798173] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  472. [ 440.804573] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  473. [ 440.811750] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  474. [ 468.438738] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  475. [ 468.446112] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  476. [ 468.482629] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  477. [ 468.492715] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  478. [ 468.504165] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  479. [ 468.513180] RIP: 0010:[<ffffffff812db8bd>] [<ffffffff812db8bd>] put_io_context_active+0xad/0xc0
  480. [ 468.523737] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  481. [ 468.530039] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000075
  482. [ 468.538386] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  483. [ 468.546732] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  484. [ 468.555079] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  485. [ 468.563426] R13: ffff880178f1f8b0 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  486. [ 468.571772] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  487. [ 468.581468] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  488. [ 468.588256] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  489. [ 468.596603] Stack:
  490. [ 468.599203] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  491. [ 468.608441] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  492. [ 468.617678] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  493. [ 468.626918] Call Trace:
  494. [ 468.630008] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  495. [ 468.636604] [<ffffffff810697e8>] do_exit+0x658/0xa20
  496. [ 468.642616] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  497. [ 468.648530] [<ffffffff81015c1b>] die+0x4b/0x70
  498. [ 468.653957] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  499. [ 468.659872] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  500. [ 468.666272] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  501. [ 468.673257] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  502. [ 468.680339] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  503. [ 468.687033] [<ffffffff816580de>] invalid_op+0x1e/0x30
  504. [ 468.693141] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  505. [ 468.700126] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  506. [ 468.706527] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  507. [ 468.713804] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  508. [ 468.720108] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  509. [ 468.726412] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  510. [ 468.733301] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  511. [ 468.739994] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  512. [ 468.746589] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  513. [ 468.753184] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  514. [ 468.760364] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  515. [ 468.766961] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  516. [ 468.773850] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  517. [ 468.780738] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  518. [ 468.786943] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  519. [ 468.793830] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  520. [ 468.800523] [<ffffffff81088640>] kthread+0xc0/0xd0
  521. [ 468.806339] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  522. [ 468.813520] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  523. [ 468.819920] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  524. [ 468.827099] Code: 75 c5 4c 89 f6 4c 89 ef e8 41 26 37 00 4c 89 e7 e8 d9 fe ff ff 5b 41 5c 41 5d 41 5e 5d c3 4c 89 f6 4c 89 ef e8 25 26 37 00 f3 90 <e9> 70 ff ff ff 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
  525. [ 496.461836] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  526. [ 496.469210] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  527. [ 496.505725] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  528. [ 496.515812] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  529. [ 496.527263] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  530. [ 496.536277] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  531. [ 496.547421] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  532. [ 496.553722] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 000000000000008d
  533. [ 496.562069] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  534. [ 496.570416] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  535. [ 496.578762] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  536. [ 496.587109] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  537. [ 496.595456] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  538. [ 496.605145] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  539. [ 496.611933] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  540. [ 496.620279] Stack:
  541. [ 496.622879] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  542. [ 496.632118] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  543. [ 496.641357] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  544. [ 496.650590] Call Trace:
  545. [ 496.653679] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  546. [ 496.660859] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  547. [ 496.675412] [<ffffffff810697e8>] do_exit+0x658/0xa20
  548. [ 496.681423] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  549. [ 496.687337] [<ffffffff81015c1b>] die+0x4b/0x70
  550. [ 496.692764] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  551. [ 496.698679] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  552. [ 496.705079] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  553. [ 496.712064] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  554. [ 496.719145] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  555. [ 496.725839] [<ffffffff816580de>] invalid_op+0x1e/0x30
  556. [ 496.731949] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  557. [ 496.738934] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  558. [ 496.745336] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  559. [ 496.752613] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  560. [ 496.758916] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  561. [ 496.765219] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  562. [ 496.772108] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  563. [ 496.778802] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  564. [ 496.785397] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  565. [ 496.791992] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  566. [ 496.799172] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  567. [ 496.805770] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  568. [ 496.812658] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  569. [ 496.819547] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  570. [ 496.825753] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  571. [ 496.832640] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  572. [ 496.839333] [<ffffffff81088640>] kthread+0xc0/0xd0
  573. [ 496.845150] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  574. [ 496.852330] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  575. [ 496.858730] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  576. [ 496.865908] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  577. [ 524.484933] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  578. [ 524.492307] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  579. [ 524.528827] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  580. [ 524.538912] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  581. [ 524.550362] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  582. [ 524.559378] RIP: 0010:[<ffffffff812db8bd>] [<ffffffff812db8bd>] put_io_context_active+0xad/0xc0
  583. [ 524.569935] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  584. [ 524.576236] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000081
  585. [ 524.584582] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  586. [ 524.592928] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  587. [ 524.601275] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  588. [ 524.609622] R13: ffff880178f1f8b0 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  589. [ 524.617969] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  590. [ 524.627665] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  591. [ 524.634455] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  592. [ 524.642800] Stack:
  593. [ 524.645400] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  594. [ 524.654639] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  595. [ 524.663876] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  596. [ 524.673114] Call Trace:
  597. [ 524.676204] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  598. [ 524.682799] [<ffffffff810697e8>] do_exit+0x658/0xa20
  599. [ 524.688811] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  600. [ 524.694724] [<ffffffff81015c1b>] die+0x4b/0x70
  601. [ 524.700152] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  602. [ 524.706066] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  603. [ 524.712467] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  604. [ 524.719452] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  605. [ 524.726534] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  606. [ 524.733227] [<ffffffff816580de>] invalid_op+0x1e/0x30
  607. [ 524.739336] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  608. [ 524.746321] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  609. [ 524.752722] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  610. [ 524.759998] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  611. [ 524.766301] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  612. [ 524.772604] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  613. [ 524.779491] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  614. [ 524.786185] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  615. [ 524.792781] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  616. [ 524.799378] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  617. [ 524.806558] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  618. [ 524.813155] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  619. [ 524.820044] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  620. [ 524.826932] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  621. [ 524.833139] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  622. [ 524.840025] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  623. [ 524.846719] [<ffffffff81088640>] kthread+0xc0/0xd0
  624. [ 524.852535] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  625. [ 524.859715] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  626. [ 524.866116] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  627. [ 524.873294] Code: 75 c5 4c 89 f6 4c 89 ef e8 41 26 37 00 4c 89 e7 e8 d9 fe ff ff 5b 41 5c 41 5d 41 5e 5d c3 4c 89 f6 4c 89 ef e8 25 26 37 00 f3 90 <e9> 70 ff ff ff 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
  628. [ 540.466104] INFO: rcu_sched self-detected stall on CPU { 1} (t=240003 jiffies g=3503 c=3502 q=2990)
  629. [ 540.477293] sending NMI to all CPUs:
  630. [ 540.481649] NMI backtrace for cpu 0
  631. [ 540.485899] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  632. [ 540.495792] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  633. [ 540.507243] task: ffffffff81c13440 ti: ffffffff81c00000 task.ti: ffffffff81c00000
  634. [ 540.516258] RIP: 0010:[<ffffffff8164e162>] [<ffffffff8164e162>] _raw_spin_lock_irqsave+0x32/0x40
  635. [ 540.526913] RSP: 0018:ffff88017fc03e18 EFLAGS: 00000002
  636. [ 540.533213] RAX: 0000000000000296 RBX: ffff8801779cc100 RCX: 000000000000007a
  637. [ 540.541561] RDX: 0000000000000079 RSI: 0000000000000296 RDI: ffff8801779cc528
  638. [ 540.549908] RBP: ffff88017fc03e18 R08: 0000004cc72b05c0 R09: ffffffff81eb3280
  639. [ 540.558255] R10: 0000000000000000 R11: 0000000000000005 R12: 0000000000000000
  640. [ 540.566602] R13: 0000000000000000 R14: ffffffff812ddae0 R15: ffff8801779cc100
  641. [ 540.574949] FS: 0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
  642. [ 540.584646] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  643. [ 540.591433] CR2: 00007f8fdd332000 CR3: 0000000168ff7000 CR4: 00000000001007f0
  644. [ 540.599779] Stack:
  645. [ 540.602379] ffff88017fc03e68 ffffffff812ddb0f ffff88017fc03e60 ffff8801779cc100
  646. [ 540.611620] ffffffff81c13440 ffffffff81eb3280 ffff8801779cc5e0 0000000000000100
  647. [ 540.620861] ffffffff812ddae0 ffff8801779cc100 ffff88017fc03ea0 ffffffff81072b36
  648. [ 540.630099] Call Trace:
  649. [ 540.633187] <IRQ>
  650. [ 540.635411] [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  651. [ 540.643424] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  652. [ 540.650312] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  653. [ 540.656810] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  654. [ 540.663698] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  655. [ 540.670685] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  656. [ 540.677084] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  657. [ 540.682998] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  658. [ 540.690471] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  659. [ 540.697552] <EOI>
  660. [ 540.699776] [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  661. [ 540.707594] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  662. [ 540.714481] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  663. [ 540.720785] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  664. [ 540.727674] [<ffffffff8163daf7>] rest_init+0x77/0x80
  665. [ 540.733685] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  666. [ 540.740183] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  667. [ 540.747169] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  668. [ 540.754446] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  669. [ 540.762014] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  670. [ 540.769192] Code: 89 e5 9c 58 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00 f0 66 0f c1 17 0f b6 ce 38 d1 74 0e 0f 1f 44 00 00 f3 90 <0f> b6 17 38 d1 75 f7 48 89 f0 5d c3 66 90 0f 1f 44 00 00 55 48
  671. [ 540.796452] NMI backtrace for cpu 1
  672. [ 540.800711] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  673. [ 540.810797] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  674. [ 540.822247] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  675. [ 540.831262] RIP: 0010:[<ffffffff813096e3>] [<ffffffff813096e3>] __bitmap_empty+0x73/0x80
  676. [ 540.841130] RSP: 0018:ffff88017fd03df0 EFLAGS: 00000046
  677. [ 540.847431] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000000000002
  678. [ 540.855777] RDX: 0000000000000c00 RSI: 0000000000000080 RDI: ffffffff81ceb900
  679. [ 540.864124] RBP: ffff88017fd03e00 R08: ffffffff81cecbf8 R09: 000000000000061a
  680. [ 540.872470] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff81c50240
  681. [ 540.880818] R13: ffffffff81c50240 R14: ffff88017fd0eb80 R15: 0000000000000bae
  682. [ 540.889165] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  683. [ 540.898854] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  684. [ 540.905642] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  685. [ 540.913989] Stack:
  686. [ 540.916588] ffffffff81042680 ffffffff81cecc10 ffff88017fd03e60 ffffffff810feb7d
  687. [ 540.925821] ffff880177446320 0000000000000000 0000007dbb94c152 ffff880178f1e000
  688. [ 540.935057] 0000000000000001 ffff880177446320 0000000000000000 0000000000000001
  689. [ 540.944298] Call Trace:
  690. [ 540.947385] <IRQ>
  691. [ 540.949610] [<ffffffff81042680>] ? arch_trigger_all_cpu_backtrace+0x80/0x90
  692. [ 540.966455] [<ffffffff810feb7d>] rcu_check_callbacks+0x30d/0x5f0
  693. [ 540.973636] [<ffffffff810749b7>] update_process_times+0x47/0x80
  694. [ 540.980719] [<ffffffff810c0db5>] tick_sched_handle.isra.15+0x25/0x60
  695. [ 540.988289] [<ffffffff810c0e31>] tick_sched_timer+0x41/0x60
  696. [ 540.994982] [<ffffffff8108bc53>] __run_hrtimer+0x73/0x1d0
  697. [ 541.001480] [<ffffffff810c0df0>] ? tick_sched_handle.isra.15+0x60/0x60
  698. [ 541.009244] [<ffffffff8108c467>] hrtimer_interrupt+0xf7/0x240
  699. [ 541.016131] [<ffffffff81040a97>] local_apic_timer_interrupt+0x37/0x60
  700. [ 541.023799] [<ffffffff81658c7f>] smp_apic_timer_interrupt+0x3f/0x60
  701. [ 541.031270] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  702. [ 541.038352] <EOI>
  703. [ 541.040577] [<ffffffff8164e13a>] ? _raw_spin_lock_irqsave+0xa/0x40
  704. [ 541.048587] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  705. [ 541.055767] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  706. [ 541.062362] [<ffffffff810697e8>] do_exit+0x658/0xa20
  707. [ 541.068374] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  708. [ 541.074287] [<ffffffff81015c1b>] die+0x4b/0x70
  709. [ 541.079715] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  710. [ 541.085629] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  711. [ 541.092029] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  712. [ 541.099015] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  713. [ 541.106097] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  714. [ 541.112790] [<ffffffff816580de>] invalid_op+0x1e/0x30
  715. [ 541.118899] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  716. [ 541.125884] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  717. [ 541.132284] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  718. [ 541.139562] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  719. [ 541.145865] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  720. [ 541.152170] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  721. [ 541.159058] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  722. [ 541.165752] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  723. [ 541.172347] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  724. [ 541.178943] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  725. [ 541.186123] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  726. [ 541.192720] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  727. [ 541.199608] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  728. [ 541.206495] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  729. [ 541.212700] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  730. [ 541.219587] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  731. [ 541.226280] [<ffffffff81088640>] kthread+0xc0/0xd0
  732. [ 541.232097] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  733. [ 541.239276] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  734. [ 541.245678] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  735. [ 541.252855] Code: ea 1a 8d 0c 16 83 e1 3f 29 d1 ba 01 00 00 00 48 d3 e2 48 83 ea 01 48 85 14 c7 75 0c b8 01 00 00 00 5d c3 0f 1f 44 00 00 31 c0 5d <c3> 31 c0 eb c2 0f 1f 84 00 00 00 00 00 8d 4e 3f 85 f6 55 0f 49
  736. [ 541.280118] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 798.466 msecs
  737. [ 564.517929] BUG: soft lockup - CPU#1 stuck for 21s! [md7_raid5:473]
  738. [ 564.525302] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  739. [ 564.561819] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  740. [ 564.571907] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  741. [ 564.583358] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  742. [ 564.592373] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  743. [ 564.603516] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  744. [ 564.609817] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000aa
  745. [ 564.618163] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  746. [ 564.626510] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  747. [ 564.634857] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  748. [ 564.643204] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  749. [ 564.651552] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  750. [ 564.661249] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  751. [ 564.668037] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  752. [ 564.676384] Stack:
  753. [ 564.678984] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  754. [ 564.688212] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  755. [ 564.697440] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  756. [ 564.706678] Call Trace:
  757. [ 564.709768] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  758. [ 564.716948] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  759. [ 564.723544] [<ffffffff810697e8>] do_exit+0x658/0xa20
  760. [ 564.729556] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  761. [ 564.735469] [<ffffffff81015c1b>] die+0x4b/0x70
  762. [ 564.740895] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  763. [ 564.746808] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  764. [ 564.753209] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  765. [ 564.760194] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  766. [ 564.767276] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  767. [ 564.773968] [<ffffffff816580de>] invalid_op+0x1e/0x30
  768. [ 564.780077] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  769. [ 564.787062] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  770. [ 564.793463] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  771. [ 564.800739] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  772. [ 564.807042] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  773. [ 564.813345] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  774. [ 564.820234] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  775. [ 564.826927] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  776. [ 564.833522] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  777. [ 564.840117] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  778. [ 564.847297] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  779. [ 564.853894] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  780. [ 564.860782] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  781. [ 564.867669] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  782. [ 564.873875] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  783. [ 564.880763] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  784. [ 564.887456] [<ffffffff81088640>] kthread+0xc0/0xd0
  785. [ 564.893273] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  786. [ 564.900453] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  787. [ 564.906855] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  788. [ 564.914031] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  789. [ 592.541026] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  790. [ 592.548399] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  791. [ 592.584915] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  792. [ 592.595003] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  793. [ 592.606453] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  794. [ 592.615469] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  795. [ 592.626611] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  796. [ 592.632913] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 000000000000006d
  797. [ 592.641260] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  798. [ 592.649607] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  799. [ 592.657954] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  800. [ 592.666301] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  801. [ 592.674648] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  802. [ 592.684346] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  803. [ 592.691134] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  804. [ 592.699481] Stack:
  805. [ 592.702080] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  806. [ 592.711311] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  807. [ 592.720551] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  808. [ 592.729788] Call Trace:
  809. [ 592.732877] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  810. [ 592.740056] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  811. [ 592.746651] [<ffffffff810697e8>] do_exit+0x658/0xa20
  812. [ 592.752664] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  813. [ 592.758578] [<ffffffff81015c1b>] die+0x4b/0x70
  814. [ 592.764004] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  815. [ 592.769917] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  816. [ 592.776319] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  817. [ 592.783304] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  818. [ 592.790387] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  819. [ 592.797080] [<ffffffff816580de>] invalid_op+0x1e/0x30
  820. [ 592.803188] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  821. [ 592.810173] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  822. [ 592.816574] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  823. [ 592.823851] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  824. [ 592.830153] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  825. [ 592.836456] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  826. [ 592.843343] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  827. [ 592.850036] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  828. [ 592.856632] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  829. [ 592.863227] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  830. [ 592.870406] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  831. [ 592.877004] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  832. [ 592.883892] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  833. [ 592.890779] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  834. [ 592.896986] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  835. [ 592.903873] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  836. [ 592.910566] [<ffffffff81088640>] kthread+0xc0/0xd0
  837. [ 592.916382] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  838. [ 592.923563] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  839. [ 592.929964] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  840. [ 592.937141] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  841. [ 620.564124] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  842. [ 620.571498] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  843. [ 620.608017] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  844. [ 620.618104] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  845. [ 620.629555] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  846. [ 620.638570] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  847. [ 620.649712] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  848. [ 620.656014] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 000000000000006e
  849. [ 620.664360] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  850. [ 620.672707] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  851. [ 620.681054] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  852. [ 620.689400] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  853. [ 620.697748] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  854. [ 620.707436] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  855. [ 620.714225] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  856. [ 620.722571] Stack:
  857. [ 620.725172] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  858. [ 620.734403] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  859. [ 620.743639] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  860. [ 620.752871] Call Trace:
  861. [ 620.755960] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  862. [ 620.763141] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  863. [ 620.769736] [<ffffffff810697e8>] do_exit+0x658/0xa20
  864. [ 620.775748] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  865. [ 620.781661] [<ffffffff81015c1b>] die+0x4b/0x70
  866. [ 620.787087] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  867. [ 620.793003] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  868. [ 620.799405] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  869. [ 620.806391] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  870. [ 620.813474] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  871. [ 620.820167] [<ffffffff816580de>] invalid_op+0x1e/0x30
  872. [ 620.826275] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  873. [ 620.833259] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  874. [ 620.839660] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  875. [ 620.846937] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  876. [ 620.853240] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  877. [ 620.859543] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  878. [ 620.866432] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  879. [ 620.873124] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  880. [ 620.879720] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  881. [ 620.886315] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  882. [ 620.893495] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  883. [ 620.900092] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  884. [ 620.906981] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  885. [ 620.913868] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  886. [ 620.920075] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  887. [ 620.926963] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  888. [ 620.933656] [<ffffffff81088640>] kthread+0xc0/0xd0
  889. [ 620.939472] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  890. [ 620.946653] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  891. [ 620.953053] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  892. [ 620.960231] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  893. [ 648.587221] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  894. [ 648.594594] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  895. [ 648.631115] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  896. [ 648.641202] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  897. [ 648.652653] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  898. [ 648.661668] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  899. [ 648.672811] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  900. [ 648.679112] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000040
  901. [ 648.687460] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  902. [ 648.695806] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  903. [ 648.704152] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  904. [ 648.712499] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  905. [ 648.720846] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  906. [ 648.730542] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  907. [ 648.737331] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  908. [ 648.745676] Stack:
  909. [ 648.748276] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  910. [ 648.757503] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  911. [ 648.766732] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  912. [ 648.775975] Call Trace:
  913. [ 648.779065] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  914. [ 648.786244] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  915. [ 648.792839] [<ffffffff810697e8>] do_exit+0x658/0xa20
  916. [ 648.798852] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  917. [ 648.804765] [<ffffffff81015c1b>] die+0x4b/0x70
  918. [ 648.810192] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  919. [ 648.816107] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  920. [ 648.822507] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  921. [ 648.829493] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  922. [ 648.836574] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  923. [ 648.843268] [<ffffffff816580de>] invalid_op+0x1e/0x30
  924. [ 648.849377] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  925. [ 648.856362] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  926. [ 648.862762] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  927. [ 648.870040] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  928. [ 648.876343] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  929. [ 648.882646] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  930. [ 648.889533] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  931. [ 648.896225] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  932. [ 648.902820] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  933. [ 648.909416] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  934. [ 648.916597] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  935. [ 648.923195] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  936. [ 648.930083] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  937. [ 648.936971] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  938. [ 648.943177] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  939. [ 648.950065] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  940. [ 648.956758] [<ffffffff81088640>] kthread+0xc0/0xd0
  941. [ 648.962574] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  942. [ 648.969754] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  943. [ 648.976154] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  944. [ 648.983330] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  945. [ 676.610318] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  946. [ 676.617692] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  947. [ 676.654208] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  948. [ 676.664295] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  949. [ 676.675745] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  950. [ 676.684760] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  951. [ 676.695319] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  952. [ 676.701621] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 00000000000000ed
  953. [ 676.709967] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  954. [ 676.718312] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  955. [ 676.726659] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  956. [ 676.735006] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  957. [ 676.743353] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  958. [ 676.753050] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  959. [ 676.759838] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  960. [ 676.768184] Stack:
  961. [ 676.770784] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  962. [ 676.780016] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  963. [ 676.789247] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  964. [ 676.798476] Call Trace:
  965. [ 676.801566] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  966. [ 676.808746] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  967. [ 676.815341] [<ffffffff810697e8>] do_exit+0x658/0xa20
  968. [ 676.821353] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  969. [ 676.827267] [<ffffffff81015c1b>] die+0x4b/0x70
  970. [ 676.832693] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  971. [ 676.838607] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  972. [ 676.845008] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  973. [ 676.851993] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  974. [ 676.859076] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  975. [ 676.865769] [<ffffffff816580de>] invalid_op+0x1e/0x30
  976. [ 676.871878] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  977. [ 676.878862] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  978. [ 676.885264] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  979. [ 676.892540] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  980. [ 676.898843] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  981. [ 676.913105] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  982. [ 676.919993] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  983. [ 676.926687] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  984. [ 676.933282] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  985. [ 676.939876] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  986. [ 676.947056] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  987. [ 676.953655] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  988. [ 676.960544] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  989. [ 676.967431] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  990. [ 676.973638] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  991. [ 676.980525] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  992. [ 676.987219] [<ffffffff81088640>] kthread+0xc0/0xd0
  993. [ 676.993035] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  994. [ 677.000215] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  995. [ 677.006616] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  996. [ 677.013795] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  997. [ 704.633415] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  998. [ 704.640789] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  999. [ 704.677307] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1000. [ 704.687394] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1001. [ 704.698844] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1002. [ 704.707858] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  1003. [ 704.718417] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  1004. [ 704.724718] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 00000000000000c9
  1005. [ 704.733063] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  1006. [ 704.741410] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1007. [ 704.749756] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  1008. [ 704.758102] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  1009. [ 704.766448] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1010. [ 704.776145] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1011. [ 704.782933] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1012. [ 704.791278] Stack:
  1013. [ 704.793878] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  1014. [ 704.803110] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  1015. [ 704.812351] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  1016. [ 704.821588] Call Trace:
  1017. [ 704.824678] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  1018. [ 704.831858] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1019. [ 704.838454] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1020. [ 704.844465] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1021. [ 704.850379] [<ffffffff81015c1b>] die+0x4b/0x70
  1022. [ 704.855807] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1023. [ 704.861722] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1024. [ 704.868124] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1025. [ 704.875109] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1026. [ 704.882191] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1027. [ 704.888884] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1028. [ 704.894994] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1029. [ 704.901979] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1030. [ 704.908379] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1031. [ 704.915657] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1032. [ 704.921960] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1033. [ 704.928263] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1034. [ 704.935152] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1035. [ 704.941845] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1036. [ 704.948441] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1037. [ 704.955037] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1038. [ 704.962217] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1039. [ 704.968815] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1040. [ 704.975703] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1041. [ 704.982592] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1042. [ 704.988799] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1043. [ 704.995686] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1044. [ 705.002379] [<ffffffff81088640>] kthread+0xc0/0xd0
  1045. [ 705.008196] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1046. [ 705.015376] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1047. [ 705.021776] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1048. [ 705.028954] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  1049. [ 720.617589] INFO: rcu_sched self-detected stall on CPU { 1} (t=420006 jiffies g=3503 c=3502 q=2990)
  1050. [ 720.628770] sending NMI to all CPUs:
  1051. [ 720.633125] NMI backtrace for cpu 1
  1052. [ 720.637384] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1053. [ 720.647469] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1054. [ 720.658919] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1055. [ 720.667934] RIP: 0010:[<ffffffff81309683>] [<ffffffff81309683>] __bitmap_empty+0x13/0x80
  1056. [ 720.677812] RSP: 0018:ffff88017fd03de8 EFLAGS: 00000002
  1057. [ 720.684112] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000000000002
  1058. [ 720.692459] RDX: 0000000000000c00 RSI: 0000000000000080 RDI: ffffffff81ceb900
  1059. [ 720.700806] RBP: ffff88017fd03de8 R08: ffffffff81cecbf8 R09: 00000000000007c3
  1060. [ 720.709151] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff81c50240
  1061. [ 720.717497] R13: ffffffff81c50240 R14: ffff88017fd0eb80 R15: 0000000000000bae
  1062. [ 720.725844] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1063. [ 720.735541] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1064. [ 720.742329] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1065. [ 720.750675] Stack:
  1066. [ 720.753274] ffff88017fd03e00 ffffffff81042680 ffffffff81cecc10 ffff88017fd03e60
  1067. [ 720.762513] ffffffff810feb7d ffff880177446320 0000000000000000 000000a7a498901b
  1068. [ 720.771743] ffff880178f1e000 0000000000000001 ffff880177446320 0000000000000000
  1069. [ 720.780983] Call Trace:
  1070. [ 720.784070] <IRQ>
  1071. [ 720.786294] [<ffffffff81042680>] arch_trigger_all_cpu_backtrace+0x80/0x90
  1072. [ 720.794988] [<ffffffff810feb7d>] rcu_check_callbacks+0x30d/0x5f0
  1073. [ 720.802169] [<ffffffff810749b7>] update_process_times+0x47/0x80
  1074. [ 720.809253] [<ffffffff810c0db5>] tick_sched_handle.isra.15+0x25/0x60
  1075. [ 720.816821] [<ffffffff810c0e31>] tick_sched_timer+0x41/0x60
  1076. [ 720.823515] [<ffffffff8108bc53>] __run_hrtimer+0x73/0x1d0
  1077. [ 720.830013] [<ffffffff810c0df0>] ? tick_sched_handle.isra.15+0x60/0x60
  1078. [ 720.837777] [<ffffffff8108c467>] hrtimer_interrupt+0xf7/0x240
  1079. [ 720.844665] [<ffffffff81040a97>] local_apic_timer_interrupt+0x37/0x60
  1080. [ 720.852332] [<ffffffff81658c7f>] smp_apic_timer_interrupt+0x3f/0x60
  1081. [ 720.859804] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  1082. [ 720.866885] <EOI>
  1083. [ 720.869108] [<ffffffff8164def1>] ? _raw_spin_unlock_irqrestore+0x11/0x20
  1084. [ 720.877704] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  1085. [ 720.884884] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1086. [ 720.891479] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1087. [ 720.897491] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1088. [ 720.903404] [<ffffffff81015c1b>] die+0x4b/0x70
  1089. [ 720.908830] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1090. [ 720.914743] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1091. [ 720.921144] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1092. [ 720.928130] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1093. [ 720.935211] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1094. [ 720.941905] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1095. [ 720.948013] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1096. [ 720.954998] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1097. [ 720.961399] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1098. [ 720.968676] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1099. [ 720.974979] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1100. [ 720.981284] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1101. [ 720.988171] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1102. [ 720.994865] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1103. [ 721.001461] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1104. [ 721.008056] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1105. [ 721.015237] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1106. [ 721.021834] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1107. [ 721.028721] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1108. [ 721.035609] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1109. [ 721.041815] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1110. [ 721.048703] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1111. [ 721.055396] [<ffffffff81088640>] kthread+0xc0/0xd0
  1112. [ 721.061212] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1113. [ 721.068392] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1114. [ 721.074793] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1115. [ 721.081970] Code: 4c 89 4c 24 40 c7 04 24 10 00 00 00 48 89 44 24 10 e8 42 ff ff ff c9 c3 8d 4e 3f 85 f6 55 0f 49 ce 48 89 e5 c1 f9 06 85 c9 7e 61 <48> 83 3f 00 75 57 48 8d 57 08 31 c0 eb 12 0f 1f 80 00 00 00 00
  1116. [ 721.109229] NMI backtrace for cpu 0
  1117. [ 721.113487] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1118. [ 721.123380] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1119. [ 721.134830] task: ffffffff81c13440 ti: ffffffff81c00000 task.ti: ffffffff81c00000
  1120. [ 721.143845] RIP: 0010:[<ffffffff8164e165>] [<ffffffff8164e165>] _raw_spin_lock_irqsave+0x35/0x40
  1121. [ 721.154501] RSP: 0018:ffff88017fc03e18 EFLAGS: 00000002
  1122. [ 721.160802] RAX: 0000000000000296 RBX: ffff8801779cc100 RCX: 000000000000007a
  1123. [ 721.169149] RDX: 0000000000000079 RSI: 0000000000000296 RDI: ffff8801779cc528
  1124. [ 721.177496] RBP: ffff88017fc03e18 R08: 0000004cc72b05c0 R09: ffffffff81eb3280
  1125. [ 721.185843] R10: 0000000000000000 R11: 0000000000000005 R12: 0000000000000000
  1126. [ 721.194191] R13: 0000000000000000 R14: ffffffff812ddae0 R15: ffff8801779cc100
  1127. [ 721.202539] FS: 0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
  1128. [ 721.212236] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1129. [ 721.226982] CR2: 00007f8fdd332000 CR3: 0000000168ff7000 CR4: 00000000001007f0
  1130. [ 721.235329] Stack:
  1131. [ 721.237929] ffff88017fc03e68 ffffffff812ddb0f ffff88017fc03e60 ffff8801779cc100
  1132. [ 721.247166] ffffffff81c13440 ffffffff81eb3280 ffff8801779cc5e0 0000000000000100
  1133. [ 721.256397] ffffffff812ddae0 ffff8801779cc100 ffff88017fc03ea0 ffffffff81072b36
  1134. [ 721.265638] Call Trace:
  1135. [ 721.268725] <IRQ>
  1136. [ 721.270939] [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  1137. [ 721.278950] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  1138. [ 721.285839] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  1139. [ 721.292337] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  1140. [ 721.299224] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  1141. [ 721.306210] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  1142. [ 721.312610] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  1143. [ 721.318523] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  1144. [ 721.325995] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  1145. [ 721.333074] <EOI>
  1146. [ 721.335289] [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  1147. [ 721.343105] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  1148. [ 721.349995] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  1149. [ 721.356297] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  1150. [ 721.363186] [<ffffffff8163daf7>] rest_init+0x77/0x80
  1151. [ 721.369197] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  1152. [ 721.375696] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  1153. [ 721.382681] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  1154. [ 721.389957] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  1155. [ 721.397526] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  1156. [ 721.404704] Code: 58 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00 f0 66 0f c1 17 0f b6 ce 38 d1 74 0e 0f 1f 44 00 00 f3 90 0f b6 17 <38> d1 75 f7 48 89 f0 5d c3 66 90 0f 1f 44 00 00 55 48 89 e5 fa
  1157. [ 721.431968] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 798.840 msecs
  1158. [ 744.666412] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1159. [ 744.673787] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1160. [ 744.710301] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1161. [ 744.720388] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1162. [ 744.731838] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1163. [ 744.740853] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  1164. [ 744.751995] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  1165. [ 744.758296] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000a2
  1166. [ 744.766643] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1167. [ 744.774990] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1168. [ 744.783337] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  1169. [ 744.791684] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  1170. [ 744.800031] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1171. [ 744.809720] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1172. [ 744.816508] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1173. [ 744.824853] Stack:
  1174. [ 744.827453] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  1175. [ 744.836693] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  1176. [ 744.845923] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  1177. [ 744.855161] Call Trace:
  1178. [ 744.858250] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  1179. [ 744.865429] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1180. [ 744.872024] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1181. [ 744.878035] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1182. [ 744.883949] [<ffffffff81015c1b>] die+0x4b/0x70
  1183. [ 744.889377] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1184. [ 744.895291] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1185. [ 744.901693] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1186. [ 744.908678] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1187. [ 744.915761] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1188. [ 744.922454] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1189. [ 744.928563] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1190. [ 744.935547] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1191. [ 744.941947] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1192. [ 744.949224] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1193. [ 744.955527] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1194. [ 744.961831] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1195. [ 744.968718] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1196. [ 744.975411] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1197. [ 744.982006] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1198. [ 744.988603] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1199. [ 744.995783] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1200. [ 745.002381] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1201. [ 745.009268] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1202. [ 745.016156] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1203. [ 745.022363] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1204. [ 745.029251] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1205. [ 745.035944] [<ffffffff81088640>] kthread+0xc0/0xd0
  1206. [ 745.041760] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1207. [ 745.048941] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1208. [ 745.055342] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1209. [ 745.062520] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  1210. [ 772.689509] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1211. [ 772.696882] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1212. [ 772.733400] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1213. [ 772.743485] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1214. [ 772.754935] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1215. [ 772.763950] RIP: 0010:[<ffffffff812db832>] [<ffffffff812db832>] put_io_context_active+0x22/0xc0
  1216. [ 772.774509] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  1217. [ 772.780809] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00000000000000d8
  1218. [ 772.789155] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1219. [ 772.797502] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  1220. [ 772.805849] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  1221. [ 772.814196] R13: 0000000000000000 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  1222. [ 772.822543] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1223. [ 772.832231] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1224. [ 772.839019] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1225. [ 772.847366] Stack:
  1226. [ 772.849966] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  1227. [ 772.859195] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  1228. [ 772.868424] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  1229. [ 772.877659] Call Trace:
  1230. [ 772.880749] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1231. [ 772.887344] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1232. [ 772.893357] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1233. [ 772.899271] [<ffffffff81015c1b>] die+0x4b/0x70
  1234. [ 772.904698] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1235. [ 772.910613] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1236. [ 772.917013] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1237. [ 772.923998] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1238. [ 772.931080] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1239. [ 772.937774] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1240. [ 772.943882] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1241. [ 772.950867] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1242. [ 772.957269] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1243. [ 772.964546] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1244. [ 772.970849] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1245. [ 772.977153] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1246. [ 772.984040] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1247. [ 772.990734] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1248. [ 772.997329] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1249. [ 773.003924] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1250. [ 773.011105] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1251. [ 773.017704] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1252. [ 773.024591] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1253. [ 773.031479] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1254. [ 773.037685] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1255. [ 773.044574] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1256. [ 773.051267] [<ffffffff81088640>] kthread+0xc0/0xd0
  1257. [ 773.057083] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1258. [ 773.064262] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1259. [ 773.070664] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1260. [ 773.077842] Code: 1e eb ff eb 9d 0f 0b 66 90 0f 1f 44 00 00 55 48 89 e5 41 56 41 55 41 54 49 89 fc 53 f0 ff 4f 08 0f 94 c0 84 c0 4c 8d 6f 10 74 6d <4c> 89 ef e8 f6 28 37 00 49 8b 5c 24 38 49 89 c6 48 85 db 75 12
  1261. [ 800.712606] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1262. [ 800.719979] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1263. [ 800.756495] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1264. [ 800.766581] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1265. [ 800.778031] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1266. [ 800.787047] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  1267. [ 800.805568] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  1268. [ 800.811869] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 0000000000000038
  1269. [ 800.820215] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  1270. [ 800.828561] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1271. [ 800.836908] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  1272. [ 800.845255] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  1273. [ 800.853602] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1274. [ 800.863298] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1275. [ 800.870087] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1276. [ 800.878433] Stack:
  1277. [ 800.881033] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  1278. [ 800.890273] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  1279. [ 800.899502] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  1280. [ 800.908740] Call Trace:
  1281. [ 800.911830] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  1282. [ 800.919009] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1283. [ 800.925605] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1284. [ 800.931616] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1285. [ 800.937529] [<ffffffff81015c1b>] die+0x4b/0x70
  1286. [ 800.942947] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1287. [ 800.948860] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1288. [ 800.955261] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1289. [ 800.962247] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1290. [ 800.969329] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1291. [ 800.976021] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1292. [ 800.982130] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1293. [ 800.989115] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1294. [ 800.995516] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1295. [ 801.002793] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1296. [ 801.009096] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1297. [ 801.015399] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1298. [ 801.022288] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1299. [ 801.028982] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1300. [ 801.035577] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1301. [ 801.042172] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1302. [ 801.049353] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1303. [ 801.055949] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1304. [ 801.062838] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1305. [ 801.069726] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1306. [ 801.075932] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1307. [ 801.082819] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1308. [ 801.089512] [<ffffffff81088640>] kthread+0xc0/0xd0
  1309. [ 801.095329] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1310. [ 801.102508] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1311. [ 801.108910] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1312. [ 801.116088] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  1313. [ 828.735703] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1314. [ 828.743067] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1315. [ 828.779587] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1316. [ 828.789674] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1317. [ 828.801124] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1318. [ 828.810139] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  1319. [ 828.821281] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  1320. [ 828.827583] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000060
  1321. [ 828.835930] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1322. [ 828.844276] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1323. [ 828.852622] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  1324. [ 828.860968] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  1325. [ 828.869316] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1326. [ 828.879013] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1327. [ 828.885801] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1328. [ 828.894147] Stack:
  1329. [ 828.896747] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  1330. [ 828.905987] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  1331. [ 828.915227] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  1332. [ 828.924467] Call Trace:
  1333. [ 828.927556] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  1334. [ 828.934737] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1335. [ 828.941332] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1336. [ 828.947343] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1337. [ 828.953258] [<ffffffff81015c1b>] die+0x4b/0x70
  1338. [ 828.958685] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1339. [ 828.964600] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1340. [ 828.971000] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1341. [ 828.977986] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1342. [ 828.985067] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1343. [ 828.991761] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1344. [ 828.997868] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1345. [ 829.004853] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1346. [ 829.011255] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1347. [ 829.018532] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1348. [ 829.024836] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1349. [ 829.031140] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1350. [ 829.038027] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1351. [ 829.044721] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1352. [ 829.051317] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1353. [ 829.057912] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1354. [ 829.065092] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1355. [ 829.071691] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1356. [ 829.078580] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1357. [ 829.085468] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1358. [ 829.091675] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1359. [ 829.098564] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1360. [ 829.105257] [<ffffffff81088640>] kthread+0xc0/0xd0
  1361. [ 829.111074] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1362. [ 829.118255] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1363. [ 829.124655] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1364. [ 829.131832] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  1365. [ 856.758801] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1366. [ 856.766165] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1367. [ 856.802685] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1368. [ 856.812771] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1369. [ 856.824222] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1370. [ 856.833236] RIP: 0010:[<ffffffff812db835>] [<ffffffff812db835>] put_io_context_active+0x25/0xc0
  1371. [ 856.843794] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  1372. [ 856.850094] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000068
  1373. [ 856.858441] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  1374. [ 856.866788] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  1375. [ 856.875135] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  1376. [ 856.883482] R13: ffff880178f1f8b0 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  1377. [ 856.891830] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1378. [ 856.901527] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1379. [ 856.908315] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1380. [ 856.916660] Stack:
  1381. [ 856.919260] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  1382. [ 856.928499] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  1383. [ 856.937735] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  1384. [ 856.946976] Call Trace:
  1385. [ 856.950066] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1386. [ 856.956662] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1387. [ 856.962673] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1388. [ 856.968587] [<ffffffff81015c1b>] die+0x4b/0x70
  1389. [ 856.974014] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1390. [ 856.979929] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1391. [ 856.986329] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1392. [ 856.993315] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1393. [ 857.000398] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1394. [ 857.007092] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1395. [ 857.013201] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1396. [ 857.020187] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1397. [ 857.026589] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1398. [ 857.033866] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1399. [ 857.040168] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1400. [ 857.046471] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1401. [ 857.053359] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1402. [ 857.060052] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1403. [ 857.066647] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1404. [ 857.073242] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1405. [ 857.080422] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1406. [ 857.087019] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1407. [ 857.093908] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1408. [ 857.100797] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1409. [ 857.107004] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1410. [ 857.113891] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1411. [ 857.120584] [<ffffffff81088640>] kthread+0xc0/0xd0
  1412. [ 857.126400] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1413. [ 857.133580] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1414. [ 857.139981] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1415. [ 857.155124] Code: eb 9d 0f 0b 66 90 0f 1f 44 00 00 55 48 89 e5 41 56 41 55 41 54 49 89 fc 53 f0 ff 4f 08 0f 94 c0 84 c0 4c 8d 6f 10 74 6d 4c 89 ef <e8> f6 28 37 00 49 8b 5c 24 38 49 89 c6 48 85 db 75 12 eb 4b 0f
  1416. [ 884.781898] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  1417. [ 884.789272] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1418. [ 884.825789] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1419. [ 884.835875] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1420. [ 884.847326] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1421. [ 884.856341] RIP: 0010:[<ffffffff8164def7>] [<ffffffff8164def7>] _raw_spin_unlock_irqrestore+0x17/0x20
  1422. [ 884.867483] RSP: 0018:ffff880178f1f8b8 EFLAGS: 00000202
  1423. [ 884.873776] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000d0
  1424. [ 884.882123] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1425. [ 884.890469] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  1426. [ 884.898815] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  1427. [ 884.907161] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  1428. [ 884.915507] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1429. [ 884.925204] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1430. [ 884.931992] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1431. [ 884.940339] Stack:
  1432. [ 884.942939] ffffffff812db8bb ffff880177446320 ffff880178f1f720 ffff880178f1f720
  1433. [ 884.952178] ffff880177446310 ffff880178f1f8f8 ffffffff812db90b ffff880177446848
  1434. [ 884.961417] ffff880178f1f980 ffffffff810697e8 00000001819ea99c ffff880177446538
  1435. [ 884.970653] Call Trace:
  1436. [ 884.973742] [<ffffffff812db8bb>] ? put_io_context_active+0xab/0xc0
  1437. [ 884.981118] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1438. [ 884.987713] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1439. [ 884.993725] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1440. [ 884.999639] [<ffffffff81015c1b>] die+0x4b/0x70
  1441. [ 885.005066] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1442. [ 885.010981] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1443. [ 885.017383] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1444. [ 885.024368] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1445. [ 885.031450] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1446. [ 885.038144] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1447. [ 885.044252] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1448. [ 885.051237] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1449. [ 885.057638] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1450. [ 885.064915] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1451. [ 885.071218] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1452. [ 885.077522] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1453. [ 885.084411] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1454. [ 885.091103] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1455. [ 885.097698] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1456. [ 885.104293] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1457. [ 885.111474] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1458. [ 885.118073] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1459. [ 885.124961] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1460. [ 885.131849] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1461. [ 885.138056] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1462. [ 885.144945] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1463. [ 885.151638] [<ffffffff81088640>] kthread+0xc0/0xd0
  1464. [ 885.157455] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1465. [ 885.164636] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1466. [ 885.171036] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1467. [ 885.178214] Code: a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d 0f 1f 44 00 00 5d <c3> 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 ba ff ff
  1468. [ 900.769074] INFO: rcu_sched self-detected stall on CPU { 1} (t=600009 jiffies g=3503 c=3502 q=2990)
  1469. [ 900.780262] sending NMI to all CPUs:
  1470. [ 900.784617] NMI backtrace for cpu 0
  1471. [ 900.788876] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1472. [ 900.798768] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1473. [ 900.810219] task: ffffffff81c13440 ti: ffffffff81c00000 task.ti: ffffffff81c00000
  1474. [ 900.819235] RIP: 0010:[<ffffffff8164e162>] [<ffffffff8164e162>] _raw_spin_lock_irqsave+0x32/0x40
  1475. [ 900.829890] RSP: 0018:ffff88017fc03e18 EFLAGS: 00000002
  1476. [ 900.836191] RAX: 0000000000000296 RBX: ffff8801779cc100 RCX: 000000000000007a
  1477. [ 900.844539] RDX: 0000000000000079 RSI: 0000000000000296 RDI: ffff8801779cc528
  1478. [ 900.852886] RBP: ffff88017fc03e18 R08: 0000004cc72b05c0 R09: ffffffff81eb3280
  1479. [ 900.861233] R10: 0000000000000000 R11: 0000000000000005 R12: 0000000000000000
  1480. [ 900.869579] R13: 0000000000000000 R14: ffffffff812ddae0 R15: ffff8801779cc100
  1481. [ 900.877927] FS: 0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
  1482. [ 900.887624] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1483. [ 900.894412] CR2: 00007f8fdd332000 CR3: 0000000168ff7000 CR4: 00000000001007f0
  1484. [ 900.902758] Stack:
  1485. [ 900.905358] ffff88017fc03e68 ffffffff812ddb0f ffff88017fc03e60 ffff8801779cc100
  1486. [ 900.914596] ffffffff81c13440 ffffffff81eb3280 ffff8801779cc5e0 0000000000000100
  1487. [ 900.923837] ffffffff812ddae0 ffff8801779cc100 ffff88017fc03ea0 ffffffff81072b36
  1488. [ 900.933065] Call Trace:
  1489. [ 900.936153] <IRQ>
  1490. [ 900.938376] [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  1491. [ 900.946387] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  1492. [ 900.953276] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  1493. [ 900.959774] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  1494. [ 900.966660] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  1495. [ 900.973646] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  1496. [ 900.980046] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  1497. [ 900.985960] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  1498. [ 900.993431] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  1499. [ 901.000511] <EOI>
  1500. [ 901.002726] [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  1501. [ 901.010542] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  1502. [ 901.017431] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  1503. [ 901.023734] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  1504. [ 901.030622] [<ffffffff8163daf7>] rest_init+0x77/0x80
  1505. [ 901.036634] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  1506. [ 901.043132] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  1507. [ 901.050117] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  1508. [ 901.057394] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  1509. [ 901.064963] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  1510. [ 901.072141] Code: 89 e5 9c 58 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00 f0 66 0f c1 17 0f b6 ce 38 d1 74 0e 0f 1f 44 00 00 f3 90 <0f> b6 17 38 d1 75 f7 48 89 f0 5d c3 66 90 0f 1f 44 00 00 55 48
  1511. [ 901.099393] NMI backtrace for cpu 1
  1512. [ 901.103652] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1513. [ 901.113739] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1514. [ 901.125189] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1515. [ 901.134204] RIP: 0010:[<ffffffff8130967f>] [<ffffffff8130967f>] __bitmap_empty+0xf/0x80
  1516. [ 901.143975] RSP: 0018:ffff88017fd03de8 EFLAGS: 00000002
  1517. [ 901.150276] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000000000002
  1518. [ 901.158622] RDX: 0000000000000c00 RSI: 0000000000000080 RDI: ffffffff81ceb900
  1519. [ 901.166968] RBP: ffff88017fd03de8 R08: ffffffff81cecbf8 R09: 000000000000096a
  1520. [ 901.175315] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff81c50240
  1521. [ 901.183662] R13: ffffffff81c50240 R14: ffff88017fd0eb80 R15: 0000000000000bae
  1522. [ 901.192010] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1523. [ 901.201706] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1524. [ 901.208494] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1525. [ 901.216840] Stack:
  1526. [ 901.219440] ffff88017fd03e00 ffffffff81042680 ffffffff81cecc10 ffff88017fd03e60
  1527. [ 901.228681] ffffffff810feb7d ffff880177446320 0000000000000000 000000d18d9c5eed
  1528. [ 901.237921] ffff880178f1e000 0000000000000001 ffff880177446320 0000000000000000
  1529. [ 901.247158] Call Trace:
  1530. [ 901.250246] <IRQ>
  1531. [ 901.252470] [<ffffffff81042680>] arch_trigger_all_cpu_backtrace+0x80/0x90
  1532. [ 901.261166] [<ffffffff810feb7d>] rcu_check_callbacks+0x30d/0x5f0
  1533. [ 901.268347] [<ffffffff810749b7>] update_process_times+0x47/0x80
  1534. [ 901.275428] [<ffffffff810c0db5>] tick_sched_handle.isra.15+0x25/0x60
  1535. [ 901.282998] [<ffffffff810c0e31>] tick_sched_timer+0x41/0x60
  1536. [ 901.289692] [<ffffffff8108bc53>] __run_hrtimer+0x73/0x1d0
  1537. [ 901.296189] [<ffffffff810c0df0>] ? tick_sched_handle.isra.15+0x60/0x60
  1538. [ 901.303953] [<ffffffff8108c467>] hrtimer_interrupt+0xf7/0x240
  1539. [ 901.310841] [<ffffffff81040a97>] local_apic_timer_interrupt+0x37/0x60
  1540. [ 901.318509] [<ffffffff81658c7f>] smp_apic_timer_interrupt+0x3f/0x60
  1541. [ 901.325981] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  1542. [ 901.333061] <EOI>
  1543. [ 901.335277] [<ffffffff8164def1>] ? _raw_spin_unlock_irqrestore+0x11/0x20
  1544. [ 901.343872] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  1545. [ 901.351052] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1546. [ 901.357648] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1547. [ 901.363660] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1548. [ 901.369574] [<ffffffff81015c1b>] die+0x4b/0x70
  1549. [ 901.375002] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1550. [ 901.380915] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1551. [ 901.387316] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1552. [ 901.394301] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1553. [ 901.401383] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1554. [ 901.408077] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1555. [ 901.414185] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1556. [ 901.421170] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1557. [ 901.427570] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1558. [ 901.434847] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1559. [ 901.441149] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1560. [ 901.455417] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1561. [ 901.462306] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1562. [ 901.468998] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1563. [ 901.475592] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1564. [ 901.482187] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1565. [ 901.489368] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1566. [ 901.495967] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1567. [ 901.502854] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1568. [ 901.509743] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1569. [ 901.515948] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1570. [ 901.522836] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1571. [ 901.529529] [<ffffffff81088640>] kthread+0xc0/0xd0
  1572. [ 901.535345] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1573. [ 901.542525] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1574. [ 901.548925] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1575. [ 901.556102] Code: 8d 44 24 18 4c 89 4c 24 40 c7 04 24 10 00 00 00 48 89 44 24 10 e8 42 ff ff ff c9 c3 8d 4e 3f 85 f6 55 0f 49 ce 48 89 e5 c1 f9 06 <85> c9 7e 61 48 83 3f 00 75 57 48 8d 57 08 31 c0 eb 12 0f 1f 80
  1576. [ 924.814894] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1577. [ 924.822266] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1578. [ 924.858784] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1579. [ 924.868871] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1580. [ 924.880321] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1581. [ 924.889336] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  1582. [ 924.900478] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  1583. [ 924.906779] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000059
  1584. [ 924.915126] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1585. [ 924.923472] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1586. [ 924.931819] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  1587. [ 924.940166] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  1588. [ 924.948515] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1589. [ 924.958212] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1590. [ 924.964999] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1591. [ 924.973345] Stack:
  1592. [ 924.975945] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  1593. [ 924.985175] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  1594. [ 924.994416] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  1595. [ 925.003655] Call Trace:
  1596. [ 925.006746] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  1597. [ 925.013926] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1598. [ 925.020522] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1599. [ 925.026533] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1600. [ 925.032447] [<ffffffff81015c1b>] die+0x4b/0x70
  1601. [ 925.037874] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1602. [ 925.043788] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1603. [ 925.050189] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1604. [ 925.057175] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1605. [ 925.064258] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1606. [ 925.070950] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1607. [ 925.077059] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1608. [ 925.084044] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1609. [ 925.090445] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1610. [ 925.097722] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1611. [ 925.104024] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1612. [ 925.110328] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1613. [ 925.117217] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1614. [ 925.123910] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1615. [ 925.130504] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1616. [ 925.137100] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1617. [ 925.144280] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1618. [ 925.150877] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1619. [ 925.157764] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1620. [ 925.164653] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1621. [ 925.170859] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1622. [ 925.177746] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1623. [ 925.184439] [<ffffffff81088640>] kthread+0xc0/0xd0
  1624. [ 925.190256] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1625. [ 925.197436] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1626. [ 925.203837] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1627. [ 925.211014] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  1628. [ 952.837991] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1629. [ 952.845364] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1630. [ 952.881882] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1631. [ 952.891968] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1632. [ 952.903419] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1633. [ 952.912434] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  1634. [ 952.922993] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  1635. [ 952.929294] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 000000000000007d
  1636. [ 952.937641] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  1637. [ 952.945989] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1638. [ 952.954335] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  1639. [ 952.962682] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  1640. [ 952.971030] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1641. [ 952.980727] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1642. [ 952.987515] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1643. [ 952.995862] Stack:
  1644. [ 952.998461] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  1645. [ 953.007698] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  1646. [ 953.016937] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  1647. [ 953.026167] Call Trace:
  1648. [ 953.029257] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  1649. [ 953.036437] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1650. [ 953.043034] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1651. [ 953.049046] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1652. [ 953.054961] [<ffffffff81015c1b>] die+0x4b/0x70
  1653. [ 953.060387] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1654. [ 953.066300] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1655. [ 953.072700] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1656. [ 953.079685] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1657. [ 953.086767] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1658. [ 953.093461] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1659. [ 953.099569] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1660. [ 953.106554] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1661. [ 953.112955] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1662. [ 953.120233] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1663. [ 953.126535] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1664. [ 953.132839] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1665. [ 953.139727] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1666. [ 953.146420] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1667. [ 953.153016] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1668. [ 953.159612] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1669. [ 953.166793] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1670. [ 953.173390] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1671. [ 953.180278] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1672. [ 953.187165] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1673. [ 953.193372] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1674. [ 953.200261] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1675. [ 953.206955] [<ffffffff81088640>] kthread+0xc0/0xd0
  1676. [ 953.212771] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1677. [ 953.219952] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1678. [ 953.226353] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1679. [ 953.233531] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  1680. [ 980.861088] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1681. [ 980.868462] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1682. [ 980.904980] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1683. [ 980.915066] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1684. [ 980.926516] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1685. [ 980.935530] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  1686. [ 980.946673] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  1687. [ 980.952975] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000090
  1688. [ 980.961321] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1689. [ 980.969668] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1690. [ 980.978015] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  1691. [ 980.986362] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  1692. [ 980.994710] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1693. [ 981.004407] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1694. [ 981.011195] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1695. [ 981.019541] Stack:
  1696. [ 981.022140] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  1697. [ 981.031371] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  1698. [ 981.040611] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  1699. [ 981.057813] Call Trace:
  1700. [ 981.060903] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  1701. [ 981.068081] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1702. [ 981.074677] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1703. [ 981.080688] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1704. [ 981.086602] [<ffffffff81015c1b>] die+0x4b/0x70
  1705. [ 981.092030] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1706. [ 981.097943] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1707. [ 981.104344] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1708. [ 981.111330] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1709. [ 981.118412] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1710. [ 981.125106] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1711. [ 981.131215] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1712. [ 981.138200] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1713. [ 981.144600] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1714. [ 981.151877] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1715. [ 981.158180] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1716. [ 981.164482] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1717. [ 981.171369] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1718. [ 981.178062] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1719. [ 981.184657] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1720. [ 981.191252] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1721. [ 981.198432] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1722. [ 981.205029] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1723. [ 981.211918] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1724. [ 981.218805] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1725. [ 981.225012] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1726. [ 981.231900] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1727. [ 981.238594] [<ffffffff81088640>] kthread+0xc0/0xd0
  1728. [ 981.244410] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1729. [ 981.251591] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1730. [ 981.257991] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1731. [ 981.265169] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  1732. [ 1008.884185] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1733. [ 1008.891558] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1734. [ 1008.928077] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1735. [ 1008.938164] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1736. [ 1008.949615] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1737. [ 1008.958629] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  1738. [ 1008.969188] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  1739. [ 1008.975490] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 0000000000000026
  1740. [ 1008.983836] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  1741. [ 1008.992183] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  1742. [ 1009.000530] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  1743. [ 1009.008877] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  1744. [ 1009.017225] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1745. [ 1009.026921] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1746. [ 1009.033710] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1747. [ 1009.042057] Stack:
  1748. [ 1009.044657] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  1749. [ 1009.053887] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  1750. [ 1009.063125] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  1751. [ 1009.072367] Call Trace:
  1752. [ 1009.075456] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  1753. [ 1009.082636] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1754. [ 1009.089231] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1755. [ 1009.095243] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1756. [ 1009.101157] [<ffffffff81015c1b>] die+0x4b/0x70
  1757. [ 1009.106584] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1758. [ 1009.112498] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1759. [ 1009.118899] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1760. [ 1009.125884] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1761. [ 1009.132966] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1762. [ 1009.139660] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1763. [ 1009.145768] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1764. [ 1009.152753] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1765. [ 1009.159153] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1766. [ 1009.166430] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1767. [ 1009.172733] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1768. [ 1009.179037] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1769. [ 1009.185924] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1770. [ 1009.192618] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1771. [ 1009.199213] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1772. [ 1009.205808] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1773. [ 1009.212989] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1774. [ 1009.219586] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1775. [ 1009.226474] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1776. [ 1009.233362] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1777. [ 1009.239567] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1778. [ 1009.246455] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1779. [ 1009.253148] [<ffffffff81088640>] kthread+0xc0/0xd0
  1780. [ 1009.258966] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1781. [ 1009.266145] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1782. [ 1009.272545] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1783. [ 1009.279723] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  1784. [ 1036.907283] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1785. [ 1036.914656] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1786. [ 1036.951181] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1787. [ 1036.961267] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1788. [ 1036.972718] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1789. [ 1036.981732] RIP: 0010:[<ffffffff8164def7>] [<ffffffff8164def7>] _raw_spin_unlock_irqrestore+0x17/0x20
  1790. [ 1036.992875] RSP: 0018:ffff880178f1f8b8 EFLAGS: 00000202
  1791. [ 1036.999176] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 0000000000000074
  1792. [ 1037.007523] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1793. [ 1037.015869] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  1794. [ 1037.024216] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  1795. [ 1037.032563] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  1796. [ 1037.040910] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1797. [ 1037.050607] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1798. [ 1037.057395] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1799. [ 1037.065742] Stack:
  1800. [ 1037.068342] ffffffff812db8bb ffff880177446320 ffff880178f1f720 ffff880178f1f720
  1801. [ 1037.077572] ffff880177446310 ffff880178f1f8f8 ffffffff812db90b ffff880177446848
  1802. [ 1037.086810] ffff880178f1f980 ffffffff810697e8 00000001819ea99c ffff880177446538
  1803. [ 1037.096049] Call Trace:
  1804. [ 1037.099140] [<ffffffff812db8bb>] ? put_io_context_active+0xab/0xc0
  1805. [ 1037.106514] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1806. [ 1037.113109] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1807. [ 1037.119121] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1808. [ 1037.125034] [<ffffffff81015c1b>] die+0x4b/0x70
  1809. [ 1037.130462] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1810. [ 1037.136376] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1811. [ 1037.142776] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1812. [ 1037.149761] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1813. [ 1037.156843] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1814. [ 1037.163536] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1815. [ 1037.169646] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1816. [ 1037.176631] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1817. [ 1037.183031] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1818. [ 1037.190308] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1819. [ 1037.196610] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1820. [ 1037.202913] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1821. [ 1037.209800] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1822. [ 1037.216493] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1823. [ 1037.223089] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1824. [ 1037.229684] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1825. [ 1037.236864] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1826. [ 1037.243462] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1827. [ 1037.250351] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1828. [ 1037.257238] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1829. [ 1037.263444] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1830. [ 1037.270332] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1831. [ 1037.277024] [<ffffffff81088640>] kthread+0xc0/0xd0
  1832. [ 1037.282840] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1833. [ 1037.290021] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1834. [ 1037.296421] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1835. [ 1037.303599] Code: a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d 0f 1f 44 00 00 5d <c3> 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 ba ff ff
  1836. [ 1064.930380] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1837. [ 1064.937754] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1838. [ 1064.974267] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1839. [ 1064.984353] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1840. [ 1064.995803] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1841. [ 1065.012785] RIP: 0010:[<ffffffff812db8bd>] [<ffffffff812db8bd>] put_io_context_active+0xad/0xc0
  1842. [ 1065.023343] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  1843. [ 1065.029644] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00000000000000d3
  1844. [ 1065.037990] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  1845. [ 1065.046336] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  1846. [ 1065.054682] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  1847. [ 1065.063029] R13: 0000000000000000 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  1848. [ 1065.071376] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1849. [ 1065.081073] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1850. [ 1065.087860] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1851. [ 1065.096207] Stack:
  1852. [ 1065.098807] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  1853. [ 1065.108043] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  1854. [ 1065.117274] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  1855. [ 1065.126514] Call Trace:
  1856. [ 1065.129604] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1857. [ 1065.136199] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1858. [ 1065.142211] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1859. [ 1065.148124] [<ffffffff81015c1b>] die+0x4b/0x70
  1860. [ 1065.153551] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1861. [ 1065.159464] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1862. [ 1065.165865] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1863. [ 1065.172851] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1864. [ 1065.179933] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1865. [ 1065.186627] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1866. [ 1065.192735] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1867. [ 1065.199720] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1868. [ 1065.206121] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1869. [ 1065.213398] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1870. [ 1065.219700] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1871. [ 1065.226003] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1872. [ 1065.232892] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1873. [ 1065.239585] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1874. [ 1065.246181] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1875. [ 1065.252777] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1876. [ 1065.259957] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1877. [ 1065.266554] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1878. [ 1065.273443] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1879. [ 1065.280331] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1880. [ 1065.286538] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1881. [ 1065.293426] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1882. [ 1065.300120] [<ffffffff81088640>] kthread+0xc0/0xd0
  1883. [ 1065.305936] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1884. [ 1065.313115] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1885. [ 1065.319516] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1886. [ 1065.326693] Code: 75 c5 4c 89 f6 4c 89 ef e8 41 26 37 00 4c 89 e7 e8 d9 fe ff ff 5b 41 5c 41 5d 41 5e 5d c3 4c 89 f6 4c 89 ef e8 25 26 37 00 f3 90 <e9> 70 ff ff ff 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
  1887. [ 1080.920559] INFO: rcu_sched self-detected stall on CPU { 1} (t=780012 jiffies g=3503 c=3502 q=2990)
  1888. [ 1080.931738] sending NMI to all CPUs:
  1889. [ 1080.936093] NMI backtrace for cpu 1
  1890. [ 1080.940350] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1891. [ 1080.950437] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1892. [ 1080.961888] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  1893. [ 1080.970903] RIP: 0010:[<ffffffff81306c91>] [<ffffffff81306c91>] __const_udelay+0x1/0x30
  1894. [ 1080.980674] RSP: 0018:ffff88017fd03de8 EFLAGS: 00000046
  1895. [ 1080.986975] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000000000002
  1896. [ 1080.995323] RDX: 0000000000000c00 RSI: 0000000000000080 RDI: 0000000000418958
  1897. [ 1081.003670] RBP: ffff88017fd03e00 R08: ffffffff81cecbf8 R09: 0000000000000b11
  1898. [ 1081.012016] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff81c50240
  1899. [ 1081.020363] R13: ffffffff81c50240 R14: ffff88017fd0eb80 R15: 0000000000000bae
  1900. [ 1081.028710] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  1901. [ 1081.038406] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1902. [ 1081.045194] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  1903. [ 1081.053539] Stack:
  1904. [ 1081.056139] ffff88017fd03e00 ffffffff8104266a ffffffff81cecc10 ffff88017fd03e60
  1905. [ 1081.065369] ffffffff810feb7d ffff880177446320 0000000000000000 000000fb76a02dac
  1906. [ 1081.074596] ffff880178f1e000 0000000000000001 ffff880177446320 0000000000000000
  1907. [ 1081.083825] Call Trace:
  1908. [ 1081.086913] <IRQ>
  1909. [ 1081.089136] [<ffffffff8104266a>] ? arch_trigger_all_cpu_backtrace+0x6a/0x90
  1910. [ 1081.098024] [<ffffffff810feb7d>] rcu_check_callbacks+0x30d/0x5f0
  1911. [ 1081.105205] [<ffffffff810749b7>] update_process_times+0x47/0x80
  1912. [ 1081.112287] [<ffffffff810c0db5>] tick_sched_handle.isra.15+0x25/0x60
  1913. [ 1081.119856] [<ffffffff810c0e31>] tick_sched_timer+0x41/0x60
  1914. [ 1081.126549] [<ffffffff8108bc53>] __run_hrtimer+0x73/0x1d0
  1915. [ 1081.133047] [<ffffffff810c0df0>] ? tick_sched_handle.isra.15+0x60/0x60
  1916. [ 1081.140812] [<ffffffff8108c467>] hrtimer_interrupt+0xf7/0x240
  1917. [ 1081.147701] [<ffffffff81040a97>] local_apic_timer_interrupt+0x37/0x60
  1918. [ 1081.155368] [<ffffffff81658c7f>] smp_apic_timer_interrupt+0x3f/0x60
  1919. [ 1081.162840] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  1920. [ 1081.169921] <EOI>
  1921. [ 1081.172146] [<ffffffff8164def7>] ? _raw_spin_unlock_irqrestore+0x17/0x20
  1922. [ 1081.180742] [<ffffffff812db8bb>] ? put_io_context_active+0xab/0xc0
  1923. [ 1081.188117] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  1924. [ 1081.194713] [<ffffffff810697e8>] do_exit+0x658/0xa20
  1925. [ 1081.200725] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  1926. [ 1081.206639] [<ffffffff81015c1b>] die+0x4b/0x70
  1927. [ 1081.212067] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  1928. [ 1081.217981] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  1929. [ 1081.224382] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1930. [ 1081.231367] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  1931. [ 1081.238448] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  1932. [ 1081.245142] [<ffffffff816580de>] invalid_op+0x1e/0x30
  1933. [ 1081.251251] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  1934. [ 1081.258236] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  1935. [ 1081.264637] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  1936. [ 1081.271914] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  1937. [ 1081.278216] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  1938. [ 1081.284519] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  1939. [ 1081.291406] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  1940. [ 1081.298099] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  1941. [ 1081.304694] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  1942. [ 1081.311289] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  1943. [ 1081.318470] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  1944. [ 1081.325067] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  1945. [ 1081.331954] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  1946. [ 1081.338842] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  1947. [ 1081.345048] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  1948. [ 1081.351936] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  1949. [ 1081.358630] [<ffffffff81088640>] kthread+0xc0/0xd0
  1950. [ 1081.364446] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1951. [ 1081.371626] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  1952. [ 1081.378028] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  1953. [ 1081.385206] Code: ff c8 5d c3 66 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 ff 15 b9 ad 98 00 5d c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 <48> 8d 04 bd 00 00 00 00 65 48 8b 14 25 a0 39 01 00 48 89 e5 48
  1954. [ 1081.412469] NMI backtrace for cpu 0
  1955. [ 1081.416729] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1956. [ 1081.426620] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  1957. [ 1081.438071] task: ffffffff81c13440 ti: ffffffff81c00000 task.ti: ffffffff81c00000
  1958. [ 1081.447085] RIP: 0010:[<ffffffff8164e162>] [<ffffffff8164e162>] _raw_spin_lock_irqsave+0x32/0x40
  1959. [ 1081.457741] RSP: 0018:ffff88017fc03e18 EFLAGS: 00000002
  1960. [ 1081.464042] RAX: 0000000000000296 RBX: ffff8801779cc100 RCX: 000000000000007a
  1961. [ 1081.472389] RDX: 0000000000000079 RSI: 0000000000000296 RDI: ffff8801779cc528
  1962. [ 1081.480735] RBP: ffff88017fc03e18 R08: 0000004cc72b05c0 R09: ffffffff81eb3280
  1963. [ 1081.489081] R10: 0000000000000000 R11: 0000000000000005 R12: 0000000000000000
  1964. [ 1081.497427] R13: 0000000000000000 R14: ffffffff812ddae0 R15: ffff8801779cc100
  1965. [ 1081.505773] FS: 0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
  1966. [ 1081.515469] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  1967. [ 1081.522258] CR2: 00007f8fdd332000 CR3: 0000000168ff7000 CR4: 00000000001007f0
  1968. [ 1081.530604] Stack:
  1969. [ 1081.533204] ffff88017fc03e68 ffffffff812ddb0f ffff88017fc03e60 ffff8801779cc100
  1970. [ 1081.542436] ffffffff81c13440 ffffffff81eb3280 ffff8801779cc5e0 0000000000000100
  1971. [ 1081.551675] ffffffff812ddae0 ffff8801779cc100 ffff88017fc03ea0 ffffffff81072b36
  1972. [ 1081.560912] Call Trace:
  1973. [ 1081.563999] <IRQ>
  1974. [ 1081.566214] [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  1975. [ 1081.574225] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  1976. [ 1081.581114] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  1977. [ 1081.587612] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  1978. [ 1081.594499] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  1979. [ 1081.601485] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  1980. [ 1081.607886] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  1981. [ 1081.613800] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  1982. [ 1081.621272] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  1983. [ 1081.628352] <EOI>
  1984. [ 1081.630567] [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  1985. [ 1081.638386] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  1986. [ 1081.645275] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  1987. [ 1081.651577] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  1988. [ 1081.658464] [<ffffffff8163daf7>] rest_init+0x77/0x80
  1989. [ 1081.664476] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  1990. [ 1081.670974] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  1991. [ 1081.677958] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  1992. [ 1081.685236] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  1993. [ 1081.692804] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  1994. [ 1081.699982] Code: 89 e5 9c 58 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00 f0 66 0f c1 17 0f b6 ce 38 d1 74 0e 0f 1f 44 00 00 f3 90 <0f> b6 17 38 d1 75 f7 48 89 f0 5d c3 66 90 0f 1f 44 00 00 55 48
  1995. [ 1081.735207] INFO: NMI handler (arch_trigger_all_cpu_backtrace_handler) took too long to run: 799.112 msecs
  1996. [ 1104.963376] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  1997. [ 1104.970749] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  1998. [ 1105.007265] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  1999. [ 1105.017351] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2000. [ 1105.028802] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2001. [ 1105.037816] RIP: 0010:[<ffffffff812db8bd>] [<ffffffff812db8bd>] put_io_context_active+0xad/0xc0
  2002. [ 1105.048374] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  2003. [ 1105.054675] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000ca
  2004. [ 1105.063022] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  2005. [ 1105.071369] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  2006. [ 1105.079715] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  2007. [ 1105.088062] R13: ffff880178f1f8b0 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  2008. [ 1105.096409] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2009. [ 1105.106105] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2010. [ 1105.112893] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2011. [ 1105.121240] Stack:
  2012. [ 1105.123840] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  2013. [ 1105.133077] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  2014. [ 1105.142306] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  2015. [ 1105.151544] Call Trace:
  2016. [ 1105.154633] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2017. [ 1105.161230] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2018. [ 1105.167242] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2019. [ 1105.173157] [<ffffffff81015c1b>] die+0x4b/0x70
  2020. [ 1105.178583] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2021. [ 1105.184497] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2022. [ 1105.190897] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2023. [ 1105.197881] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2024. [ 1105.204963] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2025. [ 1105.211655] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2026. [ 1105.217764] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2027. [ 1105.224749] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2028. [ 1105.231150] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2029. [ 1105.238427] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2030. [ 1105.244730] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2031. [ 1105.251034] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2032. [ 1105.257922] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2033. [ 1105.264615] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2034. [ 1105.271210] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2035. [ 1105.277806] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2036. [ 1105.284986] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2037. [ 1105.291584] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2038. [ 1105.298473] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2039. [ 1105.305361] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2040. [ 1105.311568] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2041. [ 1105.318456] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2042. [ 1105.325149] [<ffffffff81088640>] kthread+0xc0/0xd0
  2043. [ 1105.330965] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2044. [ 1105.338145] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2045. [ 1105.344546] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2046. [ 1105.351724] Code: 75 c5 4c 89 f6 4c 89 ef e8 41 26 37 00 4c 89 e7 e8 d9 fe ff ff 5b 41 5c 41 5d 41 5e 5d c3 4c 89 f6 4c 89 ef e8 25 26 37 00 f3 90 <e9> 70 ff ff ff 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
  2047. [ 1132.986473] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  2048. [ 1132.993846] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2049. [ 1133.030361] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2050. [ 1133.040447] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2051. [ 1133.051897] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2052. [ 1133.060912] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  2053. [ 1133.071471] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  2054. [ 1133.077773] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 0000000000000037
  2055. [ 1133.086120] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  2056. [ 1133.094466] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  2057. [ 1133.102813] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  2058. [ 1133.111159] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  2059. [ 1133.119507] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2060. [ 1133.129204] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2061. [ 1133.135992] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2062. [ 1133.144339] Stack:
  2063. [ 1133.146937] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  2064. [ 1133.156176] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  2065. [ 1133.165407] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  2066. [ 1133.174643] Call Trace:
  2067. [ 1133.177733] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  2068. [ 1133.184914] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2069. [ 1133.191510] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2070. [ 1133.197521] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2071. [ 1133.203435] [<ffffffff81015c1b>] die+0x4b/0x70
  2072. [ 1133.208863] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2073. [ 1133.214777] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2074. [ 1133.221178] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2075. [ 1133.228163] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2076. [ 1133.235244] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2077. [ 1133.241936] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2078. [ 1133.248045] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2079. [ 1133.255030] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2080. [ 1133.261431] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2081. [ 1133.268709] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2082. [ 1133.275012] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2083. [ 1133.281315] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2084. [ 1133.288204] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2085. [ 1133.294897] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2086. [ 1133.301492] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2087. [ 1133.308087] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2088. [ 1133.315267] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2089. [ 1133.321864] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2090. [ 1133.328752] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2091. [ 1133.335639] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2092. [ 1133.341845] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2093. [ 1133.348733] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2094. [ 1133.355426] [<ffffffff81088640>] kthread+0xc0/0xd0
  2095. [ 1133.361243] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2096. [ 1133.368423] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2097. [ 1133.374824] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2098. [ 1133.382002] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  2099. [ 1161.009571] BUG: soft lockup - CPU#1 stuck for 23s! [md7_raid5:473]
  2100. [ 1161.016944] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2101. [ 1161.053462] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2102. [ 1161.063548] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2103. [ 1161.074998] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2104. [ 1161.084013] RIP: 0010:[<ffffffff8164def6>] [<ffffffff8164def6>] _raw_spin_unlock_irqrestore+0x16/0x20
  2105. [ 1161.095155] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  2106. [ 1161.101456] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000a1
  2107. [ 1161.109804] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  2108. [ 1161.118149] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  2109. [ 1161.126497] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  2110. [ 1161.134843] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  2111. [ 1161.143189] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2112. [ 1161.152886] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2113. [ 1161.159674] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2114. [ 1161.168020] Stack:
  2115. [ 1161.170620] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  2116. [ 1161.179849] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  2117. [ 1161.189080] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  2118. [ 1161.198321] Call Trace:
  2119. [ 1161.201411] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  2120. [ 1161.208591] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2121. [ 1161.215187] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2122. [ 1161.221198] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2123. [ 1161.227112] [<ffffffff81015c1b>] die+0x4b/0x70
  2124. [ 1161.232539] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2125. [ 1161.238452] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2126. [ 1161.244853] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2127. [ 1161.251838] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2128. [ 1161.258921] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2129. [ 1161.265615] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2130. [ 1161.271724] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2131. [ 1161.278709] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2132. [ 1161.293066] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2133. [ 1161.300343] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2134. [ 1161.306647] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2135. [ 1161.312950] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2136. [ 1161.319838] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2137. [ 1161.326532] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2138. [ 1161.333127] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2139. [ 1161.339724] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2140. [ 1161.346903] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2141. [ 1161.353500] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2142. [ 1161.360387] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2143. [ 1161.367275] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2144. [ 1161.373480] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2145. [ 1161.380367] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2146. [ 1161.387060] [<ffffffff81088640>] kthread+0xc0/0xd0
  2147. [ 1161.392876] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2148. [ 1161.400057] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2149. [ 1161.406457] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2150. [ 1161.413635] Code: eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d 0f 1f 44 00 00 <5d> c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55 48 89 e5 ba ff
  2151. [ 1189.032668] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  2152. [ 1189.040042] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2153. [ 1189.076558] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2154. [ 1189.086645] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2155. [ 1189.098096] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2156. [ 1189.107110] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  2157. [ 1189.117669] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  2158. [ 1189.123970] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 00000000000000dd
  2159. [ 1189.132316] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  2160. [ 1189.140663] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  2161. [ 1189.149010] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  2162. [ 1189.157356] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  2163. [ 1189.165702] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2164. [ 1189.175399] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2165. [ 1189.182187] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2166. [ 1189.190532] Stack:
  2167. [ 1189.193132] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  2168. [ 1189.202361] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  2169. [ 1189.211596] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  2170. [ 1189.220837] Call Trace:
  2171. [ 1189.223926] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  2172. [ 1189.231107] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2173. [ 1189.237702] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2174. [ 1189.243714] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2175. [ 1189.249629] [<ffffffff81015c1b>] die+0x4b/0x70
  2176. [ 1189.255056] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2177. [ 1189.260970] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2178. [ 1189.267371] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2179. [ 1189.274357] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2180. [ 1189.281438] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2181. [ 1189.288131] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2182. [ 1189.294240] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2183. [ 1189.301225] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2184. [ 1189.307627] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2185. [ 1189.314904] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2186. [ 1189.321207] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2187. [ 1189.327510] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2188. [ 1189.334398] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2189. [ 1189.341092] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2190. [ 1189.347689] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2191. [ 1189.354285] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2192. [ 1189.361466] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2193. [ 1189.368063] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2194. [ 1189.374952] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2195. [ 1189.381840] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2196. [ 1189.388046] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2197. [ 1189.394933] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2198. [ 1189.401626] [<ffffffff81088640>] kthread+0xc0/0xd0
  2199. [ 1189.407442] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2200. [ 1189.414623] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2201. [ 1189.421023] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2202. [ 1189.428201] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  2203. [ 1217.055765] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  2204. [ 1217.063138] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2205. [ 1217.099657] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2206. [ 1217.109743] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2207. [ 1217.121193] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2208. [ 1217.130207] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  2209. [ 1217.141350] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  2210. [ 1217.147651] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 000000000000001c
  2211. [ 1217.155998] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  2212. [ 1217.164344] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  2213. [ 1217.172690] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  2214. [ 1217.181037] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  2215. [ 1217.189385] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2216. [ 1217.199073] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2217. [ 1217.205861] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2218. [ 1217.214208] Stack:
  2219. [ 1217.216808] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  2220. [ 1217.226038] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  2221. [ 1217.235277] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  2222. [ 1217.244519] Call Trace:
  2223. [ 1217.247609] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  2224. [ 1217.254789] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2225. [ 1217.261385] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2226. [ 1217.267397] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2227. [ 1217.273311] [<ffffffff81015c1b>] die+0x4b/0x70
  2228. [ 1217.278739] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2229. [ 1217.284653] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2230. [ 1217.291054] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2231. [ 1217.298038] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2232. [ 1217.305120] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2233. [ 1217.311813] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2234. [ 1217.317921] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2235. [ 1217.324907] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2236. [ 1217.331307] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2237. [ 1217.338585] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2238. [ 1217.344887] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2239. [ 1217.351190] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2240. [ 1217.358078] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2241. [ 1217.364771] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2242. [ 1217.371367] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2243. [ 1217.377962] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2244. [ 1217.385141] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2245. [ 1217.391738] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2246. [ 1217.398627] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2247. [ 1217.405514] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2248. [ 1217.411720] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2249. [ 1217.418607] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2250. [ 1217.425300] [<ffffffff81088640>] kthread+0xc0/0xd0
  2251. [ 1217.431115] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2252. [ 1217.438295] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2253. [ 1217.444697] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2254. [ 1217.451874] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  2255. [ 1245.078862] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  2256. [ 1245.086236] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2257. [ 1245.122751] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2258. [ 1245.132838] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2259. [ 1245.144288] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2260. [ 1245.153303] RIP: 0010:[<ffffffff8164e13a>] [<ffffffff8164e13a>] _raw_spin_lock_irqsave+0xa/0x40
  2261. [ 1245.163863] RSP: 0018:ffff880178f1f8a8 EFLAGS: 00000202
  2262. [ 1245.170164] RAX: 0000000000000000 RBX: ffffffff81ca4c40 RCX: 0000000000000005
  2263. [ 1245.178511] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: ffff880177fa7bb0
  2264. [ 1245.186857] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  2265. [ 1245.195204] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c64
  2266. [ 1245.203550] R13: 00000001800f000c R14: ffff880178f1f888 R15: 0000001f811bf83a
  2267. [ 1245.211896] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2268. [ 1245.221593] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2269. [ 1245.228381] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2270. [ 1245.236727] Stack:
  2271. [ 1245.239327] 0000000000000202 ffff880178f1f8e0 ffffffff812db83a ffff880177446320
  2272. [ 1245.256530] ffff880178f1f720 ffff880178f1f720 ffff880177446310 ffff880178f1f8f8
  2273. [ 1245.265770] ffffffff812db90b ffff880177446848 ffff880178f1f980 ffffffff810697e8
  2274. [ 1245.275003] Call Trace:
  2275. [ 1245.278093] [<ffffffff812db83a>] put_io_context_active+0x2a/0xc0
  2276. [ 1245.285273] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2277. [ 1245.291868] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2278. [ 1245.297880] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2279. [ 1245.303794] [<ffffffff81015c1b>] die+0x4b/0x70
  2280. [ 1245.309221] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2281. [ 1245.315134] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2282. [ 1245.321535] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2283. [ 1245.328520] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2284. [ 1245.335602] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2285. [ 1245.342296] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2286. [ 1245.348404] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2287. [ 1245.355389] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2288. [ 1245.361789] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2289. [ 1245.369066] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2290. [ 1245.375369] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2291. [ 1245.381672] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2292. [ 1245.388561] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2293. [ 1245.395254] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2294. [ 1245.401849] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2295. [ 1245.408444] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2296. [ 1245.415625] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2297. [ 1245.422223] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2298. [ 1245.429110] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2299. [ 1245.435999] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2300. [ 1245.442206] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2301. [ 1245.449093] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2302. [ 1245.455786] [<ffffffff81088640>] kthread+0xc0/0xd0
  2303. [ 1245.461602] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2304. [ 1245.468783] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2305. [ 1245.475184] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2306. [ 1245.482362] Code: 00 0f 1f 44 00 00 55 48 89 e5 f0 81 07 00 00 10 00 48 8b 7d 08 e8 a7 d5 a1 ff 5d c3 0f 1f 44 00 00 0f 1f 44 00 00 55 48 89 e5 9c <58> 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00
  2307. [ 1261.072043] INFO: rcu_sched self-detected stall on CPU { 1} (t=960015 jiffies g=3503 c=3502 q=2990)
  2308. [ 1261.083232] sending NMI to all CPUs:
  2309. [ 1261.087587] NMI backtrace for cpu 0
  2310. [ 1261.091846] CPU: 0 PID: 0 Comm: swapper/0 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2311. [ 1261.101738] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2312. [ 1261.113187] task: ffffffff81c13440 ti: ffffffff81c00000 task.ti: ffffffff81c00000
  2313. [ 1261.122201] RIP: 0010:[<ffffffff8164e162>] [<ffffffff8164e162>] _raw_spin_lock_irqsave+0x32/0x40
  2314. [ 1261.132856] RSP: 0018:ffff88017fc03e18 EFLAGS: 00000002
  2315. [ 1261.139159] RAX: 0000000000000296 RBX: ffff8801779cc100 RCX: 000000000000007a
  2316. [ 1261.147506] RDX: 0000000000000079 RSI: 0000000000000296 RDI: ffff8801779cc528
  2317. [ 1261.155852] RBP: ffff88017fc03e18 R08: 0000004cc72b05c0 R09: ffffffff81eb3280
  2318. [ 1261.164199] R10: 0000000000000000 R11: 0000000000000005 R12: 0000000000000000
  2319. [ 1261.172544] R13: 0000000000000000 R14: ffffffff812ddae0 R15: ffff8801779cc100
  2320. [ 1261.180892] FS: 0000000000000000(0000) GS:ffff88017fc00000(0000) knlGS:0000000000000000
  2321. [ 1261.190589] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2322. [ 1261.197378] CR2: 00007f8fdd332000 CR3: 0000000168ff7000 CR4: 00000000001007f0
  2323. [ 1261.205724] Stack:
  2324. [ 1261.208324] ffff88017fc03e68 ffffffff812ddb0f ffff88017fc03e60 ffff8801779cc100
  2325. [ 1261.217562] ffffffff81c13440 ffffffff81eb3280 ffff8801779cc5e0 0000000000000100
  2326. [ 1261.226799] ffffffff812ddae0 ffff8801779cc100 ffff88017fc03ea0 ffffffff81072b36
  2327. [ 1261.236038] Call Trace:
  2328. [ 1261.239125] <IRQ>
  2329. [ 1261.241339] [<ffffffff812ddb0f>] blk_rq_timed_out_timer+0x2f/0x140
  2330. [ 1261.249351] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  2331. [ 1261.256240] [<ffffffff81072b36>] call_timer_fn+0x36/0x110
  2332. [ 1261.262738] [<ffffffff812ddae0>] ? blk_rq_timed_out+0x70/0x70
  2333. [ 1261.269625] [<ffffffff81073779>] run_timer_softirq+0x1e9/0x290
  2334. [ 1261.276611] [<ffffffff8106c427>] __do_softirq+0xf7/0x240
  2335. [ 1261.283013] [<ffffffff8106c705>] irq_exit+0xb5/0xc0
  2336. [ 1261.288927] [<ffffffff81658c85>] smp_apic_timer_interrupt+0x45/0x60
  2337. [ 1261.296399] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  2338. [ 1261.303480] <EOI>
  2339. [ 1261.305704] [<ffffffff81500382>] ? cpuidle_enter_state+0x52/0xc0
  2340. [ 1261.313522] [<ffffffff815004b9>] cpuidle_idle_call+0xc9/0x210
  2341. [ 1261.320411] [<ffffffff8101b5fe>] arch_cpu_idle+0xe/0x30
  2342. [ 1261.326714] [<ffffffff810b667e>] cpu_startup_entry+0xce/0x280
  2343. [ 1261.333603] [<ffffffff8163daf7>] rest_init+0x77/0x80
  2344. [ 1261.339615] [<ffffffff81d0eef5>] start_kernel+0x40a/0x416
  2345. [ 1261.346113] [<ffffffff81d0e8f4>] ? repair_env_string+0x5c/0x5c
  2346. [ 1261.353098] [<ffffffff81d0e120>] ? early_idt_handlers+0x120/0x120
  2347. [ 1261.360376] [<ffffffff81d0e5dc>] x86_64_start_reservations+0x2a/0x2c
  2348. [ 1261.367945] [<ffffffff81d0e6e6>] x86_64_start_kernel+0x108/0x117
  2349. [ 1261.375123] Code: 89 e5 9c 58 0f 1f 44 00 00 48 89 c6 fa 66 0f 1f 44 00 00 ba 00 01 00 00 f0 66 0f c1 17 0f b6 ce 38 d1 74 0e 0f 1f 44 00 00 f3 90 <0f> b6 17 38 d1 75 f7 48 89 f0 5d c3 66 90 0f 1f 44 00 00 55 48
  2350. [ 1261.402383] NMI backtrace for cpu 1
  2351. [ 1261.406642] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2352. [ 1261.416729] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2353. [ 1261.428180] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2354. [ 1261.437194] RIP: 0010:[<ffffffff81309683>] [<ffffffff81309683>] __bitmap_empty+0x13/0x80
  2355. [ 1261.447063] RSP: 0018:ffff88017fd03de8 EFLAGS: 00000002
  2356. [ 1261.453364] RAX: 0000000000000000 RBX: 0000000000002710 RCX: 0000000000000002
  2357. [ 1261.461711] RDX: 0000000000000c00 RSI: 0000000000000080 RDI: ffffffff81ceb900
  2358. [ 1261.470058] RBP: ffff88017fd03de8 R08: ffffffff81cecbf8 R09: 0000000000000cb9
  2359. [ 1261.478405] R10: 0000000000000001 R11: 0000000000000000 R12: ffffffff81c50240
  2360. [ 1261.486751] R13: ffffffff81c50240 R14: ffff88017fd0eb80 R15: 0000000000000bae
  2361. [ 1261.495097] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2362. [ 1261.504793] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2363. [ 1261.511580] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2364. [ 1261.519928] Stack:
  2365. [ 1261.522528] ffff88017fd03e00 ffffffff81042680 ffffffff81cecc10 ffff88017fd03e60
  2366. [ 1261.531768] ffffffff810feb7d ffff880177446320 0000000000000000 000001255fa3fc43
  2367. [ 1261.541000] ffff880178f1e000 0000000000000001 ffff880177446320 0000000000000000
  2368. [ 1261.550238] Call Trace:
  2369. [ 1261.553325] <IRQ>
  2370. [ 1261.555548] [<ffffffff81042680>] arch_trigger_all_cpu_backtrace+0x80/0x90
  2371. [ 1261.564243] [<ffffffff810feb7d>] rcu_check_callbacks+0x30d/0x5f0
  2372. [ 1261.571424] [<ffffffff810749b7>] update_process_times+0x47/0x80
  2373. [ 1261.578507] [<ffffffff810c0db5>] tick_sched_handle.isra.15+0x25/0x60
  2374. [ 1261.586076] [<ffffffff810c0e31>] tick_sched_timer+0x41/0x60
  2375. [ 1261.592770] [<ffffffff8108bc53>] __run_hrtimer+0x73/0x1d0
  2376. [ 1261.599268] [<ffffffff810c0df0>] ? tick_sched_handle.isra.15+0x60/0x60
  2377. [ 1261.607033] [<ffffffff8108c467>] hrtimer_interrupt+0xf7/0x240
  2378. [ 1261.613921] [<ffffffff81040a97>] local_apic_timer_interrupt+0x37/0x60
  2379. [ 1261.621589] [<ffffffff81658c7f>] smp_apic_timer_interrupt+0x3f/0x60
  2380. [ 1261.629062] [<ffffffff8165761d>] apic_timer_interrupt+0x6d/0x80
  2381. [ 1261.636141] <EOI>
  2382. [ 1261.638365] [<ffffffff812db8bb>] ? put_io_context_active+0xab/0xc0
  2383. [ 1261.646375] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2384. [ 1261.652970] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2385. [ 1261.658982] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2386. [ 1261.664897] [<ffffffff81015c1b>] die+0x4b/0x70
  2387. [ 1261.670324] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2388. [ 1261.676237] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2389. [ 1261.682638] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2390. [ 1261.689624] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2391. [ 1261.696706] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2392. [ 1261.703399] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2393. [ 1261.709508] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2394. [ 1261.716493] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2395. [ 1261.722894] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2396. [ 1261.730171] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2397. [ 1261.736474] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2398. [ 1261.742777] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2399. [ 1261.749664] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2400. [ 1261.756357] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2401. [ 1261.762953] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2402. [ 1261.769550] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2403. [ 1261.776730] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2404. [ 1261.783327] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2405. [ 1261.790216] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2406. [ 1261.797105] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2407. [ 1261.803312] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2408. [ 1261.810200] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2409. [ 1261.816893] [<ffffffff81088640>] kthread+0xc0/0xd0
  2410. [ 1261.822709] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2411. [ 1261.829889] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2412. [ 1261.836289] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2413. [ 1261.843468] Code: 4c 89 4c 24 40 c7 04 24 10 00 00 00 48 89 44 24 10 e8 42 ff ff ff c9 c3 8d 4e 3f 85 f6 55 0f 49 ce 48 89 e5 c1 f9 06 85 c9 7e 61 <48> 83 3f 00 75 57 48 8d 57 08 31 c0 eb 12 0f 1f 80 00 00 00 00
  2414. [ 1285.111858] BUG: soft lockup - CPU#1 stuck for 21s! [md7_raid5:473]
  2415. [ 1285.119232] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2416. [ 1285.155748] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2417. [ 1285.165835] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2418. [ 1285.177286] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2419. [ 1285.186301] RIP: 0010:[<ffffffff8164def1>] [<ffffffff8164def1>] _raw_spin_unlock_irqrestore+0x11/0x20
  2420. [ 1285.205413] RSP: 0018:ffff880178f1f8b0 EFLAGS: 00000202
  2421. [ 1285.211714] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000dd
  2422. [ 1285.220060] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  2423. [ 1285.228406] RBP: ffff880178f1f8b0 R08: 0000000000000000 R09: 0000000000000001
  2424. [ 1285.236751] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81ca4c40
  2425. [ 1285.245097] R13: ffff880178f1f8b0 R14: ffffffff81ca4c64 R15: 00000001800f000c
  2426. [ 1285.253445] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2427. [ 1285.263142] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2428. [ 1285.269930] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2429. [ 1285.278276] Stack:
  2430. [ 1285.280875] ffff880178f1f8e0 ffffffff812db8bb ffff880177446320 ffff880178f1f720
  2431. [ 1285.290106] ffff880178f1f720 ffff880177446310 ffff880178f1f8f8 ffffffff812db90b
  2432. [ 1285.299334] ffff880177446848 ffff880178f1f980 ffffffff810697e8 00000001819ea99c
  2433. [ 1285.308572] Call Trace:
  2434. [ 1285.311662] [<ffffffff812db8bb>] put_io_context_active+0xab/0xc0
  2435. [ 1285.318842] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2436. [ 1285.325438] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2437. [ 1285.331449] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2438. [ 1285.337363] [<ffffffff81015c1b>] die+0x4b/0x70
  2439. [ 1285.342790] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2440. [ 1285.348703] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2441. [ 1285.355104] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2442. [ 1285.362089] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2443. [ 1285.369171] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2444. [ 1285.375864] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2445. [ 1285.381974] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2446. [ 1285.388959] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2447. [ 1285.395359] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2448. [ 1285.402637] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2449. [ 1285.408940] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2450. [ 1285.415243] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2451. [ 1285.422130] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2452. [ 1285.428823] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2453. [ 1285.435420] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2454. [ 1285.442016] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2455. [ 1285.449196] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2456. [ 1285.455793] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2457. [ 1285.462682] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2458. [ 1285.469570] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2459. [ 1285.475776] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2460. [ 1285.482663] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2461. [ 1285.489357] [<ffffffff81088640>] kthread+0xc0/0xd0
  2462. [ 1285.495173] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2463. [ 1285.502353] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2464. [ 1285.508754] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2465. [ 1285.515932] Code: c1 07 45 31 e4 eb a2 41 80 47 08 01 fb 66 0f 1f 44 00 00 eb b6 31 c0 eb ba 90 0f 1f 44 00 00 55 48 89 e5 80 07 01 48 89 f7 57 9d <0f> 1f 44 00 00 5d c3 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 55
  2466. [ 1313.134956] BUG: soft lockup - CPU#1 stuck for 22s! [md7_raid5:473]
  2467. [ 1313.142329] Modules linked in: bnep bluetooth rfkill bonding iTCO_wdt iTCO_vendor_support raid456 async_raid6_recov async_memcpy async_pq raid6_pq async_xor xor async_tx i2c_i801 lpc_ich mfd_core igb ixgbe ptp i2c_ismt pps_core mdio dca shpchp acpi_cpufreq mperf uinput usb_storage i2c_algo_bit drm_kms_helper ttm drm i2c_core
  2468. [ 1313.178849] CPU: 1 PID: 473 Comm: md7_raid5 Tainted: G D W 3.11.4-201.fc19.x86_64 #1
  2469. [ 1313.188937] Hardware name: Intel Corp. Atom Server, BIOS EDVLCRB1.86B.0028.R00.1309241330 09/24/2013
  2470. [ 1313.200387] task: ffff880177446320 ti: ffff880178f1e000 task.ti: ffff880178f1e000
  2471. [ 1313.209401] RIP: 0010:[<ffffffff812db8bd>] [<ffffffff812db8bd>] put_io_context_active+0xad/0xc0
  2472. [ 1313.219959] RSP: 0018:ffff880178f1f8c0 EFLAGS: 00000202
  2473. [ 1313.226260] RAX: 0000000000000000 RBX: ffffffff81fce1f0 RCX: 00000000000000c9
  2474. [ 1313.234606] RDX: 0000000000007b79 RSI: 0000000000000202 RDI: 0000000000000202
  2475. [ 1313.242952] RBP: ffff880178f1f8e0 R08: 0000000000000000 R09: 0000000000000001
  2476. [ 1313.251298] R10: ffffffff81fce1f0 R11: 0000000000000000 R12: ffffffff81fce1f0
  2477. [ 1313.259643] R13: ffff880178f1f8b0 R14: ffffffff81ca4c40 R15: ffff880178f1f8b0
  2478. [ 1313.267991] FS: 0000000000000000(0000) GS:ffff88017fd00000(0000) knlGS:0000000000000000
  2479. [ 1313.277688] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
  2480. [ 1313.284476] CR2: 00007fd98838b070 CR3: 0000000001c0c000 CR4: 00000000001007e0
  2481. [ 1313.292821] Stack:
  2482. [ 1313.295421] ffff880177446320 ffff880178f1f720 ffff880178f1f720 ffff880177446310
  2483. [ 1313.304657] ffff880178f1f8f8 ffffffff812db90b ffff880177446848 ffff880178f1f980
  2484. [ 1313.313890] ffffffff810697e8 00000001819ea99c ffff880177446538 0000000000001ec9
  2485. [ 1313.323131] Call Trace:
  2486. [ 1313.326221] [<ffffffff812db90b>] exit_io_context+0x3b/0x40
  2487. [ 1313.332816] [<ffffffff810697e8>] do_exit+0x658/0xa20
  2488. [ 1313.338827] [<ffffffff8164f3e1>] oops_end+0xa1/0xe0
  2489. [ 1313.344741] [<ffffffff81015c1b>] die+0x4b/0x70
  2490. [ 1313.350167] [<ffffffff8164ecb0>] do_trap+0x60/0x170
  2491. [ 1313.356082] [<ffffffff81012fa5>] do_invalid_op+0x95/0xb0
  2492. [ 1313.362484] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2493. [ 1313.369470] [<ffffffff8113ea65>] ? mempool_alloc_slab+0x15/0x20
  2494. [ 1313.376553] [<ffffffff8113eb9a>] ? mempool_alloc+0x5a/0x140
  2495. [ 1313.383247] [<ffffffff816580de>] invalid_op+0x1e/0x30
  2496. [ 1313.389356] [<ffffffff814177a8>] ? scsi_init_sgtable+0x68/0x70
  2497. [ 1313.396341] [<ffffffff814177de>] scsi_init_io+0x2e/0x160
  2498. [ 1313.402742] [<ffffffff81417969>] scsi_setup_blk_pc_cmnd+0x59/0xf0
  2499. [ 1313.410020] [<ffffffff814259a3>] sd_prep_fn+0x1b3/0xf90
  2500. [ 1313.416322] [<ffffffff812d1602>] ? elv_rb_add+0x62/0x70
  2501. [ 1313.422626] [<ffffffff812d8472>] blk_peek_request+0x132/0x250
  2502. [ 1313.429514] [<ffffffff814189bf>] scsi_request_fn+0x4f/0x520
  2503. [ 1313.436208] [<ffffffff812d5be3>] __blk_run_queue+0x33/0x40
  2504. [ 1313.442803] [<ffffffff812d5d8a>] queue_unplugged+0x2a/0x90
  2505. [ 1313.449398] [<ffffffff812d883d>] blk_flush_plug_list+0x15d/0x1f0
  2506. [ 1313.456578] [<ffffffff812d8c94>] blk_finish_plug+0x14/0x40
  2507. [ 1313.463175] [<ffffffffa02abf7d>] raid5d+0x4fd/0x570 [raid456]
  2508. [ 1313.470063] [<ffffffff8109c226>] ? __dequeue_entity+0x26/0x40
  2509. [ 1313.476952] [<ffffffff814d57cd>] md_thread+0x12d/0x170
  2510. [ 1313.483159] [<ffffffff81089400>] ? wake_up_atomic_t+0x30/0x30
  2511. [ 1313.490047] [<ffffffff814d56a0>] ? rdev_attr_show+0x90/0x90
  2512. [ 1313.496740] [<ffffffff81088640>] kthread+0xc0/0xd0
  2513. [ 1313.502557] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2514. [ 1313.509737] [<ffffffff8165696c>] ret_from_fork+0x7c/0xb0
  2515. [ 1313.516139] [<ffffffff81088580>] ? insert_kthread_work+0x40/0x40
  2516. [ 1313.523317] Code: 75 c5 4c 89 f6 4c 89 ef e8 41 26 37 00 4c 89 e7 e8 d9 fe ff ff 5b 41 5c 41 5d 41 5e 5d c3 4c 89 f6 4c 89 ef e8 25 26 37 00 f3 90 <e9> 70 ff ff ff 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!