API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Apr 22nd, 2024
37
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 325.15 KB | None | 0 0
raw download clone embed print report
  1. Apr 22 00:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2. Apr 22 00:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3. Apr 22 00:08:37 hp-epyc kernel: (detected by 53, t=2940082 jiffies, g=1051549, q=30752212)
  4. Apr 22 00:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  5. Apr 22 00:08:37 hp-epyc kernel: Call Trace:
  6. Apr 22 00:08:37 hp-epyc kernel: <TASK>
  7. Apr 22 00:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  8. Apr 22 00:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  9. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  10. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  11. Apr 22 00:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  12. Apr 22 00:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  13. Apr 22 00:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  14. Apr 22 00:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  15. Apr 22 00:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  16. Apr 22 00:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  17. Apr 22 00:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  18. Apr 22 00:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  19. Apr 22 00:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  20. Apr 22 00:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  21. Apr 22 00:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  22. Apr 22 00:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  23. Apr 22 00:08:37 hp-epyc kernel: </TASK>
  24. Apr 22 00:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  25. Apr 22 00:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  26. Apr 22 00:08:37 hp-epyc kernel: (detected by 53, t=3120087 jiffies, g=1051549, q=30989147)
  27. Apr 22 00:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  28. Apr 22 00:08:37 hp-epyc kernel: Call Trace:
  29. Apr 22 00:08:37 hp-epyc kernel: <TASK>
  30. Apr 22 00:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  31. Apr 22 00:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  32. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  33. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  34. Apr 22 00:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  35. Apr 22 00:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  36. Apr 22 00:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  37. Apr 22 00:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  38. Apr 22 00:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  39. Apr 22 00:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  40. Apr 22 00:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  41. Apr 22 00:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  42. Apr 22 00:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  43. Apr 22 00:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  44. Apr 22 00:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  45. Apr 22 00:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  46. Apr 22 00:08:37 hp-epyc kernel: </TASK>
  47. Apr 22 00:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  48. Apr 22 00:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  49. Apr 22 00:08:37 hp-epyc kernel: (detected by 0, t=3300092 jiffies, g=1051549, q=31246683)
  50. Apr 22 00:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  51. Apr 22 00:08:37 hp-epyc kernel: Call Trace:
  52. Apr 22 00:08:37 hp-epyc kernel: <TASK>
  53. Apr 22 00:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  54. Apr 22 00:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  55. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  56. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  57. Apr 22 00:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  58. Apr 22 00:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  59. Apr 22 00:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  60. Apr 22 00:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  61. Apr 22 00:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  62. Apr 22 00:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  63. Apr 22 00:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  64. Apr 22 00:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  65. Apr 22 00:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  66. Apr 22 00:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  67. Apr 22 00:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  68. Apr 22 00:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  69. Apr 22 00:08:37 hp-epyc kernel: </TASK>
  70. Apr 22 00:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  71. Apr 22 00:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  72. Apr 22 00:14:37 hp-epyc kernel: (detected by 53, t=3480097 jiffies, g=1051549, q=31484294)
  73. Apr 22 00:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  74. Apr 22 00:14:37 hp-epyc kernel: Call Trace:
  75. Apr 22 00:14:37 hp-epyc kernel: <TASK>
  76. Apr 22 00:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  77. Apr 22 00:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  78. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  79. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  80. Apr 22 00:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  81. Apr 22 00:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  82. Apr 22 00:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  83. Apr 22 00:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  84. Apr 22 00:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  85. Apr 22 00:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  86. Apr 22 00:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  87. Apr 22 00:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  88. Apr 22 00:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  89. Apr 22 00:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  90. Apr 22 00:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  91. Apr 22 00:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  92. Apr 22 00:14:37 hp-epyc kernel: </TASK>
  93. Apr 22 00:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  94. Apr 22 00:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  95. Apr 22 00:14:37 hp-epyc kernel: (detected by 0, t=3660102 jiffies, g=1051549, q=31714568)
  96. Apr 22 00:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  97. Apr 22 00:14:37 hp-epyc kernel: Call Trace:
  98. Apr 22 00:14:37 hp-epyc kernel: <TASK>
  99. Apr 22 00:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  100. Apr 22 00:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  101. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  102. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  103. Apr 22 00:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  104. Apr 22 00:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  105. Apr 22 00:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  106. Apr 22 00:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  107. Apr 22 00:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  108. Apr 22 00:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  109. Apr 22 00:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  110. Apr 22 00:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  111. Apr 22 00:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  112. Apr 22 00:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  113. Apr 22 00:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  114. Apr 22 00:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  115. Apr 22 00:14:37 hp-epyc kernel: </TASK>
  116. Apr 22 00:17:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  117. Apr 22 00:17:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  118. Apr 22 00:17:37 hp-epyc kernel: (detected by 0, t=3840107 jiffies, g=1051549, q=31964421)
  119. Apr 22 00:17:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  120. Apr 22 00:17:37 hp-epyc kernel: Call Trace:
  121. Apr 22 00:17:37 hp-epyc kernel: <TASK>
  122. Apr 22 00:17:37 hp-epyc kernel: __schedule+0x238/0x5e0
  123. Apr 22 00:17:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  124. Apr 22 00:17:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  125. Apr 22 00:17:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  126. Apr 22 00:17:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  127. Apr 22 00:17:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  128. Apr 22 00:17:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  129. Apr 22 00:17:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  130. Apr 22 00:17:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  131. Apr 22 00:17:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  132. Apr 22 00:17:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  133. Apr 22 00:17:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  134. Apr 22 00:17:37 hp-epyc kernel: kthread+0x191/0x1b0
  135. Apr 22 00:17:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  136. Apr 22 00:17:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  137. Apr 22 00:17:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  138. Apr 22 00:17:37 hp-epyc kernel: </TASK>
  139. Apr 22 00:23:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  140. Apr 22 00:23:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  141. Apr 22 00:23:37 hp-epyc kernel: (detected by 53, t=4020112 jiffies, g=1051549, q=32196901)
  142. Apr 22 00:23:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  143. Apr 22 00:23:37 hp-epyc kernel: Call Trace:
  144. Apr 22 00:23:37 hp-epyc kernel: <TASK>
  145. Apr 22 00:23:37 hp-epyc kernel: __schedule+0x238/0x5e0
  146. Apr 22 00:23:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  147. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  148. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  149. Apr 22 00:23:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  150. Apr 22 00:23:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  151. Apr 22 00:23:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  152. Apr 22 00:23:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  153. Apr 22 00:23:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  154. Apr 22 00:23:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  155. Apr 22 00:23:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  156. Apr 22 00:23:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  157. Apr 22 00:23:37 hp-epyc kernel: kthread+0x191/0x1b0
  158. Apr 22 00:23:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  159. Apr 22 00:23:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  160. Apr 22 00:23:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  161. Apr 22 00:23:37 hp-epyc kernel: </TASK>
  162. Apr 22 00:23:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  163. Apr 22 00:23:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  164. Apr 22 00:23:37 hp-epyc kernel: (detected by 0, t=4200117 jiffies, g=1051549, q=32420343)
  165. Apr 22 00:23:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  166. Apr 22 00:23:37 hp-epyc kernel: Call Trace:
  167. Apr 22 00:23:37 hp-epyc kernel: <TASK>
  168. Apr 22 00:23:37 hp-epyc kernel: __schedule+0x238/0x5e0
  169. Apr 22 00:23:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  170. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  171. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  172. Apr 22 00:23:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  173. Apr 22 00:23:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  174. Apr 22 00:23:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  175. Apr 22 00:23:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  176. Apr 22 00:23:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  177. Apr 22 00:23:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  178. Apr 22 00:23:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  179. Apr 22 00:23:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  180. Apr 22 00:23:37 hp-epyc kernel: kthread+0x191/0x1b0
  181. Apr 22 00:23:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  182. Apr 22 00:23:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  183. Apr 22 00:23:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  184. Apr 22 00:23:37 hp-epyc kernel: </TASK>
  185. Apr 22 00:26:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  186. Apr 22 00:26:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  187. Apr 22 00:26:37 hp-epyc kernel: (detected by 0, t=4380122 jiffies, g=1051549, q=32626777)
  188. Apr 22 00:26:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  189. Apr 22 00:26:37 hp-epyc kernel: Call Trace:
  190. Apr 22 00:26:37 hp-epyc kernel: <TASK>
  191. Apr 22 00:26:37 hp-epyc kernel: __schedule+0x238/0x5e0
  192. Apr 22 00:26:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  193. Apr 22 00:26:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  194. Apr 22 00:26:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  195. Apr 22 00:26:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  196. Apr 22 00:26:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  197. Apr 22 00:26:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  198. Apr 22 00:26:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  199. Apr 22 00:26:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  200. Apr 22 00:26:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  201. Apr 22 00:26:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  202. Apr 22 00:26:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  203. Apr 22 00:26:37 hp-epyc kernel: kthread+0x191/0x1b0
  204. Apr 22 00:26:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  205. Apr 22 00:26:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  206. Apr 22 00:26:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  207. Apr 22 00:26:37 hp-epyc kernel: </TASK>
  208. Apr 22 00:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  209. Apr 22 00:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  210. Apr 22 00:35:37 hp-epyc kernel: (detected by 53, t=4560127 jiffies, g=1051549, q=32835543)
  211. Apr 22 00:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  212. Apr 22 00:35:37 hp-epyc kernel: Call Trace:
  213. Apr 22 00:35:37 hp-epyc kernel: <TASK>
  214. Apr 22 00:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  215. Apr 22 00:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  216. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  217. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  218. Apr 22 00:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  219. Apr 22 00:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  220. Apr 22 00:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  221. Apr 22 00:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  222. Apr 22 00:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  223. Apr 22 00:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  224. Apr 22 00:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  225. Apr 22 00:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  226. Apr 22 00:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  227. Apr 22 00:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  228. Apr 22 00:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  229. Apr 22 00:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  230. Apr 22 00:35:37 hp-epyc kernel: </TASK>
  231. Apr 22 00:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  232. Apr 22 00:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  233. Apr 22 00:35:37 hp-epyc kernel: (detected by 53, t=4740132 jiffies, g=1051549, q=33046636)
  234. Apr 22 00:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  235. Apr 22 00:35:37 hp-epyc kernel: Call Trace:
  236. Apr 22 00:35:37 hp-epyc kernel: <TASK>
  237. Apr 22 00:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  238. Apr 22 00:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  239. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  240. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  241. Apr 22 00:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  242. Apr 22 00:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  243. Apr 22 00:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  244. Apr 22 00:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  245. Apr 22 00:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  246. Apr 22 00:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  247. Apr 22 00:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  248. Apr 22 00:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  249. Apr 22 00:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  250. Apr 22 00:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  251. Apr 22 00:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  252. Apr 22 00:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  253. Apr 22 00:35:37 hp-epyc kernel: </TASK>
  254. Apr 22 00:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  255. Apr 22 00:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  256. Apr 22 00:35:37 hp-epyc kernel: (detected by 0, t=4920137 jiffies, g=1051549, q=33238458)
  257. Apr 22 00:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  258. Apr 22 00:35:37 hp-epyc kernel: Call Trace:
  259. Apr 22 00:35:37 hp-epyc kernel: <TASK>
  260. Apr 22 00:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  261. Apr 22 00:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  262. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  263. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  264. Apr 22 00:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  265. Apr 22 00:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  266. Apr 22 00:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  267. Apr 22 00:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  268. Apr 22 00:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  269. Apr 22 00:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  270. Apr 22 00:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  271. Apr 22 00:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  272. Apr 22 00:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  273. Apr 22 00:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  274. Apr 22 00:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  275. Apr 22 00:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  276. Apr 22 00:35:37 hp-epyc kernel: </TASK>
  277. Apr 22 00:41:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  278. Apr 22 00:41:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  279. Apr 22 00:41:37 hp-epyc kernel: (detected by 53, t=5100142 jiffies, g=1051549, q=33447572)
  280. Apr 22 00:41:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  281. Apr 22 00:41:37 hp-epyc kernel: Call Trace:
  282. Apr 22 00:41:37 hp-epyc kernel: <TASK>
  283. Apr 22 00:41:37 hp-epyc kernel: __schedule+0x238/0x5e0
  284. Apr 22 00:41:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  285. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  286. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  287. Apr 22 00:41:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  288. Apr 22 00:41:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  289. Apr 22 00:41:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  290. Apr 22 00:41:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  291. Apr 22 00:41:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  292. Apr 22 00:41:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  293. Apr 22 00:41:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  294. Apr 22 00:41:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  295. Apr 22 00:41:37 hp-epyc kernel: kthread+0x191/0x1b0
  296. Apr 22 00:41:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  297. Apr 22 00:41:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  298. Apr 22 00:41:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  299. Apr 22 00:41:37 hp-epyc kernel: </TASK>
  300. Apr 22 00:41:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  301. Apr 22 00:41:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  302. Apr 22 00:41:37 hp-epyc kernel: (detected by 0, t=5280147 jiffies, g=1051549, q=33701577)
  303. Apr 22 00:41:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  304. Apr 22 00:41:37 hp-epyc kernel: Call Trace:
  305. Apr 22 00:41:37 hp-epyc kernel: <TASK>
  306. Apr 22 00:41:37 hp-epyc kernel: __schedule+0x238/0x5e0
  307. Apr 22 00:41:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  308. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  309. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  310. Apr 22 00:41:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  311. Apr 22 00:41:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  312. Apr 22 00:41:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  313. Apr 22 00:41:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  314. Apr 22 00:41:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  315. Apr 22 00:41:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  316. Apr 22 00:41:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  317. Apr 22 00:41:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  318. Apr 22 00:41:37 hp-epyc kernel: kthread+0x191/0x1b0
  319. Apr 22 00:41:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  320. Apr 22 00:41:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  321. Apr 22 00:41:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  322. Apr 22 00:41:37 hp-epyc kernel: </TASK>
  323. Apr 22 00:44:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  324. Apr 22 00:44:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  325. Apr 22 00:44:37 hp-epyc kernel: (detected by 0, t=5460152 jiffies, g=1051549, q=33937355)
  326. Apr 22 00:44:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  327. Apr 22 00:44:37 hp-epyc kernel: Call Trace:
  328. Apr 22 00:44:37 hp-epyc kernel: <TASK>
  329. Apr 22 00:44:37 hp-epyc kernel: __schedule+0x238/0x5e0
  330. Apr 22 00:44:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  331. Apr 22 00:44:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  332. Apr 22 00:44:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  333. Apr 22 00:44:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  334. Apr 22 00:44:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  335. Apr 22 00:44:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  336. Apr 22 00:44:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  337. Apr 22 00:44:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  338. Apr 22 00:44:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  339. Apr 22 00:44:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  340. Apr 22 00:44:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  341. Apr 22 00:44:37 hp-epyc kernel: kthread+0x191/0x1b0
  342. Apr 22 00:44:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  343. Apr 22 00:44:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  344. Apr 22 00:44:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  345. Apr 22 00:44:37 hp-epyc kernel: </TASK>
  346. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  347. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  348. Apr 22 00:56:37 hp-epyc kernel: (detected by 53, t=5640157 jiffies, g=1051549, q=34176171)
  349. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  350. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  351. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  352. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  353. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  354. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  355. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  356. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  357. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  358. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  359. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  360. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  361. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  362. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  363. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  364. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  365. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  366. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  367. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  368. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  369. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  370. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  371. Apr 22 00:56:37 hp-epyc kernel: (detected by 53, t=5820162 jiffies, g=1051549, q=34420493)
  372. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  373. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  374. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  375. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  376. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  377. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  378. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  379. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  380. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  381. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  382. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  383. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  384. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  385. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  386. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  387. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  388. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  389. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  390. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  391. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  392. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  393. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  394. Apr 22 00:56:37 hp-epyc kernel: (detected by 53, t=6000167 jiffies, g=1051549, q=34635233)
  395. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  396. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  397. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  398. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  399. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  400. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  401. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  402. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  403. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  404. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  405. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  406. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  407. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  408. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  409. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  410. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  411. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  412. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  413. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  414. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  415. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  416. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  417. Apr 22 00:56:37 hp-epyc kernel: (detected by 0, t=6180172 jiffies, g=1051549, q=34862643)
  418. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  419. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  420. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  421. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  422. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  423. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  424. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  425. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  426. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  427. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  428. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  429. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  430. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  431. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  432. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  433. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  434. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  435. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  436. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  437. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  438. Apr 22 01:02:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  439. Apr 22 01:02:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  440. Apr 22 01:02:37 hp-epyc kernel: (detected by 53, t=6360177 jiffies, g=1051549, q=35066406)
  441. Apr 22 01:02:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  442. Apr 22 01:02:37 hp-epyc kernel: Call Trace:
  443. Apr 22 01:02:37 hp-epyc kernel: <TASK>
  444. Apr 22 01:02:37 hp-epyc kernel: __schedule+0x238/0x5e0
  445. Apr 22 01:02:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  446. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  447. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  448. Apr 22 01:02:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  449. Apr 22 01:02:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  450. Apr 22 01:02:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  451. Apr 22 01:02:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  452. Apr 22 01:02:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  453. Apr 22 01:02:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  454. Apr 22 01:02:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  455. Apr 22 01:02:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  456. Apr 22 01:02:37 hp-epyc kernel: kthread+0x191/0x1b0
  457. Apr 22 01:02:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  458. Apr 22 01:02:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  459. Apr 22 01:02:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  460. Apr 22 01:02:37 hp-epyc kernel: </TASK>
  461. Apr 22 01:02:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  462. Apr 22 01:02:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  463. Apr 22 01:02:37 hp-epyc kernel: (detected by 0, t=6540182 jiffies, g=1051549, q=35287503)
  464. Apr 22 01:02:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  465. Apr 22 01:02:37 hp-epyc kernel: Call Trace:
  466. Apr 22 01:02:37 hp-epyc kernel: <TASK>
  467. Apr 22 01:02:37 hp-epyc kernel: __schedule+0x238/0x5e0
  468. Apr 22 01:02:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  469. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  470. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  471. Apr 22 01:02:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  472. Apr 22 01:02:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  473. Apr 22 01:02:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  474. Apr 22 01:02:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  475. Apr 22 01:02:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  476. Apr 22 01:02:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  477. Apr 22 01:02:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  478. Apr 22 01:02:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  479. Apr 22 01:02:37 hp-epyc kernel: kthread+0x191/0x1b0
  480. Apr 22 01:02:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  481. Apr 22 01:02:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  482. Apr 22 01:02:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  483. Apr 22 01:02:37 hp-epyc kernel: </TASK>
  484. Apr 22 01:05:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  485. Apr 22 01:05:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  486. Apr 22 01:05:37 hp-epyc kernel: (detected by 0, t=6720187 jiffies, g=1051549, q=35506516)
  487. Apr 22 01:05:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  488. Apr 22 01:05:37 hp-epyc kernel: Call Trace:
  489. Apr 22 01:05:37 hp-epyc kernel: <TASK>
  490. Apr 22 01:05:37 hp-epyc kernel: __schedule+0x238/0x5e0
  491. Apr 22 01:05:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  492. Apr 22 01:05:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  493. Apr 22 01:05:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  494. Apr 22 01:05:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  495. Apr 22 01:05:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  496. Apr 22 01:05:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  497. Apr 22 01:05:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  498. Apr 22 01:05:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  499. Apr 22 01:05:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  500. Apr 22 01:05:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  501. Apr 22 01:05:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  502. Apr 22 01:05:37 hp-epyc kernel: kthread+0x191/0x1b0
  503. Apr 22 01:05:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  504. Apr 22 01:05:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  505. Apr 22 01:05:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  506. Apr 22 01:05:37 hp-epyc kernel: </TASK>
  507. Apr 22 01:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  508. Apr 22 01:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  509. Apr 22 01:14:37 hp-epyc kernel: (detected by 53, t=6900192 jiffies, g=1051549, q=35708638)
  510. Apr 22 01:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  511. Apr 22 01:14:37 hp-epyc kernel: Call Trace:
  512. Apr 22 01:14:37 hp-epyc kernel: <TASK>
  513. Apr 22 01:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  514. Apr 22 01:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  515. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  516. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  517. Apr 22 01:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  518. Apr 22 01:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  519. Apr 22 01:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  520. Apr 22 01:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  521. Apr 22 01:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  522. Apr 22 01:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  523. Apr 22 01:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  524. Apr 22 01:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  525. Apr 22 01:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  526. Apr 22 01:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  527. Apr 22 01:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  528. Apr 22 01:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  529. Apr 22 01:14:37 hp-epyc kernel: </TASK>
  530. Apr 22 01:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  531. Apr 22 01:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  532. Apr 22 01:14:37 hp-epyc kernel: (detected by 53, t=7080197 jiffies, g=1051549, q=35909647)
  533. Apr 22 01:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  534. Apr 22 01:14:37 hp-epyc kernel: Call Trace:
  535. Apr 22 01:14:37 hp-epyc kernel: <TASK>
  536. Apr 22 01:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  537. Apr 22 01:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  538. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  539. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  540. Apr 22 01:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  541. Apr 22 01:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  542. Apr 22 01:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  543. Apr 22 01:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  544. Apr 22 01:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  545. Apr 22 01:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  546. Apr 22 01:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  547. Apr 22 01:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  548. Apr 22 01:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  549. Apr 22 01:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  550. Apr 22 01:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  551. Apr 22 01:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  552. Apr 22 01:14:37 hp-epyc kernel: </TASK>
  553. Apr 22 01:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  554. Apr 22 01:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  555. Apr 22 01:14:37 hp-epyc kernel: (detected by 0, t=7260202 jiffies, g=1051549, q=36145235)
  556. Apr 22 01:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  557. Apr 22 01:14:37 hp-epyc kernel: Call Trace:
  558. Apr 22 01:14:37 hp-epyc kernel: <TASK>
  559. Apr 22 01:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  560. Apr 22 01:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  561. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  562. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  563. Apr 22 01:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  564. Apr 22 01:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  565. Apr 22 01:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  566. Apr 22 01:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  567. Apr 22 01:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  568. Apr 22 01:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  569. Apr 22 01:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  570. Apr 22 01:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  571. Apr 22 01:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  572. Apr 22 01:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  573. Apr 22 01:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  574. Apr 22 01:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  575. Apr 22 01:14:37 hp-epyc kernel: </TASK>
  576. Apr 22 01:20:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  577. Apr 22 01:20:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  578. Apr 22 01:20:37 hp-epyc kernel: (detected by 53, t=7440207 jiffies, g=1051549, q=36382957)
  579. Apr 22 01:20:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  580. Apr 22 01:20:37 hp-epyc kernel: Call Trace:
  581. Apr 22 01:20:37 hp-epyc kernel: <TASK>
  582. Apr 22 01:20:37 hp-epyc kernel: __schedule+0x238/0x5e0
  583. Apr 22 01:20:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  584. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  585. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  586. Apr 22 01:20:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  587. Apr 22 01:20:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  588. Apr 22 01:20:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  589. Apr 22 01:20:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  590. Apr 22 01:20:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  591. Apr 22 01:20:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  592. Apr 22 01:20:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  593. Apr 22 01:20:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  594. Apr 22 01:20:37 hp-epyc kernel: kthread+0x191/0x1b0
  595. Apr 22 01:20:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  596. Apr 22 01:20:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  597. Apr 22 01:20:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  598. Apr 22 01:20:37 hp-epyc kernel: </TASK>
  599. Apr 22 01:20:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  600. Apr 22 01:20:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  601. Apr 22 01:20:37 hp-epyc kernel: (detected by 0, t=7620212 jiffies, g=1051549, q=36632327)
  602. Apr 22 01:20:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  603. Apr 22 01:20:37 hp-epyc kernel: Call Trace:
  604. Apr 22 01:20:37 hp-epyc kernel: <TASK>
  605. Apr 22 01:20:37 hp-epyc kernel: __schedule+0x238/0x5e0
  606. Apr 22 01:20:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  607. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  608. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  609. Apr 22 01:20:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  610. Apr 22 01:20:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  611. Apr 22 01:20:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  612. Apr 22 01:20:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  613. Apr 22 01:20:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  614. Apr 22 01:20:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  615. Apr 22 01:20:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  616. Apr 22 01:20:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  617. Apr 22 01:20:37 hp-epyc kernel: kthread+0x191/0x1b0
  618. Apr 22 01:20:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  619. Apr 22 01:20:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  620. Apr 22 01:20:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  621. Apr 22 01:20:37 hp-epyc kernel: </TASK>
  622. Apr 22 01:23:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  623. Apr 22 01:23:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  624. Apr 22 01:23:37 hp-epyc kernel: (detected by 0, t=7800217 jiffies, g=1051549, q=36870836)
  625. Apr 22 01:23:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  626. Apr 22 01:23:37 hp-epyc kernel: Call Trace:
  627. Apr 22 01:23:37 hp-epyc kernel: <TASK>
  628. Apr 22 01:23:37 hp-epyc kernel: __schedule+0x238/0x5e0
  629. Apr 22 01:23:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  630. Apr 22 01:23:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  631. Apr 22 01:23:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  632. Apr 22 01:23:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  633. Apr 22 01:23:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  634. Apr 22 01:23:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  635. Apr 22 01:23:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  636. Apr 22 01:23:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  637. Apr 22 01:23:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  638. Apr 22 01:23:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  639. Apr 22 01:23:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  640. Apr 22 01:23:37 hp-epyc kernel: kthread+0x191/0x1b0
  641. Apr 22 01:23:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  642. Apr 22 01:23:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  643. Apr 22 01:23:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  644. Apr 22 01:23:37 hp-epyc kernel: </TASK>
  645. Apr 22 01:26:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  646. Apr 22 01:26:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  647. Apr 22 01:26:37 hp-epyc kernel: (detected by 0, t=7980222 jiffies, g=1051549, q=37106710)
  648. Apr 22 01:26:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  649. Apr 22 01:26:37 hp-epyc kernel: Call Trace:
  650. Apr 22 01:26:37 hp-epyc kernel: <TASK>
  651. Apr 22 01:26:37 hp-epyc kernel: __schedule+0x238/0x5e0
  652. Apr 22 01:26:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  653. Apr 22 01:26:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  654. Apr 22 01:26:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  655. Apr 22 01:26:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  656. Apr 22 01:26:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  657. Apr 22 01:26:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  658. Apr 22 01:26:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  659. Apr 22 01:26:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  660. Apr 22 01:26:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  661. Apr 22 01:26:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  662. Apr 22 01:26:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  663. Apr 22 01:26:37 hp-epyc kernel: kthread+0x191/0x1b0
  664. Apr 22 01:26:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  665. Apr 22 01:26:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  666. Apr 22 01:26:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  667. Apr 22 01:26:37 hp-epyc kernel: </TASK>
  668. Apr 22 01:29:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  669. Apr 22 01:29:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  670. Apr 22 01:29:37 hp-epyc kernel: (detected by 0, t=8160227 jiffies, g=1051549, q=37332962)
  671. Apr 22 01:29:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  672. Apr 22 01:29:37 hp-epyc kernel: Call Trace:
  673. Apr 22 01:29:37 hp-epyc kernel: <TASK>
  674. Apr 22 01:29:37 hp-epyc kernel: __schedule+0x238/0x5e0
  675. Apr 22 01:29:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  676. Apr 22 01:29:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  677. Apr 22 01:29:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  678. Apr 22 01:29:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  679. Apr 22 01:29:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  680. Apr 22 01:29:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  681. Apr 22 01:29:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  682. Apr 22 01:29:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  683. Apr 22 01:29:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  684. Apr 22 01:29:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  685. Apr 22 01:29:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  686. Apr 22 01:29:37 hp-epyc kernel: kthread+0x191/0x1b0
  687. Apr 22 01:29:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  688. Apr 22 01:29:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  689. Apr 22 01:29:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  690. Apr 22 01:29:37 hp-epyc kernel: </TASK>
  691. Apr 22 01:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  692. Apr 22 01:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  693. Apr 22 01:35:37 hp-epyc kernel: (detected by 53, t=8340232 jiffies, g=1051549, q=37558255)
  694. Apr 22 01:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  695. Apr 22 01:35:37 hp-epyc kernel: Call Trace:
  696. Apr 22 01:35:37 hp-epyc kernel: <TASK>
  697. Apr 22 01:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  698. Apr 22 01:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  699. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  700. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  701. Apr 22 01:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  702. Apr 22 01:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  703. Apr 22 01:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  704. Apr 22 01:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  705. Apr 22 01:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  706. Apr 22 01:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  707. Apr 22 01:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  708. Apr 22 01:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  709. Apr 22 01:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  710. Apr 22 01:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  711. Apr 22 01:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  712. Apr 22 01:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  713. Apr 22 01:35:37 hp-epyc kernel: </TASK>
  714. Apr 22 01:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  715. Apr 22 01:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  716. Apr 22 01:35:37 hp-epyc kernel: (detected by 0, t=8520237 jiffies, g=1051549, q=37784603)
  717. Apr 22 01:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  718. Apr 22 01:35:37 hp-epyc kernel: Call Trace:
  719. Apr 22 01:35:37 hp-epyc kernel: <TASK>
  720. Apr 22 01:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  721. Apr 22 01:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  722. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  723. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  724. Apr 22 01:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  725. Apr 22 01:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  726. Apr 22 01:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  727. Apr 22 01:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  728. Apr 22 01:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  729. Apr 22 01:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  730. Apr 22 01:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  731. Apr 22 01:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  732. Apr 22 01:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  733. Apr 22 01:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  734. Apr 22 01:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  735. Apr 22 01:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  736. Apr 22 01:35:37 hp-epyc kernel: </TASK>
  737. Apr 22 01:38:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  738. Apr 22 01:38:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  739. Apr 22 01:38:37 hp-epyc kernel: (detected by 0, t=8700242 jiffies, g=1051549, q=37987800)
  740. Apr 22 01:38:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  741. Apr 22 01:38:37 hp-epyc kernel: Call Trace:
  742. Apr 22 01:38:37 hp-epyc kernel: <TASK>
  743. Apr 22 01:38:37 hp-epyc kernel: __schedule+0x238/0x5e0
  744. Apr 22 01:38:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  745. Apr 22 01:38:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  746. Apr 22 01:38:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  747. Apr 22 01:38:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  748. Apr 22 01:38:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  749. Apr 22 01:38:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  750. Apr 22 01:38:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  751. Apr 22 01:38:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  752. Apr 22 01:38:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  753. Apr 22 01:38:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  754. Apr 22 01:38:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  755. Apr 22 01:38:37 hp-epyc kernel: kthread+0x191/0x1b0
  756. Apr 22 01:38:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  757. Apr 22 01:38:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  758. Apr 22 01:38:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  759. Apr 22 01:38:37 hp-epyc kernel: </TASK>
  760. Apr 22 01:41:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  761. Apr 22 01:41:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  762. Apr 22 01:41:37 hp-epyc kernel: (detected by 0, t=8880247 jiffies, g=1051549, q=38194572)
  763. Apr 22 01:41:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  764. Apr 22 01:41:37 hp-epyc kernel: Call Trace:
  765. Apr 22 01:41:37 hp-epyc kernel: <TASK>
  766. Apr 22 01:41:37 hp-epyc kernel: __schedule+0x238/0x5e0
  767. Apr 22 01:41:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  768. Apr 22 01:41:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  769. Apr 22 01:41:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  770. Apr 22 01:41:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  771. Apr 22 01:41:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  772. Apr 22 01:41:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  773. Apr 22 01:41:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  774. Apr 22 01:41:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  775. Apr 22 01:41:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  776. Apr 22 01:41:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  777. Apr 22 01:41:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  778. Apr 22 01:41:37 hp-epyc kernel: kthread+0x191/0x1b0
  779. Apr 22 01:41:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  780. Apr 22 01:41:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  781. Apr 22 01:41:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  782. Apr 22 01:41:37 hp-epyc kernel: </TASK>
  783. Apr 22 01:47:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  784. Apr 22 01:47:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  785. Apr 22 01:47:37 hp-epyc kernel: (detected by 53, t=9060252 jiffies, g=1051549, q=38389833)
  786. Apr 22 01:47:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  787. Apr 22 01:47:37 hp-epyc kernel: Call Trace:
  788. Apr 22 01:47:37 hp-epyc kernel: <TASK>
  789. Apr 22 01:47:37 hp-epyc kernel: __schedule+0x238/0x5e0
  790. Apr 22 01:47:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  791. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  792. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  793. Apr 22 01:47:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  794. Apr 22 01:47:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  795. Apr 22 01:47:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  796. Apr 22 01:47:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  797. Apr 22 01:47:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  798. Apr 22 01:47:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  799. Apr 22 01:47:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  800. Apr 22 01:47:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  801. Apr 22 01:47:37 hp-epyc kernel: kthread+0x191/0x1b0
  802. Apr 22 01:47:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  803. Apr 22 01:47:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  804. Apr 22 01:47:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  805. Apr 22 01:47:37 hp-epyc kernel: </TASK>
  806. Apr 22 01:47:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  807. Apr 22 01:47:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  808. Apr 22 01:47:37 hp-epyc kernel: (detected by 0, t=9240257 jiffies, g=1051549, q=38588168)
  809. Apr 22 01:47:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  810. Apr 22 01:47:37 hp-epyc kernel: Call Trace:
  811. Apr 22 01:47:37 hp-epyc kernel: <TASK>
  812. Apr 22 01:47:37 hp-epyc kernel: __schedule+0x238/0x5e0
  813. Apr 22 01:47:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  814. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  815. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  816. Apr 22 01:47:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  817. Apr 22 01:47:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  818. Apr 22 01:47:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  819. Apr 22 01:47:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  820. Apr 22 01:47:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  821. Apr 22 01:47:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  822. Apr 22 01:47:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  823. Apr 22 01:47:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  824. Apr 22 01:47:37 hp-epyc kernel: kthread+0x191/0x1b0
  825. Apr 22 01:47:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  826. Apr 22 01:47:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  827. Apr 22 01:47:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  828. Apr 22 01:47:37 hp-epyc kernel: </TASK>
  829. Apr 22 01:50:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  830. Apr 22 01:50:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  831. Apr 22 01:50:37 hp-epyc kernel: (detected by 0, t=9420262 jiffies, g=1051549, q=38843604)
  832. Apr 22 01:50:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  833. Apr 22 01:50:37 hp-epyc kernel: Call Trace:
  834. Apr 22 01:50:37 hp-epyc kernel: <TASK>
  835. Apr 22 01:50:37 hp-epyc kernel: __schedule+0x238/0x5e0
  836. Apr 22 01:50:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  837. Apr 22 01:50:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  838. Apr 22 01:50:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  839. Apr 22 01:50:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  840. Apr 22 01:50:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  841. Apr 22 01:50:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  842. Apr 22 01:50:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  843. Apr 22 01:50:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  844. Apr 22 01:50:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  845. Apr 22 01:50:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  846. Apr 22 01:50:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  847. Apr 22 01:50:37 hp-epyc kernel: kthread+0x191/0x1b0
  848. Apr 22 01:50:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  849. Apr 22 01:50:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  850. Apr 22 01:50:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  851. Apr 22 01:50:37 hp-epyc kernel: </TASK>
  852. Apr 22 01:53:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  853. Apr 22 01:53:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  854. Apr 22 01:53:37 hp-epyc kernel: (detected by 0, t=9600267 jiffies, g=1051549, q=39096901)
  855. Apr 22 01:53:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  856. Apr 22 01:53:37 hp-epyc kernel: Call Trace:
  857. Apr 22 01:53:37 hp-epyc kernel: <TASK>
  858. Apr 22 01:53:37 hp-epyc kernel: __schedule+0x238/0x5e0
  859. Apr 22 01:53:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  860. Apr 22 01:53:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  861. Apr 22 01:53:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  862. Apr 22 01:53:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  863. Apr 22 01:53:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  864. Apr 22 01:53:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  865. Apr 22 01:53:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  866. Apr 22 01:53:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  867. Apr 22 01:53:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  868. Apr 22 01:53:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  869. Apr 22 01:53:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  870. Apr 22 01:53:37 hp-epyc kernel: kthread+0x191/0x1b0
  871. Apr 22 01:53:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  872. Apr 22 01:53:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  873. Apr 22 01:53:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  874. Apr 22 01:53:37 hp-epyc kernel: </TASK>
  875. Apr 22 01:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  876. Apr 22 01:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  877. Apr 22 01:56:37 hp-epyc kernel: (detected by 0, t=9780272 jiffies, g=1051549, q=39336394)
  878. Apr 22 01:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  879. Apr 22 01:56:37 hp-epyc kernel: Call Trace:
  880. Apr 22 01:56:37 hp-epyc kernel: <TASK>
  881. Apr 22 01:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  882. Apr 22 01:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  883. Apr 22 01:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  884. Apr 22 01:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  885. Apr 22 01:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  886. Apr 22 01:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  887. Apr 22 01:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  888. Apr 22 01:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  889. Apr 22 01:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  890. Apr 22 01:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  891. Apr 22 01:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  892. Apr 22 01:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  893. Apr 22 01:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  894. Apr 22 01:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  895. Apr 22 01:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  896. Apr 22 01:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  897. Apr 22 01:56:37 hp-epyc kernel: </TASK>
  898. Apr 22 01:59:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  899. Apr 22 01:59:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  900. Apr 22 01:59:37 hp-epyc kernel: (detected by 0, t=9960277 jiffies, g=1051549, q=39569336)
  901. Apr 22 01:59:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  902. Apr 22 01:59:37 hp-epyc kernel: Call Trace:
  903. Apr 22 01:59:37 hp-epyc kernel: <TASK>
  904. Apr 22 01:59:37 hp-epyc kernel: __schedule+0x238/0x5e0
  905. Apr 22 01:59:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  906. Apr 22 01:59:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  907. Apr 22 01:59:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  908. Apr 22 01:59:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  909. Apr 22 01:59:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  910. Apr 22 01:59:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  911. Apr 22 01:59:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  912. Apr 22 01:59:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  913. Apr 22 01:59:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  914. Apr 22 01:59:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  915. Apr 22 01:59:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  916. Apr 22 01:59:37 hp-epyc kernel: kthread+0x191/0x1b0
  917. Apr 22 01:59:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  918. Apr 22 01:59:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  919. Apr 22 01:59:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  920. Apr 22 01:59:37 hp-epyc kernel: </TASK>
  921. Apr 22 02:02:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  922. Apr 22 02:02:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  923. Apr 22 02:02:37 hp-epyc kernel: (detected by 0, t=10140282 jiffies, g=1051549, q=39786158)
  924. Apr 22 02:02:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  925. Apr 22 02:02:37 hp-epyc kernel: Call Trace:
  926. Apr 22 02:02:37 hp-epyc kernel: <TASK>
  927. Apr 22 02:02:37 hp-epyc kernel: __schedule+0x238/0x5e0
  928. Apr 22 02:02:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  929. Apr 22 02:02:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  930. Apr 22 02:02:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  931. Apr 22 02:02:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  932. Apr 22 02:02:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  933. Apr 22 02:02:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  934. Apr 22 02:02:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  935. Apr 22 02:02:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  936. Apr 22 02:02:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  937. Apr 22 02:02:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  938. Apr 22 02:02:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  939. Apr 22 02:02:37 hp-epyc kernel: kthread+0x191/0x1b0
  940. Apr 22 02:02:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  941. Apr 22 02:02:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  942. Apr 22 02:02:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  943. Apr 22 02:02:37 hp-epyc kernel: </TASK>
  944. Apr 22 02:05:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  945. Apr 22 02:05:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  946. Apr 22 02:05:37 hp-epyc kernel: (detected by 0, t=10320287 jiffies, g=1051549, q=40020632)
  947. Apr 22 02:05:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  948. Apr 22 02:05:37 hp-epyc kernel: Call Trace:
  949. Apr 22 02:05:37 hp-epyc kernel: <TASK>
  950. Apr 22 02:05:37 hp-epyc kernel: __schedule+0x238/0x5e0
  951. Apr 22 02:05:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  952. Apr 22 02:05:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  953. Apr 22 02:05:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  954. Apr 22 02:05:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  955. Apr 22 02:05:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  956. Apr 22 02:05:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  957. Apr 22 02:05:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  958. Apr 22 02:05:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  959. Apr 22 02:05:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  960. Apr 22 02:05:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  961. Apr 22 02:05:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  962. Apr 22 02:05:37 hp-epyc kernel: kthread+0x191/0x1b0
  963. Apr 22 02:05:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  964. Apr 22 02:05:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  965. Apr 22 02:05:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  966. Apr 22 02:05:37 hp-epyc kernel: </TASK>
  967. Apr 22 02:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  968. Apr 22 02:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  969. Apr 22 02:08:37 hp-epyc kernel: (detected by 0, t=10500292 jiffies, g=1051549, q=40225083)
  970. Apr 22 02:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  971. Apr 22 02:08:37 hp-epyc kernel: Call Trace:
  972. Apr 22 02:08:37 hp-epyc kernel: <TASK>
  973. Apr 22 02:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  974. Apr 22 02:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  975. Apr 22 02:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  976. Apr 22 02:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  977. Apr 22 02:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  978. Apr 22 02:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  979. Apr 22 02:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  980. Apr 22 02:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  981. Apr 22 02:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  982. Apr 22 02:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  983. Apr 22 02:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  984. Apr 22 02:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  985. Apr 22 02:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  986. Apr 22 02:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  987. Apr 22 02:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  988. Apr 22 02:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  989. Apr 22 02:08:37 hp-epyc kernel: </TASK>
  990. Apr 22 02:11:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  991. Apr 22 02:11:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  992. Apr 22 02:11:37 hp-epyc kernel: (detected by 0, t=10680297 jiffies, g=1051549, q=40453831)
  993. Apr 22 02:11:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  994. Apr 22 02:11:37 hp-epyc kernel: Call Trace:
  995. Apr 22 02:11:37 hp-epyc kernel: <TASK>
  996. Apr 22 02:11:37 hp-epyc kernel: __schedule+0x238/0x5e0
  997. Apr 22 02:11:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  998. Apr 22 02:11:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  999. Apr 22 02:11:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1000. Apr 22 02:11:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1001. Apr 22 02:11:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1002. Apr 22 02:11:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1003. Apr 22 02:11:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1004. Apr 22 02:11:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1005. Apr 22 02:11:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1006. Apr 22 02:11:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1007. Apr 22 02:11:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1008. Apr 22 02:11:37 hp-epyc kernel: kthread+0x191/0x1b0
  1009. Apr 22 02:11:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1010. Apr 22 02:11:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1011. Apr 22 02:11:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  1012. Apr 22 02:11:37 hp-epyc kernel: </TASK>
  1013. Apr 22 02:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1014. Apr 22 02:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1015. Apr 22 02:14:37 hp-epyc kernel: (detected by 0, t=10860302 jiffies, g=1051549, q=40652533)
  1016. Apr 22 02:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1017. Apr 22 02:14:37 hp-epyc kernel: Call Trace:
  1018. Apr 22 02:14:37 hp-epyc kernel: <TASK>
  1019. Apr 22 02:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  1020. Apr 22 02:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1021. Apr 22 02:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  1022. Apr 22 02:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1023. Apr 22 02:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1024. Apr 22 02:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1025. Apr 22 02:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1026. Apr 22 02:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1027. Apr 22 02:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1028. Apr 22 02:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1029. Apr 22 02:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1030. Apr 22 02:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1031. Apr 22 02:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  1032. Apr 22 02:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1033. Apr 22 02:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1034. Apr 22 02:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  1035. Apr 22 02:14:37 hp-epyc kernel: </TASK>
  1036. Apr 22 02:17:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1037. Apr 22 02:17:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1038. Apr 22 02:17:37 hp-epyc kernel: (detected by 0, t=11040307 jiffies, g=1051549, q=40863289)
  1039. Apr 22 02:17:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1040. Apr 22 02:17:37 hp-epyc kernel: Call Trace:
  1041. Apr 22 02:17:37 hp-epyc kernel: <TASK>
  1042. Apr 22 02:17:37 hp-epyc kernel: __schedule+0x238/0x5e0
  1043. Apr 22 02:17:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1044. Apr 22 02:17:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  1045. Apr 22 02:17:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1046. Apr 22 02:17:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1047. Apr 22 02:17:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1048. Apr 22 02:17:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1049. Apr 22 02:17:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1050. Apr 22 02:17:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1051. Apr 22 02:17:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1052. Apr 22 02:17:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1053. Apr 22 02:17:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1054. Apr 22 02:17:37 hp-epyc kernel: kthread+0x191/0x1b0
  1055. Apr 22 02:17:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1056. Apr 22 02:17:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1057. Apr 22 02:17:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  1058. Apr 22 02:17:37 hp-epyc kernel: </TASK>
  1059. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1060. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1061. Apr 22 02:29:38 hp-epyc kernel: (detected by 53, t=11220312 jiffies, g=1051549, q=41089101)
  1062. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1063. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1064. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1065. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1066. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1067. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1068. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1069. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1070. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1071. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1072. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1073. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1074. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1075. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1076. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1077. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1078. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1079. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1080. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1081. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1082. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1083. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1084. Apr 22 02:29:38 hp-epyc kernel: (detected by 53, t=11400317 jiffies, g=1051549, q=41341577)
  1085. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1086. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1087. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1088. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1089. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1090. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1091. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1092. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1093. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1094. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1095. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1096. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1097. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1098. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1099. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1100. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1101. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1102. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1103. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1104. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1105. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1106. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1107. Apr 22 02:29:38 hp-epyc kernel: (detected by 53, t=11580322 jiffies, g=1051549, q=41593746)
  1108. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1109. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1110. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1111. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1112. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1113. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1114. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1115. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1116. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1117. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1118. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1119. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1120. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1121. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1122. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1123. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1124. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1125. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1126. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1127. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1128. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1129. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1130. Apr 22 02:29:38 hp-epyc kernel: (detected by 0, t=11760327 jiffies, g=1051549, q=41843999)
  1131. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1132. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1133. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1134. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1135. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1136. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1137. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1138. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1139. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1140. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1141. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1142. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1143. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1144. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1145. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1146. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1147. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1148. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1149. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1150. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1151. Apr 22 02:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1152. Apr 22 02:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1153. Apr 22 02:38:38 hp-epyc kernel: (detected by 53, t=11940332 jiffies, g=1051549, q=42070451)
  1154. Apr 22 02:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1155. Apr 22 02:38:38 hp-epyc kernel: Call Trace:
  1156. Apr 22 02:38:38 hp-epyc kernel: <TASK>
  1157. Apr 22 02:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1158. Apr 22 02:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1159. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1160. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1161. Apr 22 02:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1162. Apr 22 02:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1163. Apr 22 02:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1164. Apr 22 02:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1165. Apr 22 02:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1166. Apr 22 02:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1167. Apr 22 02:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1168. Apr 22 02:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1169. Apr 22 02:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1170. Apr 22 02:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1171. Apr 22 02:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1172. Apr 22 02:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1173. Apr 22 02:38:38 hp-epyc kernel: </TASK>
  1174. Apr 22 02:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1175. Apr 22 02:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1176. Apr 22 02:38:38 hp-epyc kernel: (detected by 53, t=12120337 jiffies, g=1051549, q=42294718)
  1177. Apr 22 02:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1178. Apr 22 02:38:38 hp-epyc kernel: Call Trace:
  1179. Apr 22 02:38:38 hp-epyc kernel: <TASK>
  1180. Apr 22 02:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1181. Apr 22 02:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1182. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1183. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1184. Apr 22 02:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1185. Apr 22 02:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1186. Apr 22 02:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1187. Apr 22 02:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1188. Apr 22 02:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1189. Apr 22 02:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1190. Apr 22 02:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1191. Apr 22 02:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1192. Apr 22 02:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1193. Apr 22 02:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1194. Apr 22 02:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1195. Apr 22 02:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1196. Apr 22 02:38:38 hp-epyc kernel: </TASK>
  1197. Apr 22 02:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1198. Apr 22 02:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1199. Apr 22 02:38:38 hp-epyc kernel: (detected by 0, t=12300342 jiffies, g=1051549, q=42513832)
  1200. Apr 22 02:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1201. Apr 22 02:38:38 hp-epyc kernel: Call Trace:
  1202. Apr 22 02:38:38 hp-epyc kernel: <TASK>
  1203. Apr 22 02:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1204. Apr 22 02:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1205. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1206. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1207. Apr 22 02:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1208. Apr 22 02:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1209. Apr 22 02:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1210. Apr 22 02:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1211. Apr 22 02:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1212. Apr 22 02:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1213. Apr 22 02:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1214. Apr 22 02:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1215. Apr 22 02:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1216. Apr 22 02:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1217. Apr 22 02:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1218. Apr 22 02:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1219. Apr 22 02:38:38 hp-epyc kernel: </TASK>
  1220. Apr 22 02:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1221. Apr 22 02:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1222. Apr 22 02:47:38 hp-epyc kernel: (detected by 53, t=12480347 jiffies, g=1051549, q=42679121)
  1223. Apr 22 02:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1224. Apr 22 02:47:38 hp-epyc kernel: Call Trace:
  1225. Apr 22 02:47:38 hp-epyc kernel: <TASK>
  1226. Apr 22 02:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1227. Apr 22 02:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1228. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1229. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1230. Apr 22 02:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1231. Apr 22 02:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1232. Apr 22 02:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1233. Apr 22 02:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1234. Apr 22 02:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1235. Apr 22 02:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1236. Apr 22 02:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1237. Apr 22 02:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1238. Apr 22 02:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  1239. Apr 22 02:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1240. Apr 22 02:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1241. Apr 22 02:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1242. Apr 22 02:47:38 hp-epyc kernel: </TASK>
  1243. Apr 22 02:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1244. Apr 22 02:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1245. Apr 22 02:47:38 hp-epyc kernel: (detected by 53, t=12660352 jiffies, g=1051549, q=42830586)
  1246. Apr 22 02:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1247. Apr 22 02:47:38 hp-epyc kernel: Call Trace:
  1248. Apr 22 02:47:38 hp-epyc kernel: <TASK>
  1249. Apr 22 02:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1250. Apr 22 02:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1251. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1252. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1253. Apr 22 02:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1254. Apr 22 02:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1255. Apr 22 02:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1256. Apr 22 02:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1257. Apr 22 02:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1258. Apr 22 02:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1259. Apr 22 02:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1260. Apr 22 02:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1261. Apr 22 02:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  1262. Apr 22 02:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1263. Apr 22 02:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1264. Apr 22 02:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1265. Apr 22 02:47:38 hp-epyc kernel: </TASK>
  1266. Apr 22 02:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1267. Apr 22 02:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1268. Apr 22 02:47:38 hp-epyc kernel: (detected by 0, t=12840357 jiffies, g=1051549, q=42986729)
  1269. Apr 22 02:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1270. Apr 22 02:47:38 hp-epyc kernel: Call Trace:
  1271. Apr 22 02:47:38 hp-epyc kernel: <TASK>
  1272. Apr 22 02:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1273. Apr 22 02:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1274. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1275. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1276. Apr 22 02:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1277. Apr 22 02:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1278. Apr 22 02:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1279. Apr 22 02:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1280. Apr 22 02:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1281. Apr 22 02:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1282. Apr 22 02:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1283. Apr 22 02:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1284. Apr 22 02:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  1285. Apr 22 02:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1286. Apr 22 02:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1287. Apr 22 02:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1288. Apr 22 02:47:38 hp-epyc kernel: </TASK>
  1289. Apr 22 02:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1290. Apr 22 02:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1291. Apr 22 02:53:38 hp-epyc kernel: (detected by 53, t=13020362 jiffies, g=1051549, q=43137643)
  1292. Apr 22 02:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1293. Apr 22 02:53:38 hp-epyc kernel: Call Trace:
  1294. Apr 22 02:53:38 hp-epyc kernel: <TASK>
  1295. Apr 22 02:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1296. Apr 22 02:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1297. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1298. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1299. Apr 22 02:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1300. Apr 22 02:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1301. Apr 22 02:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1302. Apr 22 02:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1303. Apr 22 02:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1304. Apr 22 02:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1305. Apr 22 02:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1306. Apr 22 02:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1307. Apr 22 02:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  1308. Apr 22 02:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1309. Apr 22 02:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1310. Apr 22 02:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1311. Apr 22 02:53:38 hp-epyc kernel: </TASK>
  1312. Apr 22 02:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1313. Apr 22 02:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1314. Apr 22 02:53:38 hp-epyc kernel: (detected by 0, t=13200367 jiffies, g=1051549, q=43283977)
  1315. Apr 22 02:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1316. Apr 22 02:53:38 hp-epyc kernel: Call Trace:
  1317. Apr 22 02:53:38 hp-epyc kernel: <TASK>
  1318. Apr 22 02:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1319. Apr 22 02:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1320. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1321. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1322. Apr 22 02:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1323. Apr 22 02:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1324. Apr 22 02:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1325. Apr 22 02:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1326. Apr 22 02:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1327. Apr 22 02:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1328. Apr 22 02:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1329. Apr 22 02:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1330. Apr 22 02:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  1331. Apr 22 02:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1332. Apr 22 02:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1333. Apr 22 02:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1334. Apr 22 02:53:38 hp-epyc kernel: </TASK>
  1335. Apr 22 02:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1336. Apr 22 02:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1337. Apr 22 02:56:38 hp-epyc kernel: (detected by 0, t=13380372 jiffies, g=1051549, q=43441996)
  1338. Apr 22 02:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1339. Apr 22 02:56:38 hp-epyc kernel: Call Trace:
  1340. Apr 22 02:56:38 hp-epyc kernel: <TASK>
  1341. Apr 22 02:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1342. Apr 22 02:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1343. Apr 22 02:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1344. Apr 22 02:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1345. Apr 22 02:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1346. Apr 22 02:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1347. Apr 22 02:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1348. Apr 22 02:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1349. Apr 22 02:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1350. Apr 22 02:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1351. Apr 22 02:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1352. Apr 22 02:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1353. Apr 22 02:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  1354. Apr 22 02:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1355. Apr 22 02:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1356. Apr 22 02:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1357. Apr 22 02:56:38 hp-epyc kernel: </TASK>
  1358. Apr 22 03:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1359. Apr 22 03:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1360. Apr 22 03:02:38 hp-epyc kernel: (detected by 53, t=13560377 jiffies, g=1051549, q=43557827)
  1361. Apr 22 03:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1362. Apr 22 03:02:38 hp-epyc kernel: Call Trace:
  1363. Apr 22 03:02:38 hp-epyc kernel: <TASK>
  1364. Apr 22 03:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1365. Apr 22 03:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1366. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1367. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1368. Apr 22 03:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1369. Apr 22 03:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1370. Apr 22 03:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1371. Apr 22 03:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1372. Apr 22 03:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1373. Apr 22 03:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1374. Apr 22 03:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1375. Apr 22 03:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1376. Apr 22 03:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  1377. Apr 22 03:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1378. Apr 22 03:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1379. Apr 22 03:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1380. Apr 22 03:02:38 hp-epyc kernel: </TASK>
  1381. Apr 22 03:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1382. Apr 22 03:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1383. Apr 22 03:02:38 hp-epyc kernel: (detected by 0, t=13740382 jiffies, g=1051549, q=43625244)
  1384. Apr 22 03:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1385. Apr 22 03:02:38 hp-epyc kernel: Call Trace:
  1386. Apr 22 03:02:38 hp-epyc kernel: <TASK>
  1387. Apr 22 03:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1388. Apr 22 03:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1389. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1390. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1391. Apr 22 03:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1392. Apr 22 03:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1393. Apr 22 03:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1394. Apr 22 03:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1395. Apr 22 03:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1396. Apr 22 03:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1397. Apr 22 03:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1398. Apr 22 03:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1399. Apr 22 03:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  1400. Apr 22 03:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1401. Apr 22 03:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1402. Apr 22 03:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1403. Apr 22 03:02:38 hp-epyc kernel: </TASK>
  1404. Apr 22 03:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1405. Apr 22 03:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1406. Apr 22 03:05:38 hp-epyc kernel: (detected by 0, t=13920387 jiffies, g=1051549, q=43695184)
  1407. Apr 22 03:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1408. Apr 22 03:05:38 hp-epyc kernel: Call Trace:
  1409. Apr 22 03:05:38 hp-epyc kernel: <TASK>
  1410. Apr 22 03:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1411. Apr 22 03:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1412. Apr 22 03:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1413. Apr 22 03:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1414. Apr 22 03:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1415. Apr 22 03:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1416. Apr 22 03:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1417. Apr 22 03:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1418. Apr 22 03:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1419. Apr 22 03:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1420. Apr 22 03:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1421. Apr 22 03:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1422. Apr 22 03:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  1423. Apr 22 03:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1424. Apr 22 03:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1425. Apr 22 03:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1426. Apr 22 03:05:38 hp-epyc kernel: </TASK>
  1427. Apr 22 03:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1428. Apr 22 03:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1429. Apr 22 03:08:38 hp-epyc kernel: (detected by 0, t=14100392 jiffies, g=1051549, q=43768144)
  1430. Apr 22 03:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1431. Apr 22 03:08:38 hp-epyc kernel: Call Trace:
  1432. Apr 22 03:08:38 hp-epyc kernel: <TASK>
  1433. Apr 22 03:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1434. Apr 22 03:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1435. Apr 22 03:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1436. Apr 22 03:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1437. Apr 22 03:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1438. Apr 22 03:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1439. Apr 22 03:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1440. Apr 22 03:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1441. Apr 22 03:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1442. Apr 22 03:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1443. Apr 22 03:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1444. Apr 22 03:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1445. Apr 22 03:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  1446. Apr 22 03:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1447. Apr 22 03:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1448. Apr 22 03:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1449. Apr 22 03:08:38 hp-epyc kernel: </TASK>
  1450. Apr 22 03:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1451. Apr 22 03:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1452. Apr 22 03:11:38 hp-epyc kernel: (detected by 0, t=14280397 jiffies, g=1051549, q=43837142)
  1453. Apr 22 03:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1454. Apr 22 03:11:38 hp-epyc kernel: Call Trace:
  1455. Apr 22 03:11:38 hp-epyc kernel: <TASK>
  1456. Apr 22 03:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1457. Apr 22 03:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1458. Apr 22 03:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1459. Apr 22 03:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1460. Apr 22 03:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1461. Apr 22 03:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1462. Apr 22 03:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1463. Apr 22 03:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1464. Apr 22 03:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1465. Apr 22 03:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1466. Apr 22 03:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1467. Apr 22 03:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1468. Apr 22 03:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  1469. Apr 22 03:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1470. Apr 22 03:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1471. Apr 22 03:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1472. Apr 22 03:11:38 hp-epyc kernel: </TASK>
  1473. Apr 22 03:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1474. Apr 22 03:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1475. Apr 22 03:14:38 hp-epyc kernel: (detected by 0, t=14460402 jiffies, g=1051549, q=43905578)
  1476. Apr 22 03:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1477. Apr 22 03:14:38 hp-epyc kernel: Call Trace:
  1478. Apr 22 03:14:38 hp-epyc kernel: <TASK>
  1479. Apr 22 03:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1480. Apr 22 03:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1481. Apr 22 03:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1482. Apr 22 03:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1483. Apr 22 03:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1484. Apr 22 03:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1485. Apr 22 03:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1486. Apr 22 03:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1487. Apr 22 03:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1488. Apr 22 03:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1489. Apr 22 03:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1490. Apr 22 03:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1491. Apr 22 03:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  1492. Apr 22 03:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1493. Apr 22 03:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1494. Apr 22 03:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1495. Apr 22 03:14:38 hp-epyc kernel: </TASK>
  1496. Apr 22 03:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1497. Apr 22 03:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1498. Apr 22 03:17:38 hp-epyc kernel: (detected by 0, t=14640407 jiffies, g=1051549, q=43975166)
  1499. Apr 22 03:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1500. Apr 22 03:17:38 hp-epyc kernel: Call Trace:
  1501. Apr 22 03:17:38 hp-epyc kernel: <TASK>
  1502. Apr 22 03:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1503. Apr 22 03:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1504. Apr 22 03:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1505. Apr 22 03:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1506. Apr 22 03:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1507. Apr 22 03:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1508. Apr 22 03:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1509. Apr 22 03:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1510. Apr 22 03:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1511. Apr 22 03:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1512. Apr 22 03:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1513. Apr 22 03:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1514. Apr 22 03:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  1515. Apr 22 03:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1516. Apr 22 03:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1517. Apr 22 03:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1518. Apr 22 03:17:38 hp-epyc kernel: </TASK>
  1519. Apr 22 03:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1520. Apr 22 03:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1521. Apr 22 03:20:38 hp-epyc kernel: (detected by 0, t=14820412 jiffies, g=1051549, q=44044548)
  1522. Apr 22 03:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1523. Apr 22 03:20:38 hp-epyc kernel: Call Trace:
  1524. Apr 22 03:20:38 hp-epyc kernel: <TASK>
  1525. Apr 22 03:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1526. Apr 22 03:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1527. Apr 22 03:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1528. Apr 22 03:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1529. Apr 22 03:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1530. Apr 22 03:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1531. Apr 22 03:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1532. Apr 22 03:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1533. Apr 22 03:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1534. Apr 22 03:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1535. Apr 22 03:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1536. Apr 22 03:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1537. Apr 22 03:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  1538. Apr 22 03:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1539. Apr 22 03:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1540. Apr 22 03:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1541. Apr 22 03:20:38 hp-epyc kernel: </TASK>
  1542. Apr 22 03:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1543. Apr 22 03:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1544. Apr 22 03:23:38 hp-epyc kernel: (detected by 0, t=15000417 jiffies, g=1051549, q=44113947)
  1545. Apr 22 03:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1546. Apr 22 03:23:38 hp-epyc kernel: Call Trace:
  1547. Apr 22 03:23:38 hp-epyc kernel: <TASK>
  1548. Apr 22 03:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1549. Apr 22 03:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1550. Apr 22 03:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1551. Apr 22 03:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1552. Apr 22 03:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1553. Apr 22 03:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1554. Apr 22 03:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1555. Apr 22 03:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1556. Apr 22 03:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1557. Apr 22 03:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1558. Apr 22 03:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1559. Apr 22 03:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1560. Apr 22 03:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  1561. Apr 22 03:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1562. Apr 22 03:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1563. Apr 22 03:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1564. Apr 22 03:23:38 hp-epyc kernel: </TASK>
  1565. Apr 22 03:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1566. Apr 22 03:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1567. Apr 22 03:26:38 hp-epyc kernel: (detected by 0, t=15180422 jiffies, g=1051549, q=44181071)
  1568. Apr 22 03:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1569. Apr 22 03:26:38 hp-epyc kernel: Call Trace:
  1570. Apr 22 03:26:38 hp-epyc kernel: <TASK>
  1571. Apr 22 03:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1572. Apr 22 03:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1573. Apr 22 03:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1574. Apr 22 03:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1575. Apr 22 03:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1576. Apr 22 03:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1577. Apr 22 03:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1578. Apr 22 03:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1579. Apr 22 03:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1580. Apr 22 03:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1581. Apr 22 03:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1582. Apr 22 03:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1583. Apr 22 03:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  1584. Apr 22 03:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1585. Apr 22 03:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1586. Apr 22 03:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1587. Apr 22 03:26:38 hp-epyc kernel: </TASK>
  1588. Apr 22 03:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1589. Apr 22 03:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1590. Apr 22 03:29:38 hp-epyc kernel: (detected by 0, t=15360427 jiffies, g=1051549, q=44248689)
  1591. Apr 22 03:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1592. Apr 22 03:29:38 hp-epyc kernel: Call Trace:
  1593. Apr 22 03:29:38 hp-epyc kernel: <TASK>
  1594. Apr 22 03:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1595. Apr 22 03:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1596. Apr 22 03:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1597. Apr 22 03:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1598. Apr 22 03:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1599. Apr 22 03:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1600. Apr 22 03:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1601. Apr 22 03:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1602. Apr 22 03:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1603. Apr 22 03:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1604. Apr 22 03:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1605. Apr 22 03:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1606. Apr 22 03:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1607. Apr 22 03:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1608. Apr 22 03:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1609. Apr 22 03:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1610. Apr 22 03:29:38 hp-epyc kernel: </TASK>
  1611. Apr 22 03:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1612. Apr 22 03:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1613. Apr 22 03:35:38 hp-epyc kernel: (detected by 53, t=15540432 jiffies, g=1051549, q=44320557)
  1614. Apr 22 03:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1615. Apr 22 03:35:38 hp-epyc kernel: Call Trace:
  1616. Apr 22 03:35:38 hp-epyc kernel: <TASK>
  1617. Apr 22 03:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1618. Apr 22 03:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1619. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1620. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1621. Apr 22 03:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1622. Apr 22 03:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1623. Apr 22 03:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1624. Apr 22 03:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1625. Apr 22 03:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1626. Apr 22 03:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1627. Apr 22 03:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1628. Apr 22 03:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1629. Apr 22 03:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  1630. Apr 22 03:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1631. Apr 22 03:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1632. Apr 22 03:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1633. Apr 22 03:35:38 hp-epyc kernel: </TASK>
  1634. Apr 22 03:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1635. Apr 22 03:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1636. Apr 22 03:35:38 hp-epyc kernel: (detected by 0, t=15720437 jiffies, g=1051549, q=44389826)
  1637. Apr 22 03:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1638. Apr 22 03:35:38 hp-epyc kernel: Call Trace:
  1639. Apr 22 03:35:38 hp-epyc kernel: <TASK>
  1640. Apr 22 03:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1641. Apr 22 03:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1642. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1643. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1644. Apr 22 03:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1645. Apr 22 03:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1646. Apr 22 03:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1647. Apr 22 03:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1648. Apr 22 03:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1649. Apr 22 03:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1650. Apr 22 03:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1651. Apr 22 03:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1652. Apr 22 03:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  1653. Apr 22 03:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1654. Apr 22 03:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1655. Apr 22 03:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1656. Apr 22 03:35:38 hp-epyc kernel: </TASK>
  1657. Apr 22 03:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1658. Apr 22 03:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1659. Apr 22 03:38:38 hp-epyc kernel: (detected by 0, t=15900442 jiffies, g=1051549, q=44458606)
  1660. Apr 22 03:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1661. Apr 22 03:38:38 hp-epyc kernel: Call Trace:
  1662. Apr 22 03:38:38 hp-epyc kernel: <TASK>
  1663. Apr 22 03:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1664. Apr 22 03:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1665. Apr 22 03:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1666. Apr 22 03:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1667. Apr 22 03:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1668. Apr 22 03:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1669. Apr 22 03:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1670. Apr 22 03:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1671. Apr 22 03:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1672. Apr 22 03:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1673. Apr 22 03:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1674. Apr 22 03:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1675. Apr 22 03:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1676. Apr 22 03:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1677. Apr 22 03:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1678. Apr 22 03:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1679. Apr 22 03:38:38 hp-epyc kernel: </TASK>
  1680. Apr 22 03:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1681. Apr 22 03:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1682. Apr 22 03:41:38 hp-epyc kernel: (detected by 0, t=16080447 jiffies, g=1051549, q=44529597)
  1683. Apr 22 03:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1684. Apr 22 03:41:38 hp-epyc kernel: Call Trace:
  1685. Apr 22 03:41:38 hp-epyc kernel: <TASK>
  1686. Apr 22 03:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1687. Apr 22 03:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1688. Apr 22 03:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1689. Apr 22 03:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1690. Apr 22 03:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1691. Apr 22 03:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1692. Apr 22 03:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1693. Apr 22 03:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1694. Apr 22 03:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1695. Apr 22 03:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1696. Apr 22 03:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1697. Apr 22 03:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1698. Apr 22 03:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  1699. Apr 22 03:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1700. Apr 22 03:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1701. Apr 22 03:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1702. Apr 22 03:41:38 hp-epyc kernel: </TASK>
  1703. Apr 22 03:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1704. Apr 22 03:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1705. Apr 22 03:44:38 hp-epyc kernel: (detected by 0, t=16260452 jiffies, g=1051549, q=44599555)
  1706. Apr 22 03:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1707. Apr 22 03:44:38 hp-epyc kernel: Call Trace:
  1708. Apr 22 03:44:38 hp-epyc kernel: <TASK>
  1709. Apr 22 03:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1710. Apr 22 03:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1711. Apr 22 03:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1712. Apr 22 03:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1713. Apr 22 03:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1714. Apr 22 03:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1715. Apr 22 03:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1716. Apr 22 03:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1717. Apr 22 03:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1718. Apr 22 03:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1719. Apr 22 03:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1720. Apr 22 03:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1721. Apr 22 03:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  1722. Apr 22 03:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1723. Apr 22 03:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1724. Apr 22 03:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1725. Apr 22 03:44:38 hp-epyc kernel: </TASK>
  1726. Apr 22 03:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1727. Apr 22 03:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1728. Apr 22 03:50:38 hp-epyc kernel: (detected by 53, t=16440457 jiffies, g=1051549, q=44669187)
  1729. Apr 22 03:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1730. Apr 22 03:50:38 hp-epyc kernel: Call Trace:
  1731. Apr 22 03:50:38 hp-epyc kernel: <TASK>
  1732. Apr 22 03:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1733. Apr 22 03:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1734. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1735. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1736. Apr 22 03:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1737. Apr 22 03:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1738. Apr 22 03:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1739. Apr 22 03:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1740. Apr 22 03:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1741. Apr 22 03:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1742. Apr 22 03:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1743. Apr 22 03:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1744. Apr 22 03:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  1745. Apr 22 03:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1746. Apr 22 03:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1747. Apr 22 03:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1748. Apr 22 03:50:38 hp-epyc kernel: </TASK>
  1749. Apr 22 03:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1750. Apr 22 03:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1751. Apr 22 03:50:38 hp-epyc kernel: (detected by 0, t=16620462 jiffies, g=1051549, q=44740497)
  1752. Apr 22 03:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1753. Apr 22 03:50:38 hp-epyc kernel: Call Trace:
  1754. Apr 22 03:50:38 hp-epyc kernel: <TASK>
  1755. Apr 22 03:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1756. Apr 22 03:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1757. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1758. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1759. Apr 22 03:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1760. Apr 22 03:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1761. Apr 22 03:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1762. Apr 22 03:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1763. Apr 22 03:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1764. Apr 22 03:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1765. Apr 22 03:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1766. Apr 22 03:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1767. Apr 22 03:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  1768. Apr 22 03:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1769. Apr 22 03:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1770. Apr 22 03:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1771. Apr 22 03:50:38 hp-epyc kernel: </TASK>
  1772. Apr 22 03:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1773. Apr 22 03:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1774. Apr 22 03:53:38 hp-epyc kernel: (detected by 0, t=16800467 jiffies, g=1051549, q=44808454)
  1775. Apr 22 03:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1776. Apr 22 03:53:38 hp-epyc kernel: Call Trace:
  1777. Apr 22 03:53:38 hp-epyc kernel: <TASK>
  1778. Apr 22 03:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1779. Apr 22 03:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1780. Apr 22 03:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1781. Apr 22 03:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1782. Apr 22 03:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1783. Apr 22 03:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1784. Apr 22 03:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1785. Apr 22 03:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1786. Apr 22 03:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1787. Apr 22 03:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1788. Apr 22 03:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1789. Apr 22 03:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1790. Apr 22 03:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  1791. Apr 22 03:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1792. Apr 22 03:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1793. Apr 22 03:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1794. Apr 22 03:53:38 hp-epyc kernel: </TASK>
  1795. Apr 22 03:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1796. Apr 22 03:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1797. Apr 22 03:56:38 hp-epyc kernel: (detected by 0, t=16980472 jiffies, g=1051549, q=44875941)
  1798. Apr 22 03:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1799. Apr 22 03:56:38 hp-epyc kernel: Call Trace:
  1800. Apr 22 03:56:38 hp-epyc kernel: <TASK>
  1801. Apr 22 03:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1802. Apr 22 03:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1803. Apr 22 03:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1804. Apr 22 03:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1805. Apr 22 03:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1806. Apr 22 03:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1807. Apr 22 03:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1808. Apr 22 03:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1809. Apr 22 03:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1810. Apr 22 03:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1811. Apr 22 03:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1812. Apr 22 03:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1813. Apr 22 03:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  1814. Apr 22 03:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1815. Apr 22 03:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1816. Apr 22 03:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1817. Apr 22 03:56:38 hp-epyc kernel: </TASK>
  1818. Apr 22 03:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1819. Apr 22 03:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1820. Apr 22 03:59:38 hp-epyc kernel: (detected by 0, t=17160477 jiffies, g=1051549, q=44945246)
  1821. Apr 22 03:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1822. Apr 22 03:59:38 hp-epyc kernel: Call Trace:
  1823. Apr 22 03:59:38 hp-epyc kernel: <TASK>
  1824. Apr 22 03:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1825. Apr 22 03:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1826. Apr 22 03:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1827. Apr 22 03:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1828. Apr 22 03:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1829. Apr 22 03:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1830. Apr 22 03:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1831. Apr 22 03:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1832. Apr 22 03:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1833. Apr 22 03:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1834. Apr 22 03:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1835. Apr 22 03:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1836. Apr 22 03:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  1837. Apr 22 03:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1838. Apr 22 03:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1839. Apr 22 03:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1840. Apr 22 03:59:38 hp-epyc kernel: </TASK>
  1841. Apr 22 04:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1842. Apr 22 04:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1843. Apr 22 04:02:38 hp-epyc kernel: (detected by 0, t=17340482 jiffies, g=1051549, q=45010981)
  1844. Apr 22 04:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1845. Apr 22 04:02:38 hp-epyc kernel: Call Trace:
  1846. Apr 22 04:02:38 hp-epyc kernel: <TASK>
  1847. Apr 22 04:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1848. Apr 22 04:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1849. Apr 22 04:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1850. Apr 22 04:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1851. Apr 22 04:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1852. Apr 22 04:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1853. Apr 22 04:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1854. Apr 22 04:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1855. Apr 22 04:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1856. Apr 22 04:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1857. Apr 22 04:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1858. Apr 22 04:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1859. Apr 22 04:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  1860. Apr 22 04:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1861. Apr 22 04:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1862. Apr 22 04:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1863. Apr 22 04:02:38 hp-epyc kernel: </TASK>
  1864. Apr 22 04:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1865. Apr 22 04:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1866. Apr 22 04:05:38 hp-epyc kernel: (detected by 0, t=17520487 jiffies, g=1051549, q=45081057)
  1867. Apr 22 04:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1868. Apr 22 04:05:38 hp-epyc kernel: Call Trace:
  1869. Apr 22 04:05:38 hp-epyc kernel: <TASK>
  1870. Apr 22 04:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1871. Apr 22 04:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1872. Apr 22 04:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1873. Apr 22 04:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1874. Apr 22 04:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1875. Apr 22 04:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1876. Apr 22 04:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1877. Apr 22 04:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1878. Apr 22 04:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1879. Apr 22 04:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1880. Apr 22 04:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1881. Apr 22 04:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1882. Apr 22 04:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  1883. Apr 22 04:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1884. Apr 22 04:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1885. Apr 22 04:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1886. Apr 22 04:05:38 hp-epyc kernel: </TASK>
  1887. Apr 22 04:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1888. Apr 22 04:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1889. Apr 22 04:08:38 hp-epyc kernel: (detected by 0, t=17700492 jiffies, g=1051549, q=45152685)
  1890. Apr 22 04:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1891. Apr 22 04:08:38 hp-epyc kernel: Call Trace:
  1892. Apr 22 04:08:38 hp-epyc kernel: <TASK>
  1893. Apr 22 04:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1894. Apr 22 04:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1895. Apr 22 04:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1896. Apr 22 04:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1897. Apr 22 04:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1898. Apr 22 04:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1899. Apr 22 04:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1900. Apr 22 04:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1901. Apr 22 04:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1902. Apr 22 04:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1903. Apr 22 04:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1904. Apr 22 04:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1905. Apr 22 04:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  1906. Apr 22 04:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1907. Apr 22 04:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1908. Apr 22 04:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1909. Apr 22 04:08:38 hp-epyc kernel: </TASK>
  1910. Apr 22 04:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1911. Apr 22 04:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1912. Apr 22 04:11:38 hp-epyc kernel: (detected by 0, t=17880497 jiffies, g=1051549, q=45222556)
  1913. Apr 22 04:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1914. Apr 22 04:11:38 hp-epyc kernel: Call Trace:
  1915. Apr 22 04:11:38 hp-epyc kernel: <TASK>
  1916. Apr 22 04:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1917. Apr 22 04:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1918. Apr 22 04:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1919. Apr 22 04:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1920. Apr 22 04:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1921. Apr 22 04:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1922. Apr 22 04:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1923. Apr 22 04:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1924. Apr 22 04:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1925. Apr 22 04:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1926. Apr 22 04:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1927. Apr 22 04:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1928. Apr 22 04:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  1929. Apr 22 04:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1930. Apr 22 04:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1931. Apr 22 04:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1932. Apr 22 04:11:38 hp-epyc kernel: </TASK>
  1933. Apr 22 04:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1934. Apr 22 04:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1935. Apr 22 04:14:38 hp-epyc kernel: (detected by 0, t=18060502 jiffies, g=1051549, q=45291648)
  1936. Apr 22 04:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1937. Apr 22 04:14:38 hp-epyc kernel: Call Trace:
  1938. Apr 22 04:14:38 hp-epyc kernel: <TASK>
  1939. Apr 22 04:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1940. Apr 22 04:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1941. Apr 22 04:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1942. Apr 22 04:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1943. Apr 22 04:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1944. Apr 22 04:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1945. Apr 22 04:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1946. Apr 22 04:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1947. Apr 22 04:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1948. Apr 22 04:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1949. Apr 22 04:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1950. Apr 22 04:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1951. Apr 22 04:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  1952. Apr 22 04:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1953. Apr 22 04:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1954. Apr 22 04:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1955. Apr 22 04:14:38 hp-epyc kernel: </TASK>
  1956. Apr 22 04:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1957. Apr 22 04:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1958. Apr 22 04:17:38 hp-epyc kernel: (detected by 0, t=18240507 jiffies, g=1051549, q=45360384)
  1959. Apr 22 04:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1960. Apr 22 04:17:38 hp-epyc kernel: Call Trace:
  1961. Apr 22 04:17:38 hp-epyc kernel: <TASK>
  1962. Apr 22 04:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1963. Apr 22 04:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1964. Apr 22 04:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1965. Apr 22 04:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1966. Apr 22 04:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1967. Apr 22 04:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1968. Apr 22 04:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1969. Apr 22 04:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1970. Apr 22 04:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1971. Apr 22 04:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1972. Apr 22 04:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1973. Apr 22 04:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1974. Apr 22 04:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  1975. Apr 22 04:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1976. Apr 22 04:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1977. Apr 22 04:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1978. Apr 22 04:17:38 hp-epyc kernel: </TASK>
  1979. Apr 22 04:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1980. Apr 22 04:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1981. Apr 22 04:20:38 hp-epyc kernel: (detected by 0, t=18420512 jiffies, g=1051549, q=45429874)
  1982. Apr 22 04:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1983. Apr 22 04:20:38 hp-epyc kernel: Call Trace:
  1984. Apr 22 04:20:38 hp-epyc kernel: <TASK>
  1985. Apr 22 04:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1986. Apr 22 04:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1987. Apr 22 04:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1988. Apr 22 04:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1989. Apr 22 04:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1990. Apr 22 04:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1991. Apr 22 04:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1992. Apr 22 04:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1993. Apr 22 04:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1994. Apr 22 04:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1995. Apr 22 04:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1996. Apr 22 04:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1997. Apr 22 04:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  1998. Apr 22 04:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1999. Apr 22 04:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2000. Apr 22 04:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2001. Apr 22 04:20:38 hp-epyc kernel: </TASK>
  2002. Apr 22 04:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2003. Apr 22 04:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2004. Apr 22 04:23:38 hp-epyc kernel: (detected by 0, t=18600517 jiffies, g=1051549, q=45499635)
  2005. Apr 22 04:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2006. Apr 22 04:23:38 hp-epyc kernel: Call Trace:
  2007. Apr 22 04:23:38 hp-epyc kernel: <TASK>
  2008. Apr 22 04:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2009. Apr 22 04:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2010. Apr 22 04:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2011. Apr 22 04:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2012. Apr 22 04:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2013. Apr 22 04:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2014. Apr 22 04:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2015. Apr 22 04:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2016. Apr 22 04:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2017. Apr 22 04:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2018. Apr 22 04:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2019. Apr 22 04:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2020. Apr 22 04:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  2021. Apr 22 04:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2022. Apr 22 04:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2023. Apr 22 04:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2024. Apr 22 04:23:38 hp-epyc kernel: </TASK>
  2025. Apr 22 04:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2026. Apr 22 04:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2027. Apr 22 04:26:38 hp-epyc kernel: (detected by 0, t=18780522 jiffies, g=1051549, q=45566737)
  2028. Apr 22 04:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2029. Apr 22 04:26:38 hp-epyc kernel: Call Trace:
  2030. Apr 22 04:26:38 hp-epyc kernel: <TASK>
  2031. Apr 22 04:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2032. Apr 22 04:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2033. Apr 22 04:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2034. Apr 22 04:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2035. Apr 22 04:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2036. Apr 22 04:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2037. Apr 22 04:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2038. Apr 22 04:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2039. Apr 22 04:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2040. Apr 22 04:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2041. Apr 22 04:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2042. Apr 22 04:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2043. Apr 22 04:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  2044. Apr 22 04:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2045. Apr 22 04:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2046. Apr 22 04:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2047. Apr 22 04:26:38 hp-epyc kernel: </TASK>
  2048. Apr 22 04:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2049. Apr 22 04:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2050. Apr 22 04:29:38 hp-epyc kernel: (detected by 0, t=18960527 jiffies, g=1051549, q=45636964)
  2051. Apr 22 04:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2052. Apr 22 04:29:38 hp-epyc kernel: Call Trace:
  2053. Apr 22 04:29:38 hp-epyc kernel: <TASK>
  2054. Apr 22 04:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2055. Apr 22 04:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2056. Apr 22 04:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2057. Apr 22 04:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2058. Apr 22 04:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2059. Apr 22 04:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2060. Apr 22 04:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2061. Apr 22 04:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2062. Apr 22 04:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2063. Apr 22 04:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2064. Apr 22 04:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2065. Apr 22 04:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2066. Apr 22 04:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  2067. Apr 22 04:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2068. Apr 22 04:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2069. Apr 22 04:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2070. Apr 22 04:29:38 hp-epyc kernel: </TASK>
  2071. Apr 22 04:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2072. Apr 22 04:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2073. Apr 22 04:32:38 hp-epyc kernel: (detected by 0, t=19140532 jiffies, g=1051549, q=45704064)
  2074. Apr 22 04:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2075. Apr 22 04:32:38 hp-epyc kernel: Call Trace:
  2076. Apr 22 04:32:38 hp-epyc kernel: <TASK>
  2077. Apr 22 04:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2078. Apr 22 04:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2079. Apr 22 04:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2080. Apr 22 04:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2081. Apr 22 04:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2082. Apr 22 04:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2083. Apr 22 04:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2084. Apr 22 04:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2085. Apr 22 04:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2086. Apr 22 04:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2087. Apr 22 04:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2088. Apr 22 04:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2089. Apr 22 04:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2090. Apr 22 04:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2091. Apr 22 04:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2092. Apr 22 04:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2093. Apr 22 04:32:38 hp-epyc kernel: </TASK>
  2094. Apr 22 04:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2095. Apr 22 04:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2096. Apr 22 04:35:38 hp-epyc kernel: (detected by 0, t=19320537 jiffies, g=1051549, q=45778498)
  2097. Apr 22 04:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2098. Apr 22 04:35:38 hp-epyc kernel: Call Trace:
  2099. Apr 22 04:35:38 hp-epyc kernel: <TASK>
  2100. Apr 22 04:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2101. Apr 22 04:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2102. Apr 22 04:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2103. Apr 22 04:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2104. Apr 22 04:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2105. Apr 22 04:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2106. Apr 22 04:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2107. Apr 22 04:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2108. Apr 22 04:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2109. Apr 22 04:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2110. Apr 22 04:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2111. Apr 22 04:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2112. Apr 22 04:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  2113. Apr 22 04:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2114. Apr 22 04:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2115. Apr 22 04:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2116. Apr 22 04:35:38 hp-epyc kernel: </TASK>
  2117. Apr 22 04:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2118. Apr 22 04:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2119. Apr 22 04:38:38 hp-epyc kernel: (detected by 0, t=19500542 jiffies, g=1051549, q=45848126)
  2120. Apr 22 04:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2121. Apr 22 04:38:38 hp-epyc kernel: Call Trace:
  2122. Apr 22 04:38:38 hp-epyc kernel: <TASK>
  2123. Apr 22 04:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2124. Apr 22 04:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2125. Apr 22 04:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2126. Apr 22 04:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2127. Apr 22 04:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2128. Apr 22 04:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2129. Apr 22 04:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2130. Apr 22 04:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2131. Apr 22 04:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2132. Apr 22 04:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2133. Apr 22 04:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2134. Apr 22 04:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2135. Apr 22 04:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  2136. Apr 22 04:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2137. Apr 22 04:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2138. Apr 22 04:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2139. Apr 22 04:38:38 hp-epyc kernel: </TASK>
  2140. Apr 22 04:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2141. Apr 22 04:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2142. Apr 22 04:44:38 hp-epyc kernel: (detected by 53, t=19680547 jiffies, g=1051549, q=45915847)
  2143. Apr 22 04:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2144. Apr 22 04:44:38 hp-epyc kernel: Call Trace:
  2145. Apr 22 04:44:38 hp-epyc kernel: <TASK>
  2146. Apr 22 04:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2147. Apr 22 04:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2148. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2149. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2150. Apr 22 04:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2151. Apr 22 04:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2152. Apr 22 04:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2153. Apr 22 04:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2154. Apr 22 04:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2155. Apr 22 04:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2156. Apr 22 04:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2157. Apr 22 04:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2158. Apr 22 04:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  2159. Apr 22 04:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2160. Apr 22 04:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2161. Apr 22 04:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2162. Apr 22 04:44:38 hp-epyc kernel: </TASK>
  2163. Apr 22 04:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2164. Apr 22 04:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2165. Apr 22 04:44:38 hp-epyc kernel: (detected by 0, t=19860552 jiffies, g=1051549, q=45986400)
  2166. Apr 22 04:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2167. Apr 22 04:44:38 hp-epyc kernel: Call Trace:
  2168. Apr 22 04:44:38 hp-epyc kernel: <TASK>
  2169. Apr 22 04:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2170. Apr 22 04:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2171. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2172. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2173. Apr 22 04:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2174. Apr 22 04:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2175. Apr 22 04:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2176. Apr 22 04:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2177. Apr 22 04:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2178. Apr 22 04:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2179. Apr 22 04:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2180. Apr 22 04:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2181. Apr 22 04:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  2182. Apr 22 04:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2183. Apr 22 04:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2184. Apr 22 04:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2185. Apr 22 04:44:38 hp-epyc kernel: </TASK>
  2186. Apr 22 04:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2187. Apr 22 04:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2188. Apr 22 04:47:38 hp-epyc kernel: (detected by 0, t=20040557 jiffies, g=1051549, q=46056444)
  2189. Apr 22 04:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2190. Apr 22 04:47:38 hp-epyc kernel: Call Trace:
  2191. Apr 22 04:47:38 hp-epyc kernel: <TASK>
  2192. Apr 22 04:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2193. Apr 22 04:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2194. Apr 22 04:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2195. Apr 22 04:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2196. Apr 22 04:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2197. Apr 22 04:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2198. Apr 22 04:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2199. Apr 22 04:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2200. Apr 22 04:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2201. Apr 22 04:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2202. Apr 22 04:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2203. Apr 22 04:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2204. Apr 22 04:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  2205. Apr 22 04:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2206. Apr 22 04:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2207. Apr 22 04:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2208. Apr 22 04:47:38 hp-epyc kernel: </TASK>
  2209. Apr 22 04:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2210. Apr 22 04:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2211. Apr 22 04:50:38 hp-epyc kernel: (detected by 0, t=20220562 jiffies, g=1051549, q=46129040)
  2212. Apr 22 04:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2213. Apr 22 04:50:38 hp-epyc kernel: Call Trace:
  2214. Apr 22 04:50:38 hp-epyc kernel: <TASK>
  2215. Apr 22 04:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2216. Apr 22 04:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2217. Apr 22 04:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2218. Apr 22 04:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2219. Apr 22 04:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2220. Apr 22 04:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2221. Apr 22 04:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2222. Apr 22 04:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2223. Apr 22 04:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2224. Apr 22 04:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2225. Apr 22 04:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2226. Apr 22 04:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2227. Apr 22 04:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  2228. Apr 22 04:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2229. Apr 22 04:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2230. Apr 22 04:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2231. Apr 22 04:50:38 hp-epyc kernel: </TASK>
  2232. Apr 22 04:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2233. Apr 22 04:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2234. Apr 22 04:53:38 hp-epyc kernel: (detected by 0, t=20400567 jiffies, g=1051549, q=46198670)
  2235. Apr 22 04:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2236. Apr 22 04:53:38 hp-epyc kernel: Call Trace:
  2237. Apr 22 04:53:38 hp-epyc kernel: <TASK>
  2238. Apr 22 04:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2239. Apr 22 04:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2240. Apr 22 04:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2241. Apr 22 04:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2242. Apr 22 04:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2243. Apr 22 04:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2244. Apr 22 04:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2245. Apr 22 04:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2246. Apr 22 04:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2247. Apr 22 04:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2248. Apr 22 04:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2249. Apr 22 04:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2250. Apr 22 04:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  2251. Apr 22 04:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2252. Apr 22 04:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2253. Apr 22 04:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2254. Apr 22 04:53:38 hp-epyc kernel: </TASK>
  2255. Apr 22 04:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2256. Apr 22 04:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2257. Apr 22 04:56:38 hp-epyc kernel: (detected by 0, t=20580572 jiffies, g=1051549, q=46268433)
  2258. Apr 22 04:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2259. Apr 22 04:56:38 hp-epyc kernel: Call Trace:
  2260. Apr 22 04:56:38 hp-epyc kernel: <TASK>
  2261. Apr 22 04:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2262. Apr 22 04:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2263. Apr 22 04:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2264. Apr 22 04:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2265. Apr 22 04:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2266. Apr 22 04:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2267. Apr 22 04:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2268. Apr 22 04:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2269. Apr 22 04:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2270. Apr 22 04:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2271. Apr 22 04:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2272. Apr 22 04:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2273. Apr 22 04:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  2274. Apr 22 04:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2275. Apr 22 04:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2276. Apr 22 04:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2277. Apr 22 04:56:38 hp-epyc kernel: </TASK>
  2278. Apr 22 05:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2279. Apr 22 05:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2280. Apr 22 05:02:38 hp-epyc kernel: (detected by 53, t=20760577 jiffies, g=1051549, q=46338587)
  2281. Apr 22 05:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2282. Apr 22 05:02:38 hp-epyc kernel: Call Trace:
  2283. Apr 22 05:02:38 hp-epyc kernel: <TASK>
  2284. Apr 22 05:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2285. Apr 22 05:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2286. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2287. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2288. Apr 22 05:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2289. Apr 22 05:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2290. Apr 22 05:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2291. Apr 22 05:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2292. Apr 22 05:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2293. Apr 22 05:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2294. Apr 22 05:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2295. Apr 22 05:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2296. Apr 22 05:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2297. Apr 22 05:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2298. Apr 22 05:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2299. Apr 22 05:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2300. Apr 22 05:02:38 hp-epyc kernel: </TASK>
  2301. Apr 22 05:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2302. Apr 22 05:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2303. Apr 22 05:02:38 hp-epyc kernel: (detected by 0, t=20940582 jiffies, g=1051549, q=46407036)
  2304. Apr 22 05:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2305. Apr 22 05:02:38 hp-epyc kernel: Call Trace:
  2306. Apr 22 05:02:38 hp-epyc kernel: <TASK>
  2307. Apr 22 05:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2308. Apr 22 05:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2309. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2310. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2311. Apr 22 05:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2312. Apr 22 05:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2313. Apr 22 05:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2314. Apr 22 05:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2315. Apr 22 05:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2316. Apr 22 05:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2317. Apr 22 05:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2318. Apr 22 05:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2319. Apr 22 05:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2320. Apr 22 05:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2321. Apr 22 05:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2322. Apr 22 05:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2323. Apr 22 05:02:38 hp-epyc kernel: </TASK>
  2324. Apr 22 05:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2325. Apr 22 05:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2326. Apr 22 05:05:38 hp-epyc kernel: (detected by 0, t=21120587 jiffies, g=1051549, q=46477314)
  2327. Apr 22 05:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2328. Apr 22 05:05:38 hp-epyc kernel: Call Trace:
  2329. Apr 22 05:05:38 hp-epyc kernel: <TASK>
  2330. Apr 22 05:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2331. Apr 22 05:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2332. Apr 22 05:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2333. Apr 22 05:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2334. Apr 22 05:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2335. Apr 22 05:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2336. Apr 22 05:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2337. Apr 22 05:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2338. Apr 22 05:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2339. Apr 22 05:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2340. Apr 22 05:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2341. Apr 22 05:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2342. Apr 22 05:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  2343. Apr 22 05:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2344. Apr 22 05:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2345. Apr 22 05:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2346. Apr 22 05:05:38 hp-epyc kernel: </TASK>
  2347. Apr 22 05:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2348. Apr 22 05:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2349. Apr 22 05:11:38 hp-epyc kernel: (detected by 53, t=21300592 jiffies, g=1051549, q=46547926)
  2350. Apr 22 05:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2351. Apr 22 05:11:38 hp-epyc kernel: Call Trace:
  2352. Apr 22 05:11:38 hp-epyc kernel: <TASK>
  2353. Apr 22 05:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2354. Apr 22 05:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2355. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2356. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2357. Apr 22 05:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2358. Apr 22 05:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2359. Apr 22 05:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2360. Apr 22 05:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2361. Apr 22 05:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2362. Apr 22 05:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2363. Apr 22 05:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2364. Apr 22 05:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2365. Apr 22 05:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  2366. Apr 22 05:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2367. Apr 22 05:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2368. Apr 22 05:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2369. Apr 22 05:11:38 hp-epyc kernel: </TASK>
  2370. Apr 22 05:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2371. Apr 22 05:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2372. Apr 22 05:11:38 hp-epyc kernel: (detected by 0, t=21480597 jiffies, g=1051549, q=46615612)
  2373. Apr 22 05:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2374. Apr 22 05:11:38 hp-epyc kernel: Call Trace:
  2375. Apr 22 05:11:38 hp-epyc kernel: <TASK>
  2376. Apr 22 05:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2377. Apr 22 05:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2378. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2379. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2380. Apr 22 05:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2381. Apr 22 05:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2382. Apr 22 05:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2383. Apr 22 05:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2384. Apr 22 05:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2385. Apr 22 05:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2386. Apr 22 05:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2387. Apr 22 05:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2388. Apr 22 05:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  2389. Apr 22 05:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2390. Apr 22 05:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2391. Apr 22 05:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2392. Apr 22 05:11:38 hp-epyc kernel: </TASK>
  2393. Apr 22 05:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2394. Apr 22 05:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2395. Apr 22 05:14:38 hp-epyc kernel: (detected by 0, t=21660602 jiffies, g=1051549, q=46685224)
  2396. Apr 22 05:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2397. Apr 22 05:14:38 hp-epyc kernel: Call Trace:
  2398. Apr 22 05:14:38 hp-epyc kernel: <TASK>
  2399. Apr 22 05:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2400. Apr 22 05:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2401. Apr 22 05:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2402. Apr 22 05:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2403. Apr 22 05:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2404. Apr 22 05:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2405. Apr 22 05:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2406. Apr 22 05:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2407. Apr 22 05:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2408. Apr 22 05:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2409. Apr 22 05:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2410. Apr 22 05:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2411. Apr 22 05:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  2412. Apr 22 05:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2413. Apr 22 05:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2414. Apr 22 05:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2415. Apr 22 05:14:38 hp-epyc kernel: </TASK>
  2416. Apr 22 05:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2417. Apr 22 05:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2418. Apr 22 05:17:38 hp-epyc kernel: (detected by 0, t=21840607 jiffies, g=1051549, q=46754062)
  2419. Apr 22 05:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2420. Apr 22 05:17:38 hp-epyc kernel: Call Trace:
  2421. Apr 22 05:17:38 hp-epyc kernel: <TASK>
  2422. Apr 22 05:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2423. Apr 22 05:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2424. Apr 22 05:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2425. Apr 22 05:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2426. Apr 22 05:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2427. Apr 22 05:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2428. Apr 22 05:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2429. Apr 22 05:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2430. Apr 22 05:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2431. Apr 22 05:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2432. Apr 22 05:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2433. Apr 22 05:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2434. Apr 22 05:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  2435. Apr 22 05:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2436. Apr 22 05:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2437. Apr 22 05:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2438. Apr 22 05:17:38 hp-epyc kernel: </TASK>
  2439. Apr 22 05:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2440. Apr 22 05:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2441. Apr 22 05:20:38 hp-epyc kernel: (detected by 0, t=22020612 jiffies, g=1051549, q=46823999)
  2442. Apr 22 05:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2443. Apr 22 05:20:38 hp-epyc kernel: Call Trace:
  2444. Apr 22 05:20:38 hp-epyc kernel: <TASK>
  2445. Apr 22 05:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2446. Apr 22 05:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2447. Apr 22 05:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2448. Apr 22 05:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2449. Apr 22 05:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2450. Apr 22 05:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2451. Apr 22 05:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2452. Apr 22 05:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2453. Apr 22 05:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2454. Apr 22 05:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2455. Apr 22 05:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2456. Apr 22 05:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2457. Apr 22 05:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  2458. Apr 22 05:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2459. Apr 22 05:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2460. Apr 22 05:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2461. Apr 22 05:20:38 hp-epyc kernel: </TASK>
  2462. Apr 22 05:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2463. Apr 22 05:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2464. Apr 22 05:23:38 hp-epyc kernel: (detected by 0, t=22200617 jiffies, g=1051549, q=46894131)
  2465. Apr 22 05:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2466. Apr 22 05:23:38 hp-epyc kernel: Call Trace:
  2467. Apr 22 05:23:38 hp-epyc kernel: <TASK>
  2468. Apr 22 05:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2469. Apr 22 05:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2470. Apr 22 05:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2471. Apr 22 05:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2472. Apr 22 05:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2473. Apr 22 05:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2474. Apr 22 05:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2475. Apr 22 05:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2476. Apr 22 05:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2477. Apr 22 05:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2478. Apr 22 05:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2479. Apr 22 05:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2480. Apr 22 05:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  2481. Apr 22 05:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2482. Apr 22 05:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2483. Apr 22 05:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2484. Apr 22 05:23:38 hp-epyc kernel: </TASK>
  2485. Apr 22 05:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2486. Apr 22 05:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2487. Apr 22 05:26:38 hp-epyc kernel: (detected by 0, t=22380622 jiffies, g=1051549, q=46961925)
  2488. Apr 22 05:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2489. Apr 22 05:26:38 hp-epyc kernel: Call Trace:
  2490. Apr 22 05:26:38 hp-epyc kernel: <TASK>
  2491. Apr 22 05:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2492. Apr 22 05:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2493. Apr 22 05:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2494. Apr 22 05:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2495. Apr 22 05:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2496. Apr 22 05:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2497. Apr 22 05:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2498. Apr 22 05:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2499. Apr 22 05:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2500. Apr 22 05:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2501. Apr 22 05:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2502. Apr 22 05:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2503. Apr 22 05:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  2504. Apr 22 05:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2505. Apr 22 05:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2506. Apr 22 05:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2507. Apr 22 05:26:38 hp-epyc kernel: </TASK>
  2508. Apr 22 05:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2509. Apr 22 05:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2510. Apr 22 05:29:38 hp-epyc kernel: (detected by 0, t=22560627 jiffies, g=1051549, q=47032041)
  2511. Apr 22 05:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2512. Apr 22 05:29:38 hp-epyc kernel: Call Trace:
  2513. Apr 22 05:29:38 hp-epyc kernel: <TASK>
  2514. Apr 22 05:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2515. Apr 22 05:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2516. Apr 22 05:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2517. Apr 22 05:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2518. Apr 22 05:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2519. Apr 22 05:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2520. Apr 22 05:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2521. Apr 22 05:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2522. Apr 22 05:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2523. Apr 22 05:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2524. Apr 22 05:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2525. Apr 22 05:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2526. Apr 22 05:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  2527. Apr 22 05:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2528. Apr 22 05:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2529. Apr 22 05:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2530. Apr 22 05:29:38 hp-epyc kernel: </TASK>
  2531. Apr 22 05:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2532. Apr 22 05:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2533. Apr 22 05:32:38 hp-epyc kernel: (detected by 0, t=22740632 jiffies, g=1051549, q=47102144)
  2534. Apr 22 05:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2535. Apr 22 05:32:38 hp-epyc kernel: Call Trace:
  2536. Apr 22 05:32:38 hp-epyc kernel: <TASK>
  2537. Apr 22 05:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2538. Apr 22 05:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2539. Apr 22 05:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2540. Apr 22 05:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2541. Apr 22 05:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2542. Apr 22 05:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2543. Apr 22 05:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2544. Apr 22 05:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2545. Apr 22 05:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2546. Apr 22 05:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2547. Apr 22 05:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2548. Apr 22 05:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2549. Apr 22 05:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2550. Apr 22 05:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2551. Apr 22 05:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2552. Apr 22 05:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2553. Apr 22 05:32:38 hp-epyc kernel: </TASK>
  2554. Apr 22 05:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2555. Apr 22 05:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2556. Apr 22 05:35:38 hp-epyc kernel: (detected by 0, t=22920637 jiffies, g=1051549, q=47176871)
  2557. Apr 22 05:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2558. Apr 22 05:35:38 hp-epyc kernel: Call Trace:
  2559. Apr 22 05:35:38 hp-epyc kernel: <TASK>
  2560. Apr 22 05:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2561. Apr 22 05:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2562. Apr 22 05:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2563. Apr 22 05:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2564. Apr 22 05:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2565. Apr 22 05:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2566. Apr 22 05:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2567. Apr 22 05:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2568. Apr 22 05:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2569. Apr 22 05:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2570. Apr 22 05:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2571. Apr 22 05:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2572. Apr 22 05:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  2573. Apr 22 05:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2574. Apr 22 05:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2575. Apr 22 05:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2576. Apr 22 05:35:38 hp-epyc kernel: </TASK>
  2577. Apr 22 05:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2578. Apr 22 05:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2579. Apr 22 05:38:38 hp-epyc kernel: (detected by 0, t=23100642 jiffies, g=1051549, q=47246811)
  2580. Apr 22 05:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2581. Apr 22 05:38:38 hp-epyc kernel: Call Trace:
  2582. Apr 22 05:38:38 hp-epyc kernel: <TASK>
  2583. Apr 22 05:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2584. Apr 22 05:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2585. Apr 22 05:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2586. Apr 22 05:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2587. Apr 22 05:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2588. Apr 22 05:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2589. Apr 22 05:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2590. Apr 22 05:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2591. Apr 22 05:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2592. Apr 22 05:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2593. Apr 22 05:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2594. Apr 22 05:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2595. Apr 22 05:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  2596. Apr 22 05:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2597. Apr 22 05:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2598. Apr 22 05:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2599. Apr 22 05:38:38 hp-epyc kernel: </TASK>
  2600. Apr 22 05:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2601. Apr 22 05:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2602. Apr 22 05:41:38 hp-epyc kernel: (detected by 0, t=23280647 jiffies, g=1051549, q=47315513)
  2603. Apr 22 05:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2604. Apr 22 05:41:38 hp-epyc kernel: Call Trace:
  2605. Apr 22 05:41:38 hp-epyc kernel: <TASK>
  2606. Apr 22 05:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2607. Apr 22 05:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2608. Apr 22 05:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2609. Apr 22 05:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2610. Apr 22 05:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2611. Apr 22 05:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2612. Apr 22 05:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2613. Apr 22 05:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2614. Apr 22 05:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2615. Apr 22 05:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2616. Apr 22 05:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2617. Apr 22 05:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2618. Apr 22 05:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  2619. Apr 22 05:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2620. Apr 22 05:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2621. Apr 22 05:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2622. Apr 22 05:41:38 hp-epyc kernel: </TASK>
  2623. Apr 22 05:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2624. Apr 22 05:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2625. Apr 22 05:44:38 hp-epyc kernel: (detected by 0, t=23460652 jiffies, g=1051549, q=47385102)
  2626. Apr 22 05:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2627. Apr 22 05:44:38 hp-epyc kernel: Call Trace:
  2628. Apr 22 05:44:38 hp-epyc kernel: <TASK>
  2629. Apr 22 05:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2630. Apr 22 05:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2631. Apr 22 05:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2632. Apr 22 05:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2633. Apr 22 05:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2634. Apr 22 05:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2635. Apr 22 05:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2636. Apr 22 05:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2637. Apr 22 05:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2638. Apr 22 05:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2639. Apr 22 05:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2640. Apr 22 05:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2641. Apr 22 05:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  2642. Apr 22 05:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2643. Apr 22 05:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2644. Apr 22 05:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2645. Apr 22 05:44:38 hp-epyc kernel: </TASK>
  2646. Apr 22 05:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2647. Apr 22 05:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2648. Apr 22 05:47:38 hp-epyc kernel: (detected by 0, t=23640657 jiffies, g=1051549, q=47451357)
  2649. Apr 22 05:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2650. Apr 22 05:47:38 hp-epyc kernel: Call Trace:
  2651. Apr 22 05:47:38 hp-epyc kernel: <TASK>
  2652. Apr 22 05:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2653. Apr 22 05:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2654. Apr 22 05:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2655. Apr 22 05:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2656. Apr 22 05:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2657. Apr 22 05:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2658. Apr 22 05:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2659. Apr 22 05:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2660. Apr 22 05:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2661. Apr 22 05:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2662. Apr 22 05:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2663. Apr 22 05:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2664. Apr 22 05:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  2665. Apr 22 05:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2666. Apr 22 05:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2667. Apr 22 05:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2668. Apr 22 05:47:38 hp-epyc kernel: </TASK>
  2669. Apr 22 05:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2670. Apr 22 05:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2671. Apr 22 05:50:38 hp-epyc kernel: (detected by 0, t=23820662 jiffies, g=1051549, q=47521550)
  2672. Apr 22 05:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2673. Apr 22 05:50:38 hp-epyc kernel: Call Trace:
  2674. Apr 22 05:50:38 hp-epyc kernel: <TASK>
  2675. Apr 22 05:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2676. Apr 22 05:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2677. Apr 22 05:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2678. Apr 22 05:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2679. Apr 22 05:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2680. Apr 22 05:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2681. Apr 22 05:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2682. Apr 22 05:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2683. Apr 22 05:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2684. Apr 22 05:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2685. Apr 22 05:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2686. Apr 22 05:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2687. Apr 22 05:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  2688. Apr 22 05:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2689. Apr 22 05:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2690. Apr 22 05:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2691. Apr 22 05:50:38 hp-epyc kernel: </TASK>
  2692. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2693. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2694. Apr 22 06:02:38 hp-epyc kernel: (detected by 53, t=24000667 jiffies, g=1051549, q=47592133)
  2695. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2696. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2697. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2698. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2699. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2700. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2701. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2702. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2703. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2704. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2705. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2706. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2707. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2708. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2709. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2710. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2711. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2712. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2713. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2714. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2715. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2716. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2717. Apr 22 06:02:38 hp-epyc kernel: (detected by 53, t=24180672 jiffies, g=1051549, q=47662342)
  2718. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2719. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2720. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2721. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2722. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2723. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2724. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2725. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2726. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2727. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2728. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2729. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2730. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2731. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2732. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2733. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2734. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2735. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2736. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2737. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2738. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2739. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2740. Apr 22 06:02:38 hp-epyc kernel: (detected by 53, t=24360677 jiffies, g=1051549, q=47733548)
  2741. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2742. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2743. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2744. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2745. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2746. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2747. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2748. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2749. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2750. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2751. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2752. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2753. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2754. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2755. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2756. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2757. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2758. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2759. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2760. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2761. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2762. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2763. Apr 22 06:02:38 hp-epyc kernel: (detected by 0, t=24540682 jiffies, g=1051549, q=47801588)
  2764. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2765. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2766. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2767. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2768. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2769. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2770. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2771. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2772. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2773. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2774. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2775. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2776. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2777. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2778. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2779. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2780. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2781. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2782. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2783. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2784. Apr 22 06:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2785. Apr 22 06:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2786. Apr 22 06:08:38 hp-epyc kernel: (detected by 53, t=24720687 jiffies, g=1051549, q=47873137)
  2787. Apr 22 06:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2788. Apr 22 06:08:38 hp-epyc kernel: Call Trace:
  2789. Apr 22 06:08:38 hp-epyc kernel: <TASK>
  2790. Apr 22 06:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2791. Apr 22 06:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2792. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2793. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2794. Apr 22 06:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2795. Apr 22 06:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2796. Apr 22 06:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2797. Apr 22 06:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2798. Apr 22 06:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2799. Apr 22 06:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2800. Apr 22 06:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2801. Apr 22 06:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2802. Apr 22 06:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  2803. Apr 22 06:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2804. Apr 22 06:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2805. Apr 22 06:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2806. Apr 22 06:08:38 hp-epyc kernel: </TASK>
  2807. Apr 22 06:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2808. Apr 22 06:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2809. Apr 22 06:08:38 hp-epyc kernel: (detected by 0, t=24900692 jiffies, g=1051549, q=47940961)
  2810. Apr 22 06:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2811. Apr 22 06:08:38 hp-epyc kernel: Call Trace:
  2812. Apr 22 06:08:38 hp-epyc kernel: <TASK>
  2813. Apr 22 06:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2814. Apr 22 06:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2815. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2816. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2817. Apr 22 06:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2818. Apr 22 06:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2819. Apr 22 06:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2820. Apr 22 06:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2821. Apr 22 06:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2822. Apr 22 06:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2823. Apr 22 06:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2824. Apr 22 06:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2825. Apr 22 06:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  2826. Apr 22 06:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2827. Apr 22 06:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2828. Apr 22 06:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2829. Apr 22 06:08:38 hp-epyc kernel: </TASK>
  2830. Apr 22 06:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2831. Apr 22 06:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2832. Apr 22 06:11:38 hp-epyc kernel: (detected by 0, t=25080697 jiffies, g=1051549, q=48013209)
  2833. Apr 22 06:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2834. Apr 22 06:11:38 hp-epyc kernel: Call Trace:
  2835. Apr 22 06:11:38 hp-epyc kernel: <TASK>
  2836. Apr 22 06:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2837. Apr 22 06:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2838. Apr 22 06:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2839. Apr 22 06:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2840. Apr 22 06:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2841. Apr 22 06:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2842. Apr 22 06:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2843. Apr 22 06:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2844. Apr 22 06:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2845. Apr 22 06:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2846. Apr 22 06:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2847. Apr 22 06:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2848. Apr 22 06:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  2849. Apr 22 06:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2850. Apr 22 06:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2851. Apr 22 06:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2852. Apr 22 06:11:38 hp-epyc kernel: </TASK>
  2853. Apr 22 06:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2854. Apr 22 06:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2855. Apr 22 06:14:38 hp-epyc kernel: (detected by 0, t=25260702 jiffies, g=1051549, q=48085937)
  2856. Apr 22 06:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2857. Apr 22 06:14:38 hp-epyc kernel: Call Trace:
  2858. Apr 22 06:14:38 hp-epyc kernel: <TASK>
  2859. Apr 22 06:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2860. Apr 22 06:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2861. Apr 22 06:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2862. Apr 22 06:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2863. Apr 22 06:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2864. Apr 22 06:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2865. Apr 22 06:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2866. Apr 22 06:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2867. Apr 22 06:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2868. Apr 22 06:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2869. Apr 22 06:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2870. Apr 22 06:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2871. Apr 22 06:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  2872. Apr 22 06:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2873. Apr 22 06:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2874. Apr 22 06:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2875. Apr 22 06:14:38 hp-epyc kernel: </TASK>
  2876. Apr 22 06:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2877. Apr 22 06:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2878. Apr 22 06:17:38 hp-epyc kernel: (detected by 0, t=25440707 jiffies, g=1051549, q=48155756)
  2879. Apr 22 06:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2880. Apr 22 06:17:38 hp-epyc kernel: Call Trace:
  2881. Apr 22 06:17:38 hp-epyc kernel: <TASK>
  2882. Apr 22 06:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2883. Apr 22 06:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2884. Apr 22 06:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2885. Apr 22 06:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2886. Apr 22 06:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2887. Apr 22 06:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2888. Apr 22 06:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2889. Apr 22 06:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2890. Apr 22 06:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2891. Apr 22 06:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2892. Apr 22 06:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2893. Apr 22 06:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2894. Apr 22 06:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  2895. Apr 22 06:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2896. Apr 22 06:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2897. Apr 22 06:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2898. Apr 22 06:17:38 hp-epyc kernel: </TASK>
  2899. Apr 22 06:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2900. Apr 22 06:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2901. Apr 22 06:20:38 hp-epyc kernel: (detected by 0, t=25620712 jiffies, g=1051549, q=48225117)
  2902. Apr 22 06:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2903. Apr 22 06:20:38 hp-epyc kernel: Call Trace:
  2904. Apr 22 06:20:38 hp-epyc kernel: <TASK>
  2905. Apr 22 06:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2906. Apr 22 06:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2907. Apr 22 06:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2908. Apr 22 06:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2909. Apr 22 06:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2910. Apr 22 06:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2911. Apr 22 06:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2912. Apr 22 06:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2913. Apr 22 06:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2914. Apr 22 06:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2915. Apr 22 06:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2916. Apr 22 06:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2917. Apr 22 06:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  2918. Apr 22 06:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2919. Apr 22 06:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2920. Apr 22 06:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2921. Apr 22 06:20:38 hp-epyc kernel: </TASK>
  2922. Apr 22 06:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2923. Apr 22 06:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2924. Apr 22 06:23:38 hp-epyc kernel: (detected by 0, t=25800717 jiffies, g=1051549, q=48295609)
  2925. Apr 22 06:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2926. Apr 22 06:23:38 hp-epyc kernel: Call Trace:
  2927. Apr 22 06:23:38 hp-epyc kernel: <TASK>
  2928. Apr 22 06:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2929. Apr 22 06:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2930. Apr 22 06:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2931. Apr 22 06:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2932. Apr 22 06:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2933. Apr 22 06:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2934. Apr 22 06:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2935. Apr 22 06:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2936. Apr 22 06:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2937. Apr 22 06:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2938. Apr 22 06:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2939. Apr 22 06:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2940. Apr 22 06:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  2941. Apr 22 06:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2942. Apr 22 06:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2943. Apr 22 06:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2944. Apr 22 06:23:38 hp-epyc kernel: </TASK>
  2945. Apr 22 06:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2946. Apr 22 06:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2947. Apr 22 06:32:38 hp-epyc kernel: (detected by 53, t=25980722 jiffies, g=1051549, q=48364564)
  2948. Apr 22 06:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2949. Apr 22 06:32:38 hp-epyc kernel: Call Trace:
  2950. Apr 22 06:32:38 hp-epyc kernel: <TASK>
  2951. Apr 22 06:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2952. Apr 22 06:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2953. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2954. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2955. Apr 22 06:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2956. Apr 22 06:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2957. Apr 22 06:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2958. Apr 22 06:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2959. Apr 22 06:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2960. Apr 22 06:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2961. Apr 22 06:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2962. Apr 22 06:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2963. Apr 22 06:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2964. Apr 22 06:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2965. Apr 22 06:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2966. Apr 22 06:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2967. Apr 22 06:32:38 hp-epyc kernel: </TASK>
  2968. Apr 22 06:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2969. Apr 22 06:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2970. Apr 22 06:32:38 hp-epyc kernel: (detected by 53, t=26160727 jiffies, g=1051549, q=48437261)
  2971. Apr 22 06:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2972. Apr 22 06:32:38 hp-epyc kernel: Call Trace:
  2973. Apr 22 06:32:38 hp-epyc kernel: <TASK>
  2974. Apr 22 06:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2975. Apr 22 06:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2976. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2977. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2978. Apr 22 06:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2979. Apr 22 06:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2980. Apr 22 06:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2981. Apr 22 06:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2982. Apr 22 06:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2983. Apr 22 06:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2984. Apr 22 06:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2985. Apr 22 06:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2986. Apr 22 06:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2987. Apr 22 06:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2988. Apr 22 06:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2989. Apr 22 06:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2990. Apr 22 06:32:38 hp-epyc kernel: </TASK>
  2991. Apr 22 06:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2992. Apr 22 06:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2993. Apr 22 06:32:38 hp-epyc kernel: (detected by 0, t=26340732 jiffies, g=1051549, q=48507658)
  2994. Apr 22 06:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2995. Apr 22 06:32:38 hp-epyc kernel: Call Trace:
  2996. Apr 22 06:32:38 hp-epyc kernel: <TASK>
  2997. Apr 22 06:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2998. Apr 22 06:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2999. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3000. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3001. Apr 22 06:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3002. Apr 22 06:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3003. Apr 22 06:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3004. Apr 22 06:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3005. Apr 22 06:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3006. Apr 22 06:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3007. Apr 22 06:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3008. Apr 22 06:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3009. Apr 22 06:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  3010. Apr 22 06:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3011. Apr 22 06:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3012. Apr 22 06:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3013. Apr 22 06:32:38 hp-epyc kernel: </TASK>
  3014. Apr 22 06:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3015. Apr 22 06:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3016. Apr 22 06:35:38 hp-epyc kernel: (detected by 0, t=26520737 jiffies, g=1051549, q=48576084)
  3017. Apr 22 06:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3018. Apr 22 06:35:38 hp-epyc kernel: Call Trace:
  3019. Apr 22 06:35:38 hp-epyc kernel: <TASK>
  3020. Apr 22 06:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3021. Apr 22 06:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3022. Apr 22 06:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3023. Apr 22 06:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3024. Apr 22 06:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3025. Apr 22 06:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3026. Apr 22 06:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3027. Apr 22 06:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3028. Apr 22 06:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3029. Apr 22 06:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3030. Apr 22 06:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3031. Apr 22 06:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3032. Apr 22 06:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3033. Apr 22 06:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3034. Apr 22 06:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3035. Apr 22 06:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3036. Apr 22 06:35:38 hp-epyc kernel: </TASK>
  3037. Apr 22 06:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3038. Apr 22 06:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3039. Apr 22 06:38:38 hp-epyc kernel: (detected by 0, t=26700742 jiffies, g=1051549, q=48647327)
  3040. Apr 22 06:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3041. Apr 22 06:38:38 hp-epyc kernel: Call Trace:
  3042. Apr 22 06:38:38 hp-epyc kernel: <TASK>
  3043. Apr 22 06:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3044. Apr 22 06:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3045. Apr 22 06:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3046. Apr 22 06:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3047. Apr 22 06:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3048. Apr 22 06:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3049. Apr 22 06:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3050. Apr 22 06:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3051. Apr 22 06:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3052. Apr 22 06:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3053. Apr 22 06:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3054. Apr 22 06:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3055. Apr 22 06:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  3056. Apr 22 06:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3057. Apr 22 06:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3058. Apr 22 06:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3059. Apr 22 06:38:38 hp-epyc kernel: </TASK>
  3060. Apr 22 06:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3061. Apr 22 06:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3062. Apr 22 06:41:38 hp-epyc kernel: (detected by 0, t=26880747 jiffies, g=1051549, q=48719245)
  3063. Apr 22 06:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3064. Apr 22 06:41:38 hp-epyc kernel: Call Trace:
  3065. Apr 22 06:41:38 hp-epyc kernel: <TASK>
  3066. Apr 22 06:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3067. Apr 22 06:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3068. Apr 22 06:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3069. Apr 22 06:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3070. Apr 22 06:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3071. Apr 22 06:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3072. Apr 22 06:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3073. Apr 22 06:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3074. Apr 22 06:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3075. Apr 22 06:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3076. Apr 22 06:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3077. Apr 22 06:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3078. Apr 22 06:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  3079. Apr 22 06:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3080. Apr 22 06:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3081. Apr 22 06:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3082. Apr 22 06:41:38 hp-epyc kernel: </TASK>
  3083. Apr 22 06:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3084. Apr 22 06:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3085. Apr 22 06:44:38 hp-epyc kernel: (detected by 0, t=27060752 jiffies, g=1051549, q=48792412)
  3086. Apr 22 06:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3087. Apr 22 06:44:38 hp-epyc kernel: Call Trace:
  3088. Apr 22 06:44:38 hp-epyc kernel: <TASK>
  3089. Apr 22 06:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3090. Apr 22 06:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3091. Apr 22 06:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3092. Apr 22 06:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3093. Apr 22 06:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3094. Apr 22 06:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3095. Apr 22 06:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3096. Apr 22 06:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3097. Apr 22 06:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3098. Apr 22 06:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3099. Apr 22 06:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3100. Apr 22 06:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3101. Apr 22 06:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  3102. Apr 22 06:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3103. Apr 22 06:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3104. Apr 22 06:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3105. Apr 22 06:44:38 hp-epyc kernel: </TASK>
  3106. Apr 22 06:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3107. Apr 22 06:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3108. Apr 22 06:47:38 hp-epyc kernel: (detected by 0, t=27240757 jiffies, g=1051549, q=48864650)
  3109. Apr 22 06:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3110. Apr 22 06:47:38 hp-epyc kernel: Call Trace:
  3111. Apr 22 06:47:38 hp-epyc kernel: <TASK>
  3112. Apr 22 06:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3113. Apr 22 06:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3114. Apr 22 06:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3115. Apr 22 06:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3116. Apr 22 06:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3117. Apr 22 06:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3118. Apr 22 06:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3119. Apr 22 06:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3120. Apr 22 06:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3121. Apr 22 06:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3122. Apr 22 06:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3123. Apr 22 06:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3124. Apr 22 06:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  3125. Apr 22 06:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3126. Apr 22 06:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3127. Apr 22 06:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3128. Apr 22 06:47:38 hp-epyc kernel: </TASK>
  3129. Apr 22 06:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3130. Apr 22 06:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3131. Apr 22 06:56:38 hp-epyc kernel: (detected by 53, t=27420762 jiffies, g=1051549, q=48933422)
  3132. Apr 22 06:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3133. Apr 22 06:56:38 hp-epyc kernel: Call Trace:
  3134. Apr 22 06:56:38 hp-epyc kernel: <TASK>
  3135. Apr 22 06:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3136. Apr 22 06:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3137. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3138. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3139. Apr 22 06:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3140. Apr 22 06:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3141. Apr 22 06:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3142. Apr 22 06:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3143. Apr 22 06:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3144. Apr 22 06:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3145. Apr 22 06:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3146. Apr 22 06:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3147. Apr 22 06:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3148. Apr 22 06:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3149. Apr 22 06:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3150. Apr 22 06:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3151. Apr 22 06:56:38 hp-epyc kernel: </TASK>
  3152. Apr 22 06:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3153. Apr 22 06:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3154. Apr 22 06:56:38 hp-epyc kernel: (detected by 53, t=27600767 jiffies, g=1051549, q=49003985)
  3155. Apr 22 06:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3156. Apr 22 06:56:38 hp-epyc kernel: Call Trace:
  3157. Apr 22 06:56:38 hp-epyc kernel: <TASK>
  3158. Apr 22 06:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3159. Apr 22 06:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3160. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3161. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3162. Apr 22 06:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3163. Apr 22 06:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3164. Apr 22 06:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3165. Apr 22 06:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3166. Apr 22 06:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3167. Apr 22 06:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3168. Apr 22 06:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3169. Apr 22 06:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3170. Apr 22 06:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3171. Apr 22 06:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3172. Apr 22 06:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3173. Apr 22 06:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3174. Apr 22 06:56:38 hp-epyc kernel: </TASK>
  3175. Apr 22 06:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3176. Apr 22 06:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3177. Apr 22 06:56:38 hp-epyc kernel: (detected by 0, t=27780772 jiffies, g=1051549, q=49073222)
  3178. Apr 22 06:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3179. Apr 22 06:56:38 hp-epyc kernel: Call Trace:
  3180. Apr 22 06:56:38 hp-epyc kernel: <TASK>
  3181. Apr 22 06:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3182. Apr 22 06:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3183. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3184. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3185. Apr 22 06:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3186. Apr 22 06:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3187. Apr 22 06:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3188. Apr 22 06:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3189. Apr 22 06:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3190. Apr 22 06:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3191. Apr 22 06:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3192. Apr 22 06:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3193. Apr 22 06:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3194. Apr 22 06:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3195. Apr 22 06:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3196. Apr 22 06:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3197. Apr 22 06:56:38 hp-epyc kernel: </TASK>
  3198. Apr 22 06:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3199. Apr 22 06:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3200. Apr 22 06:59:38 hp-epyc kernel: (detected by 0, t=27960777 jiffies, g=1051549, q=49145625)
  3201. Apr 22 06:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3202. Apr 22 06:59:38 hp-epyc kernel: Call Trace:
  3203. Apr 22 06:59:38 hp-epyc kernel: <TASK>
  3204. Apr 22 06:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3205. Apr 22 06:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3206. Apr 22 06:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3207. Apr 22 06:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3208. Apr 22 06:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3209. Apr 22 06:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3210. Apr 22 06:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3211. Apr 22 06:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3212. Apr 22 06:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3213. Apr 22 06:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3214. Apr 22 06:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3215. Apr 22 06:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3216. Apr 22 06:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  3217. Apr 22 06:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3218. Apr 22 06:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3219. Apr 22 06:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3220. Apr 22 06:59:38 hp-epyc kernel: </TASK>
  3221. Apr 22 07:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3222. Apr 22 07:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3223. Apr 22 07:05:38 hp-epyc kernel: (detected by 53, t=28140782 jiffies, g=1051549, q=49218746)
  3224. Apr 22 07:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3225. Apr 22 07:05:38 hp-epyc kernel: Call Trace:
  3226. Apr 22 07:05:38 hp-epyc kernel: <TASK>
  3227. Apr 22 07:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3228. Apr 22 07:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3229. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3230. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3231. Apr 22 07:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3232. Apr 22 07:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3233. Apr 22 07:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3234. Apr 22 07:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3235. Apr 22 07:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3236. Apr 22 07:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3237. Apr 22 07:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3238. Apr 22 07:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3239. Apr 22 07:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  3240. Apr 22 07:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3241. Apr 22 07:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3242. Apr 22 07:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3243. Apr 22 07:05:38 hp-epyc kernel: </TASK>
  3244. Apr 22 07:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3245. Apr 22 07:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3246. Apr 22 07:05:38 hp-epyc kernel: (detected by 0, t=28320787 jiffies, g=1051549, q=49289236)
  3247. Apr 22 07:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3248. Apr 22 07:05:38 hp-epyc kernel: Call Trace:
  3249. Apr 22 07:05:38 hp-epyc kernel: <TASK>
  3250. Apr 22 07:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3251. Apr 22 07:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3252. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3253. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3254. Apr 22 07:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3255. Apr 22 07:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3256. Apr 22 07:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3257. Apr 22 07:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3258. Apr 22 07:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3259. Apr 22 07:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3260. Apr 22 07:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3261. Apr 22 07:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3262. Apr 22 07:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  3263. Apr 22 07:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3264. Apr 22 07:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3265. Apr 22 07:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3266. Apr 22 07:05:38 hp-epyc kernel: </TASK>
  3267. Apr 22 07:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3268. Apr 22 07:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3269. Apr 22 07:11:38 hp-epyc kernel: (detected by 53, t=28500792 jiffies, g=1051549, q=49362055)
  3270. Apr 22 07:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3271. Apr 22 07:11:38 hp-epyc kernel: Call Trace:
  3272. Apr 22 07:11:38 hp-epyc kernel: <TASK>
  3273. Apr 22 07:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3274. Apr 22 07:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3275. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3276. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3277. Apr 22 07:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3278. Apr 22 07:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3279. Apr 22 07:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3280. Apr 22 07:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3281. Apr 22 07:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3282. Apr 22 07:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3283. Apr 22 07:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3284. Apr 22 07:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3285. Apr 22 07:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3286. Apr 22 07:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3287. Apr 22 07:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3288. Apr 22 07:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3289. Apr 22 07:11:38 hp-epyc kernel: </TASK>
  3290. Apr 22 07:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3291. Apr 22 07:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3292. Apr 22 07:11:38 hp-epyc kernel: (detected by 0, t=28680797 jiffies, g=1051549, q=49433277)
  3293. Apr 22 07:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3294. Apr 22 07:11:38 hp-epyc kernel: Call Trace:
  3295. Apr 22 07:11:38 hp-epyc kernel: <TASK>
  3296. Apr 22 07:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3297. Apr 22 07:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3298. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3299. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3300. Apr 22 07:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3301. Apr 22 07:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3302. Apr 22 07:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3303. Apr 22 07:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3304. Apr 22 07:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3305. Apr 22 07:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3306. Apr 22 07:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3307. Apr 22 07:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3308. Apr 22 07:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3309. Apr 22 07:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3310. Apr 22 07:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3311. Apr 22 07:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3312. Apr 22 07:11:38 hp-epyc kernel: </TASK>
  3313. Apr 22 07:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3314. Apr 22 07:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3315. Apr 22 07:14:38 hp-epyc kernel: (detected by 0, t=28860802 jiffies, g=1051549, q=49502128)
  3316. Apr 22 07:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3317. Apr 22 07:14:38 hp-epyc kernel: Call Trace:
  3318. Apr 22 07:14:38 hp-epyc kernel: <TASK>
  3319. Apr 22 07:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3320. Apr 22 07:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3321. Apr 22 07:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3322. Apr 22 07:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3323. Apr 22 07:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3324. Apr 22 07:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3325. Apr 22 07:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3326. Apr 22 07:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3327. Apr 22 07:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3328. Apr 22 07:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3329. Apr 22 07:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3330. Apr 22 07:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3331. Apr 22 07:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  3332. Apr 22 07:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3333. Apr 22 07:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3334. Apr 22 07:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3335. Apr 22 07:14:38 hp-epyc kernel: </TASK>
  3336. Apr 22 07:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3337. Apr 22 07:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3338. Apr 22 07:17:38 hp-epyc kernel: (detected by 0, t=29040807 jiffies, g=1051549, q=49573403)
  3339. Apr 22 07:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3340. Apr 22 07:17:38 hp-epyc kernel: Call Trace:
  3341. Apr 22 07:17:38 hp-epyc kernel: <TASK>
  3342. Apr 22 07:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3343. Apr 22 07:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3344. Apr 22 07:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3345. Apr 22 07:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3346. Apr 22 07:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3347. Apr 22 07:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3348. Apr 22 07:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3349. Apr 22 07:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3350. Apr 22 07:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3351. Apr 22 07:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3352. Apr 22 07:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3353. Apr 22 07:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3354. Apr 22 07:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  3355. Apr 22 07:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3356. Apr 22 07:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3357. Apr 22 07:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3358. Apr 22 07:17:38 hp-epyc kernel: </TASK>
  3359. Apr 22 07:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3360. Apr 22 07:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3361. Apr 22 07:23:38 hp-epyc kernel: (detected by 53, t=29220812 jiffies, g=1051549, q=49644760)
  3362. Apr 22 07:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3363. Apr 22 07:23:38 hp-epyc kernel: Call Trace:
  3364. Apr 22 07:23:38 hp-epyc kernel: <TASK>
  3365. Apr 22 07:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3366. Apr 22 07:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3367. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3368. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3369. Apr 22 07:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3370. Apr 22 07:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3371. Apr 22 07:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3372. Apr 22 07:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3373. Apr 22 07:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3374. Apr 22 07:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3375. Apr 22 07:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3376. Apr 22 07:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3377. Apr 22 07:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3378. Apr 22 07:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3379. Apr 22 07:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3380. Apr 22 07:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3381. Apr 22 07:23:38 hp-epyc kernel: </TASK>
  3382. Apr 22 07:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3383. Apr 22 07:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3384. Apr 22 07:23:38 hp-epyc kernel: (detected by 0, t=29400817 jiffies, g=1051549, q=49715433)
  3385. Apr 22 07:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3386. Apr 22 07:23:38 hp-epyc kernel: Call Trace:
  3387. Apr 22 07:23:38 hp-epyc kernel: <TASK>
  3388. Apr 22 07:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3389. Apr 22 07:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3390. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3391. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3392. Apr 22 07:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3393. Apr 22 07:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3394. Apr 22 07:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3395. Apr 22 07:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3396. Apr 22 07:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3397. Apr 22 07:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3398. Apr 22 07:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3399. Apr 22 07:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3400. Apr 22 07:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3401. Apr 22 07:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3402. Apr 22 07:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3403. Apr 22 07:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3404. Apr 22 07:23:38 hp-epyc kernel: </TASK>
  3405. Apr 22 07:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3406. Apr 22 07:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3407. Apr 22 07:26:38 hp-epyc kernel: (detected by 0, t=29580822 jiffies, g=1051549, q=49786826)
  3408. Apr 22 07:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3409. Apr 22 07:26:38 hp-epyc kernel: Call Trace:
  3410. Apr 22 07:26:38 hp-epyc kernel: <TASK>
  3411. Apr 22 07:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3412. Apr 22 07:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3413. Apr 22 07:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3414. Apr 22 07:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3415. Apr 22 07:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3416. Apr 22 07:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3417. Apr 22 07:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3418. Apr 22 07:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3419. Apr 22 07:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3420. Apr 22 07:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3421. Apr 22 07:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3422. Apr 22 07:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3423. Apr 22 07:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  3424. Apr 22 07:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3425. Apr 22 07:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3426. Apr 22 07:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3427. Apr 22 07:26:38 hp-epyc kernel: </TASK>
  3428. Apr 22 07:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3429. Apr 22 07:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3430. Apr 22 07:29:38 hp-epyc kernel: (detected by 0, t=29760827 jiffies, g=1051549, q=49855820)
  3431. Apr 22 07:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3432. Apr 22 07:29:38 hp-epyc kernel: Call Trace:
  3433. Apr 22 07:29:38 hp-epyc kernel: <TASK>
  3434. Apr 22 07:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3435. Apr 22 07:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3436. Apr 22 07:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3437. Apr 22 07:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3438. Apr 22 07:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3439. Apr 22 07:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3440. Apr 22 07:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3441. Apr 22 07:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3442. Apr 22 07:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3443. Apr 22 07:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3444. Apr 22 07:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3445. Apr 22 07:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3446. Apr 22 07:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  3447. Apr 22 07:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3448. Apr 22 07:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3449. Apr 22 07:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3450. Apr 22 07:29:38 hp-epyc kernel: </TASK>
  3451. Apr 22 07:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3452. Apr 22 07:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3453. Apr 22 07:32:38 hp-epyc kernel: (detected by 0, t=29940832 jiffies, g=1051549, q=49926228)
  3454. Apr 22 07:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3455. Apr 22 07:32:38 hp-epyc kernel: Call Trace:
  3456. Apr 22 07:32:38 hp-epyc kernel: <TASK>
  3457. Apr 22 07:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3458. Apr 22 07:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3459. Apr 22 07:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3460. Apr 22 07:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3461. Apr 22 07:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3462. Apr 22 07:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3463. Apr 22 07:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3464. Apr 22 07:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3465. Apr 22 07:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3466. Apr 22 07:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3467. Apr 22 07:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3468. Apr 22 07:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3469. Apr 22 07:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  3470. Apr 22 07:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3471. Apr 22 07:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3472. Apr 22 07:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3473. Apr 22 07:32:38 hp-epyc kernel: </TASK>
  3474. Apr 22 07:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3475. Apr 22 07:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3476. Apr 22 07:35:38 hp-epyc kernel: (detected by 0, t=30120837 jiffies, g=1051549, q=49998070)
  3477. Apr 22 07:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3478. Apr 22 07:35:38 hp-epyc kernel: Call Trace:
  3479. Apr 22 07:35:38 hp-epyc kernel: <TASK>
  3480. Apr 22 07:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3481. Apr 22 07:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3482. Apr 22 07:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3483. Apr 22 07:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3484. Apr 22 07:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3485. Apr 22 07:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3486. Apr 22 07:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3487. Apr 22 07:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3488. Apr 22 07:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3489. Apr 22 07:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3490. Apr 22 07:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3491. Apr 22 07:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3492. Apr 22 07:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3493. Apr 22 07:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3494. Apr 22 07:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3495. Apr 22 07:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3496. Apr 22 07:35:38 hp-epyc kernel: </TASK>
  3497. Apr 22 07:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3498. Apr 22 07:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3499. Apr 22 07:38:38 hp-epyc kernel: (detected by 0, t=30300842 jiffies, g=1051549, q=50066661)
  3500. Apr 22 07:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3501. Apr 22 07:38:38 hp-epyc kernel: Call Trace:
  3502. Apr 22 07:38:38 hp-epyc kernel: <TASK>
  3503. Apr 22 07:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3504. Apr 22 07:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3505. Apr 22 07:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3506. Apr 22 07:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3507. Apr 22 07:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3508. Apr 22 07:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3509. Apr 22 07:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3510. Apr 22 07:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3511. Apr 22 07:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3512. Apr 22 07:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3513. Apr 22 07:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3514. Apr 22 07:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3515. Apr 22 07:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  3516. Apr 22 07:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3517. Apr 22 07:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3518. Apr 22 07:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3519. Apr 22 07:38:38 hp-epyc kernel: </TASK>
  3520. Apr 22 07:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3521. Apr 22 07:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3522. Apr 22 07:44:38 hp-epyc kernel: (detected by 53, t=30480847 jiffies, g=1051549, q=50137831)
  3523. Apr 22 07:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3524. Apr 22 07:44:38 hp-epyc kernel: Call Trace:
  3525. Apr 22 07:44:38 hp-epyc kernel: <TASK>
  3526. Apr 22 07:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3527. Apr 22 07:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3528. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3529. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3530. Apr 22 07:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3531. Apr 22 07:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3532. Apr 22 07:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3533. Apr 22 07:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3534. Apr 22 07:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3535. Apr 22 07:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3536. Apr 22 07:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3537. Apr 22 07:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3538. Apr 22 07:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  3539. Apr 22 07:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3540. Apr 22 07:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3541. Apr 22 07:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3542. Apr 22 07:44:38 hp-epyc kernel: </TASK>
  3543. Apr 22 07:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3544. Apr 22 07:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3545. Apr 22 07:44:38 hp-epyc kernel: (detected by 0, t=30660852 jiffies, g=1051549, q=50208287)
  3546. Apr 22 07:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3547. Apr 22 07:44:38 hp-epyc kernel: Call Trace:
  3548. Apr 22 07:44:38 hp-epyc kernel: <TASK>
  3549. Apr 22 07:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3550. Apr 22 07:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3551. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3552. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3553. Apr 22 07:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3554. Apr 22 07:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3555. Apr 22 07:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3556. Apr 22 07:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3557. Apr 22 07:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3558. Apr 22 07:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3559. Apr 22 07:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3560. Apr 22 07:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3561. Apr 22 07:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  3562. Apr 22 07:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3563. Apr 22 07:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3564. Apr 22 07:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3565. Apr 22 07:44:38 hp-epyc kernel: </TASK>
  3566. Apr 22 07:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3567. Apr 22 07:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3568. Apr 22 07:47:38 hp-epyc kernel: (detected by 0, t=30840857 jiffies, g=1051549, q=50281342)
  3569. Apr 22 07:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3570. Apr 22 07:47:38 hp-epyc kernel: Call Trace:
  3571. Apr 22 07:47:38 hp-epyc kernel: <TASK>
  3572. Apr 22 07:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3573. Apr 22 07:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3574. Apr 22 07:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3575. Apr 22 07:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3576. Apr 22 07:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3577. Apr 22 07:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3578. Apr 22 07:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3579. Apr 22 07:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3580. Apr 22 07:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3581. Apr 22 07:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3582. Apr 22 07:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3583. Apr 22 07:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3584. Apr 22 07:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  3585. Apr 22 07:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3586. Apr 22 07:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3587. Apr 22 07:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3588. Apr 22 07:47:38 hp-epyc kernel: </TASK>
  3589. Apr 22 07:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3590. Apr 22 07:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3591. Apr 22 07:53:38 hp-epyc kernel: (detected by 53, t=31020862 jiffies, g=1051549, q=50351981)
  3592. Apr 22 07:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3593. Apr 22 07:53:38 hp-epyc kernel: Call Trace:
  3594. Apr 22 07:53:38 hp-epyc kernel: <TASK>
  3595. Apr 22 07:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3596. Apr 22 07:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3597. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3598. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3599. Apr 22 07:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3600. Apr 22 07:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3601. Apr 22 07:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3602. Apr 22 07:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3603. Apr 22 07:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3604. Apr 22 07:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3605. Apr 22 07:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3606. Apr 22 07:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3607. Apr 22 07:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  3608. Apr 22 07:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3609. Apr 22 07:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3610. Apr 22 07:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3611. Apr 22 07:53:38 hp-epyc kernel: </TASK>
  3612. Apr 22 07:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3613. Apr 22 07:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3614. Apr 22 07:53:38 hp-epyc kernel: (detected by 0, t=31200867 jiffies, g=1051549, q=50424813)
  3615. Apr 22 07:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3616. Apr 22 07:53:38 hp-epyc kernel: Call Trace:
  3617. Apr 22 07:53:38 hp-epyc kernel: <TASK>
  3618. Apr 22 07:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3619. Apr 22 07:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3620. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3621. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3622. Apr 22 07:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3623. Apr 22 07:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3624. Apr 22 07:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3625. Apr 22 07:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3626. Apr 22 07:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3627. Apr 22 07:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3628. Apr 22 07:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3629. Apr 22 07:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3630. Apr 22 07:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  3631. Apr 22 07:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3632. Apr 22 07:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3633. Apr 22 07:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3634. Apr 22 07:53:38 hp-epyc kernel: </TASK>
  3635. Apr 22 07:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3636. Apr 22 07:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3637. Apr 22 07:56:38 hp-epyc kernel: (detected by 0, t=31380872 jiffies, g=1051549, q=50496095)
  3638. Apr 22 07:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3639. Apr 22 07:56:38 hp-epyc kernel: Call Trace:
  3640. Apr 22 07:56:38 hp-epyc kernel: <TASK>
  3641. Apr 22 07:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3642. Apr 22 07:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3643. Apr 22 07:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3644. Apr 22 07:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3645. Apr 22 07:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3646. Apr 22 07:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3647. Apr 22 07:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3648. Apr 22 07:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3649. Apr 22 07:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3650. Apr 22 07:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3651. Apr 22 07:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3652. Apr 22 07:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3653. Apr 22 07:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3654. Apr 22 07:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3655. Apr 22 07:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3656. Apr 22 07:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3657. Apr 22 07:56:38 hp-epyc kernel: </TASK>
  3658. Apr 22 07:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3659. Apr 22 07:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3660. Apr 22 07:59:38 hp-epyc kernel: (detected by 0, t=31560877 jiffies, g=1051549, q=50568146)
  3661. Apr 22 07:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3662. Apr 22 07:59:38 hp-epyc kernel: Call Trace:
  3663. Apr 22 07:59:38 hp-epyc kernel: <TASK>
  3664. Apr 22 07:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3665. Apr 22 07:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3666. Apr 22 07:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3667. Apr 22 07:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3668. Apr 22 07:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3669. Apr 22 07:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3670. Apr 22 07:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3671. Apr 22 07:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3672. Apr 22 07:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3673. Apr 22 07:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3674. Apr 22 07:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3675. Apr 22 07:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3676. Apr 22 07:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  3677. Apr 22 07:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3678. Apr 22 07:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3679. Apr 22 07:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3680. Apr 22 07:59:38 hp-epyc kernel: </TASK>
  3681. Apr 22 08:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3682. Apr 22 08:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3683. Apr 22 08:02:38 hp-epyc kernel: (detected by 0, t=31740882 jiffies, g=1051549, q=50639150)
  3684. Apr 22 08:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3685. Apr 22 08:02:38 hp-epyc kernel: Call Trace:
  3686. Apr 22 08:02:38 hp-epyc kernel: <TASK>
  3687. Apr 22 08:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3688. Apr 22 08:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3689. Apr 22 08:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3690. Apr 22 08:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3691. Apr 22 08:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3692. Apr 22 08:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3693. Apr 22 08:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3694. Apr 22 08:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3695. Apr 22 08:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3696. Apr 22 08:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3697. Apr 22 08:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3698. Apr 22 08:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3699. Apr 22 08:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  3700. Apr 22 08:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3701. Apr 22 08:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3702. Apr 22 08:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3703. Apr 22 08:02:38 hp-epyc kernel: </TASK>
  3704. Apr 22 08:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3705. Apr 22 08:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3706. Apr 22 08:05:38 hp-epyc kernel: (detected by 0, t=31920887 jiffies, g=1051549, q=50709619)
  3707. Apr 22 08:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3708. Apr 22 08:05:38 hp-epyc kernel: Call Trace:
  3709. Apr 22 08:05:38 hp-epyc kernel: <TASK>
  3710. Apr 22 08:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3711. Apr 22 08:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3712. Apr 22 08:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3713. Apr 22 08:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3714. Apr 22 08:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3715. Apr 22 08:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3716. Apr 22 08:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3717. Apr 22 08:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3718. Apr 22 08:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3719. Apr 22 08:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3720. Apr 22 08:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3721. Apr 22 08:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3722. Apr 22 08:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  3723. Apr 22 08:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3724. Apr 22 08:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3725. Apr 22 08:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3726. Apr 22 08:05:38 hp-epyc kernel: </TASK>
  3727. Apr 22 08:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3728. Apr 22 08:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3729. Apr 22 08:11:38 hp-epyc kernel: (detected by 53, t=32100892 jiffies, g=1051549, q=50778446)
  3730. Apr 22 08:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3731. Apr 22 08:11:38 hp-epyc kernel: Call Trace:
  3732. Apr 22 08:11:38 hp-epyc kernel: <TASK>
  3733. Apr 22 08:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3734. Apr 22 08:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3735. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3736. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3737. Apr 22 08:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3738. Apr 22 08:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3739. Apr 22 08:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3740. Apr 22 08:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3741. Apr 22 08:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3742. Apr 22 08:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3743. Apr 22 08:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3744. Apr 22 08:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3745. Apr 22 08:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3746. Apr 22 08:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3747. Apr 22 08:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3748. Apr 22 08:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3749. Apr 22 08:11:38 hp-epyc kernel: </TASK>
  3750. Apr 22 08:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3751. Apr 22 08:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3752. Apr 22 08:11:38 hp-epyc kernel: (detected by 0, t=32280897 jiffies, g=1051549, q=50848666)
  3753. Apr 22 08:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3754. Apr 22 08:11:38 hp-epyc kernel: Call Trace:
  3755. Apr 22 08:11:38 hp-epyc kernel: <TASK>
  3756. Apr 22 08:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3757. Apr 22 08:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3758. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3759. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3760. Apr 22 08:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3761. Apr 22 08:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3762. Apr 22 08:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3763. Apr 22 08:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3764. Apr 22 08:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3765. Apr 22 08:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3766. Apr 22 08:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3767. Apr 22 08:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3768. Apr 22 08:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3769. Apr 22 08:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3770. Apr 22 08:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3771. Apr 22 08:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3772. Apr 22 08:11:38 hp-epyc kernel: </TASK>
  3773. Apr 22 08:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3774. Apr 22 08:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3775. Apr 22 08:14:38 hp-epyc kernel: (detected by 0, t=32460902 jiffies, g=1051549, q=50919769)
  3776. Apr 22 08:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3777. Apr 22 08:14:38 hp-epyc kernel: Call Trace:
  3778. Apr 22 08:14:38 hp-epyc kernel: <TASK>
  3779. Apr 22 08:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3780. Apr 22 08:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3781. Apr 22 08:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3782. Apr 22 08:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3783. Apr 22 08:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3784. Apr 22 08:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3785. Apr 22 08:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3786. Apr 22 08:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3787. Apr 22 08:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3788. Apr 22 08:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3789. Apr 22 08:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3790. Apr 22 08:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3791. Apr 22 08:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  3792. Apr 22 08:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3793. Apr 22 08:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3794. Apr 22 08:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3795. Apr 22 08:14:38 hp-epyc kernel: </TASK>
  3796. Apr 22 08:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3797. Apr 22 08:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3798. Apr 22 08:17:38 hp-epyc kernel: (detected by 0, t=32640907 jiffies, g=1051549, q=50991759)
  3799. Apr 22 08:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3800. Apr 22 08:17:38 hp-epyc kernel: Call Trace:
  3801. Apr 22 08:17:38 hp-epyc kernel: <TASK>
  3802. Apr 22 08:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3803. Apr 22 08:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3804. Apr 22 08:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3805. Apr 22 08:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3806. Apr 22 08:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3807. Apr 22 08:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3808. Apr 22 08:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3809. Apr 22 08:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3810. Apr 22 08:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3811. Apr 22 08:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3812. Apr 22 08:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3813. Apr 22 08:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3814. Apr 22 08:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  3815. Apr 22 08:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3816. Apr 22 08:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3817. Apr 22 08:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3818. Apr 22 08:17:38 hp-epyc kernel: </TASK>
  3819. Apr 22 08:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3820. Apr 22 08:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3821. Apr 22 08:23:38 hp-epyc kernel: (detected by 53, t=32820912 jiffies, g=1051549, q=51060457)
  3822. Apr 22 08:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3823. Apr 22 08:23:38 hp-epyc kernel: Call Trace:
  3824. Apr 22 08:23:38 hp-epyc kernel: <TASK>
  3825. Apr 22 08:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3826. Apr 22 08:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3827. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3828. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3829. Apr 22 08:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3830. Apr 22 08:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3831. Apr 22 08:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3832. Apr 22 08:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3833. Apr 22 08:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3834. Apr 22 08:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3835. Apr 22 08:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3836. Apr 22 08:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3837. Apr 22 08:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3838. Apr 22 08:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3839. Apr 22 08:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3840. Apr 22 08:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3841. Apr 22 08:23:38 hp-epyc kernel: </TASK>
  3842. Apr 22 08:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3843. Apr 22 08:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3844. Apr 22 08:23:38 hp-epyc kernel: (detected by 0, t=33000917 jiffies, g=1051549, q=51131066)
  3845. Apr 22 08:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3846. Apr 22 08:23:38 hp-epyc kernel: Call Trace:
  3847. Apr 22 08:23:38 hp-epyc kernel: <TASK>
  3848. Apr 22 08:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3849. Apr 22 08:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3850. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3851. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3852. Apr 22 08:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3853. Apr 22 08:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3854. Apr 22 08:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3855. Apr 22 08:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3856. Apr 22 08:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3857. Apr 22 08:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3858. Apr 22 08:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3859. Apr 22 08:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3860. Apr 22 08:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3861. Apr 22 08:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3862. Apr 22 08:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3863. Apr 22 08:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3864. Apr 22 08:23:38 hp-epyc kernel: </TASK>
  3865. Apr 22 08:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3866. Apr 22 08:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3867. Apr 22 08:26:38 hp-epyc kernel: (detected by 0, t=33180922 jiffies, g=1051549, q=51199838)
  3868. Apr 22 08:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3869. Apr 22 08:26:38 hp-epyc kernel: Call Trace:
  3870. Apr 22 08:26:38 hp-epyc kernel: <TASK>
  3871. Apr 22 08:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3872. Apr 22 08:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3873. Apr 22 08:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3874. Apr 22 08:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3875. Apr 22 08:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3876. Apr 22 08:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3877. Apr 22 08:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3878. Apr 22 08:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3879. Apr 22 08:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3880. Apr 22 08:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3881. Apr 22 08:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3882. Apr 22 08:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3883. Apr 22 08:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  3884. Apr 22 08:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3885. Apr 22 08:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3886. Apr 22 08:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3887. Apr 22 08:26:38 hp-epyc kernel: </TASK>
  3888. Apr 22 08:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3889. Apr 22 08:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3890. Apr 22 08:35:38 hp-epyc kernel: (detected by 53, t=33360927 jiffies, g=1051549, q=51267890)
  3891. Apr 22 08:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3892. Apr 22 08:35:38 hp-epyc kernel: Call Trace:
  3893. Apr 22 08:35:38 hp-epyc kernel: <TASK>
  3894. Apr 22 08:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3895. Apr 22 08:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3896. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3897. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3898. Apr 22 08:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3899. Apr 22 08:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3900. Apr 22 08:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3901. Apr 22 08:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3902. Apr 22 08:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3903. Apr 22 08:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3904. Apr 22 08:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3905. Apr 22 08:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3906. Apr 22 08:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3907. Apr 22 08:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3908. Apr 22 08:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3909. Apr 22 08:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3910. Apr 22 08:35:38 hp-epyc kernel: </TASK>
  3911. Apr 22 08:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3912. Apr 22 08:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3913. Apr 22 08:35:38 hp-epyc kernel: (detected by 53, t=33540932 jiffies, g=1051549, q=51339220)
  3914. Apr 22 08:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3915. Apr 22 08:35:38 hp-epyc kernel: Call Trace:
  3916. Apr 22 08:35:38 hp-epyc kernel: <TASK>
  3917. Apr 22 08:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3918. Apr 22 08:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3919. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3920. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3921. Apr 22 08:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3922. Apr 22 08:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3923. Apr 22 08:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3924. Apr 22 08:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3925. Apr 22 08:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3926. Apr 22 08:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3927. Apr 22 08:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3928. Apr 22 08:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3929. Apr 22 08:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3930. Apr 22 08:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3931. Apr 22 08:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3932. Apr 22 08:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3933. Apr 22 08:35:38 hp-epyc kernel: </TASK>
  3934. Apr 22 08:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3935. Apr 22 08:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3936. Apr 22 08:35:38 hp-epyc kernel: (detected by 0, t=33720937 jiffies, g=1051549, q=51409663)
  3937. Apr 22 08:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3938. Apr 22 08:35:38 hp-epyc kernel: Call Trace:
  3939. Apr 22 08:35:38 hp-epyc kernel: <TASK>
  3940. Apr 22 08:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3941. Apr 22 08:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3942. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3943. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3944. Apr 22 08:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3945. Apr 22 08:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3946. Apr 22 08:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3947. Apr 22 08:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3948. Apr 22 08:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3949. Apr 22 08:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3950. Apr 22 08:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3951. Apr 22 08:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3952. Apr 22 08:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3953. Apr 22 08:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3954. Apr 22 08:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3955. Apr 22 08:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3956. Apr 22 08:35:38 hp-epyc kernel: </TASK>
  3957. Apr 22 08:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3958. Apr 22 08:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3959. Apr 22 08:41:38 hp-epyc kernel: (detected by 53, t=33900942 jiffies, g=1051549, q=51480169)
  3960. Apr 22 08:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3961. Apr 22 08:41:38 hp-epyc kernel: Call Trace:
  3962. Apr 22 08:41:38 hp-epyc kernel: <TASK>
  3963. Apr 22 08:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3964. Apr 22 08:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3965. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3966. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3967. Apr 22 08:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3968. Apr 22 08:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3969. Apr 22 08:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3970. Apr 22 08:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3971. Apr 22 08:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3972. Apr 22 08:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3973. Apr 22 08:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3974. Apr 22 08:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3975. Apr 22 08:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  3976. Apr 22 08:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3977. Apr 22 08:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3978. Apr 22 08:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3979. Apr 22 08:41:38 hp-epyc kernel: </TASK>
  3980. Apr 22 08:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3981. Apr 22 08:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3982. Apr 22 08:41:38 hp-epyc kernel: (detected by 0, t=34080947 jiffies, g=1051549, q=51550821)
  3983. Apr 22 08:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3984. Apr 22 08:41:38 hp-epyc kernel: Call Trace:
  3985. Apr 22 08:41:38 hp-epyc kernel: <TASK>
  3986. Apr 22 08:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3987. Apr 22 08:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3988. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3989. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3990. Apr 22 08:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3991. Apr 22 08:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3992. Apr 22 08:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3993. Apr 22 08:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3994. Apr 22 08:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3995. Apr 22 08:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3996. Apr 22 08:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3997. Apr 22 08:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3998. Apr 22 08:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  3999. Apr 22 08:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4000. Apr 22 08:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4001. Apr 22 08:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4002. Apr 22 08:41:38 hp-epyc kernel: </TASK>
  4003. Apr 22 08:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4004. Apr 22 08:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4005. Apr 22 08:44:38 hp-epyc kernel: (detected by 0, t=34260952 jiffies, g=1051549, q=51623250)
  4006. Apr 22 08:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4007. Apr 22 08:44:38 hp-epyc kernel: Call Trace:
  4008. Apr 22 08:44:38 hp-epyc kernel: <TASK>
  4009. Apr 22 08:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4010. Apr 22 08:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4011. Apr 22 08:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4012. Apr 22 08:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4013. Apr 22 08:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4014. Apr 22 08:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4015. Apr 22 08:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4016. Apr 22 08:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4017. Apr 22 08:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4018. Apr 22 08:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4019. Apr 22 08:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4020. Apr 22 08:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4021. Apr 22 08:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  4022. Apr 22 08:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4023. Apr 22 08:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4024. Apr 22 08:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4025. Apr 22 08:44:38 hp-epyc kernel: </TASK>
  4026. Apr 22 08:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4027. Apr 22 08:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4028. Apr 22 08:47:38 hp-epyc kernel: (detected by 0, t=34440957 jiffies, g=1051549, q=51693919)
  4029. Apr 22 08:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4030. Apr 22 08:47:38 hp-epyc kernel: Call Trace:
  4031. Apr 22 08:47:38 hp-epyc kernel: <TASK>
  4032. Apr 22 08:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4033. Apr 22 08:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4034. Apr 22 08:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4035. Apr 22 08:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4036. Apr 22 08:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4037. Apr 22 08:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4038. Apr 22 08:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4039. Apr 22 08:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4040. Apr 22 08:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4041. Apr 22 08:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4042. Apr 22 08:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4043. Apr 22 08:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4044. Apr 22 08:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  4045. Apr 22 08:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4046. Apr 22 08:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4047. Apr 22 08:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4048. Apr 22 08:47:38 hp-epyc kernel: </TASK>
  4049. Apr 22 08:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4050. Apr 22 08:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4051. Apr 22 08:50:38 hp-epyc kernel: (detected by 0, t=34620962 jiffies, g=1051549, q=51766914)
  4052. Apr 22 08:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4053. Apr 22 08:50:38 hp-epyc kernel: Call Trace:
  4054. Apr 22 08:50:38 hp-epyc kernel: <TASK>
  4055. Apr 22 08:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4056. Apr 22 08:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4057. Apr 22 08:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4058. Apr 22 08:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4059. Apr 22 08:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4060. Apr 22 08:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4061. Apr 22 08:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4062. Apr 22 08:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4063. Apr 22 08:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4064. Apr 22 08:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4065. Apr 22 08:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4066. Apr 22 08:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4067. Apr 22 08:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  4068. Apr 22 08:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4069. Apr 22 08:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4070. Apr 22 08:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4071. Apr 22 08:50:38 hp-epyc kernel: </TASK>
  4072. Apr 22 08:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4073. Apr 22 08:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4074. Apr 22 08:56:38 hp-epyc kernel: (detected by 53, t=34800967 jiffies, g=1051549, q=51835158)
  4075. Apr 22 08:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4076. Apr 22 08:56:38 hp-epyc kernel: Call Trace:
  4077. Apr 22 08:56:38 hp-epyc kernel: <TASK>
  4078. Apr 22 08:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4079. Apr 22 08:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4080. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4081. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4082. Apr 22 08:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4083. Apr 22 08:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4084. Apr 22 08:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4085. Apr 22 08:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4086. Apr 22 08:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4087. Apr 22 08:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4088. Apr 22 08:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4089. Apr 22 08:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4090. Apr 22 08:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  4091. Apr 22 08:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4092. Apr 22 08:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4093. Apr 22 08:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4094. Apr 22 08:56:38 hp-epyc kernel: </TASK>
  4095. Apr 22 08:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4096. Apr 22 08:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4097. Apr 22 08:56:38 hp-epyc kernel: (detected by 0, t=34980972 jiffies, g=1051549, q=51907782)
  4098. Apr 22 08:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4099. Apr 22 08:56:38 hp-epyc kernel: Call Trace:
  4100. Apr 22 08:56:38 hp-epyc kernel: <TASK>
  4101. Apr 22 08:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4102. Apr 22 08:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4103. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4104. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4105. Apr 22 08:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4106. Apr 22 08:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4107. Apr 22 08:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4108. Apr 22 08:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4109. Apr 22 08:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4110. Apr 22 08:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4111. Apr 22 08:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4112. Apr 22 08:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4113. Apr 22 08:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  4114. Apr 22 08:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4115. Apr 22 08:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4116. Apr 22 08:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4117. Apr 22 08:56:38 hp-epyc kernel: </TASK>
  4118. Apr 22 08:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4119. Apr 22 08:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4120. Apr 22 08:59:38 hp-epyc kernel: (detected by 0, t=35160977 jiffies, g=1051549, q=51978604)
  4121. Apr 22 08:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4122. Apr 22 08:59:38 hp-epyc kernel: Call Trace:
  4123. Apr 22 08:59:38 hp-epyc kernel: <TASK>
  4124. Apr 22 08:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4125. Apr 22 08:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4126. Apr 22 08:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4127. Apr 22 08:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4128. Apr 22 08:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4129. Apr 22 08:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4130. Apr 22 08:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4131. Apr 22 08:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4132. Apr 22 08:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4133. Apr 22 08:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4134. Apr 22 08:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4135. Apr 22 08:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4136. Apr 22 08:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  4137. Apr 22 08:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4138. Apr 22 08:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4139. Apr 22 08:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4140. Apr 22 08:59:38 hp-epyc kernel: </TASK>
  4141. Apr 22 09:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4142. Apr 22 09:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4143. Apr 22 09:02:38 hp-epyc kernel: (detected by 0, t=35340982 jiffies, g=1051549, q=52049376)
  4144. Apr 22 09:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4145. Apr 22 09:02:38 hp-epyc kernel: Call Trace:
  4146. Apr 22 09:02:38 hp-epyc kernel: <TASK>
  4147. Apr 22 09:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4148. Apr 22 09:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4149. Apr 22 09:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4150. Apr 22 09:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4151. Apr 22 09:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4152. Apr 22 09:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4153. Apr 22 09:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4154. Apr 22 09:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4155. Apr 22 09:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4156. Apr 22 09:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4157. Apr 22 09:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4158. Apr 22 09:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4159. Apr 22 09:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  4160. Apr 22 09:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4161. Apr 22 09:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4162. Apr 22 09:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4163. Apr 22 09:02:38 hp-epyc kernel: </TASK>
  4164. Apr 22 09:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4165. Apr 22 09:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4166. Apr 22 09:05:38 hp-epyc kernel: (detected by 0, t=35520987 jiffies, g=1051549, q=52120707)
  4167. Apr 22 09:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4168. Apr 22 09:05:38 hp-epyc kernel: Call Trace:
  4169. Apr 22 09:05:38 hp-epyc kernel: <TASK>
  4170. Apr 22 09:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4171. Apr 22 09:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4172. Apr 22 09:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4173. Apr 22 09:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4174. Apr 22 09:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4175. Apr 22 09:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4176. Apr 22 09:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4177. Apr 22 09:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4178. Apr 22 09:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4179. Apr 22 09:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4180. Apr 22 09:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4181. Apr 22 09:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4182. Apr 22 09:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  4183. Apr 22 09:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4184. Apr 22 09:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4185. Apr 22 09:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4186. Apr 22 09:05:38 hp-epyc kernel: </TASK>
  4187. Apr 22 09:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4188. Apr 22 09:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4189. Apr 22 09:08:38 hp-epyc kernel: (detected by 0, t=35700992 jiffies, g=1051549, q=52190795)
  4190. Apr 22 09:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4191. Apr 22 09:08:38 hp-epyc kernel: Call Trace:
  4192. Apr 22 09:08:38 hp-epyc kernel: <TASK>
  4193. Apr 22 09:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4194. Apr 22 09:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4195. Apr 22 09:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4196. Apr 22 09:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4197. Apr 22 09:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4198. Apr 22 09:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4199. Apr 22 09:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4200. Apr 22 09:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4201. Apr 22 09:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4202. Apr 22 09:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4203. Apr 22 09:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4204. Apr 22 09:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4205. Apr 22 09:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  4206. Apr 22 09:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4207. Apr 22 09:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4208. Apr 22 09:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4209. Apr 22 09:08:38 hp-epyc kernel: </TASK>
  4210. Apr 22 09:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4211. Apr 22 09:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4212. Apr 22 09:11:38 hp-epyc kernel: (detected by 0, t=35880997 jiffies, g=1051549, q=52264071)
  4213. Apr 22 09:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4214. Apr 22 09:11:38 hp-epyc kernel: Call Trace:
  4215. Apr 22 09:11:38 hp-epyc kernel: <TASK>
  4216. Apr 22 09:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4217. Apr 22 09:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4218. Apr 22 09:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4219. Apr 22 09:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4220. Apr 22 09:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4221. Apr 22 09:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4222. Apr 22 09:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4223. Apr 22 09:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4224. Apr 22 09:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4225. Apr 22 09:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4226. Apr 22 09:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4227. Apr 22 09:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4228. Apr 22 09:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  4229. Apr 22 09:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4230. Apr 22 09:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4231. Apr 22 09:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4232. Apr 22 09:11:38 hp-epyc kernel: </TASK>
  4233. Apr 22 09:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4234. Apr 22 09:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4235. Apr 22 09:14:38 hp-epyc kernel: (detected by 0, t=36061002 jiffies, g=1051549, q=52337073)
  4236. Apr 22 09:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4237. Apr 22 09:14:38 hp-epyc kernel: Call Trace:
  4238. Apr 22 09:14:38 hp-epyc kernel: <TASK>
  4239. Apr 22 09:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4240. Apr 22 09:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4241. Apr 22 09:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4242. Apr 22 09:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4243. Apr 22 09:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4244. Apr 22 09:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4245. Apr 22 09:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4246. Apr 22 09:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4247. Apr 22 09:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4248. Apr 22 09:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4249. Apr 22 09:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4250. Apr 22 09:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4251. Apr 22 09:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  4252. Apr 22 09:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4253. Apr 22 09:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4254. Apr 22 09:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4255. Apr 22 09:14:38 hp-epyc kernel: </TASK>
  4256. Apr 22 09:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4257. Apr 22 09:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4258. Apr 22 09:17:38 hp-epyc kernel: (detected by 0, t=36241007 jiffies, g=1051549, q=52407987)
  4259. Apr 22 09:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4260. Apr 22 09:17:38 hp-epyc kernel: Call Trace:
  4261. Apr 22 09:17:38 hp-epyc kernel: <TASK>
  4262. Apr 22 09:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4263. Apr 22 09:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4264. Apr 22 09:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4265. Apr 22 09:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4266. Apr 22 09:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4267. Apr 22 09:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4268. Apr 22 09:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4269. Apr 22 09:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4270. Apr 22 09:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4271. Apr 22 09:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4272. Apr 22 09:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4273. Apr 22 09:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4274. Apr 22 09:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  4275. Apr 22 09:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4276. Apr 22 09:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4277. Apr 22 09:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4278. Apr 22 09:17:38 hp-epyc kernel: </TASK>
  4279. Apr 22 09:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4280. Apr 22 09:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4281. Apr 22 09:20:38 hp-epyc kernel: (detected by 0, t=36421012 jiffies, g=1051549, q=52478136)
  4282. Apr 22 09:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4283. Apr 22 09:20:38 hp-epyc kernel: Call Trace:
  4284. Apr 22 09:20:38 hp-epyc kernel: <TASK>
  4285. Apr 22 09:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4286. Apr 22 09:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4287. Apr 22 09:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4288. Apr 22 09:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4289. Apr 22 09:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4290. Apr 22 09:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4291. Apr 22 09:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4292. Apr 22 09:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4293. Apr 22 09:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4294. Apr 22 09:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4295. Apr 22 09:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4296. Apr 22 09:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4297. Apr 22 09:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  4298. Apr 22 09:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4299. Apr 22 09:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4300. Apr 22 09:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4301. Apr 22 09:20:38 hp-epyc kernel: </TASK>
  4302. Apr 22 09:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4303. Apr 22 09:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4304. Apr 22 09:23:38 hp-epyc kernel: (detected by 0, t=36601017 jiffies, g=1051549, q=52549146)
  4305. Apr 22 09:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4306. Apr 22 09:23:38 hp-epyc kernel: Call Trace:
  4307. Apr 22 09:23:38 hp-epyc kernel: <TASK>
  4308. Apr 22 09:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4309. Apr 22 09:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4310. Apr 22 09:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4311. Apr 22 09:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4312. Apr 22 09:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4313. Apr 22 09:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4314. Apr 22 09:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4315. Apr 22 09:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4316. Apr 22 09:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4317. Apr 22 09:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4318. Apr 22 09:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4319. Apr 22 09:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4320. Apr 22 09:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  4321. Apr 22 09:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4322. Apr 22 09:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4323. Apr 22 09:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4324. Apr 22 09:23:38 hp-epyc kernel: </TASK>
  4325. Apr 22 09:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4326. Apr 22 09:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4327. Apr 22 09:26:38 hp-epyc kernel: (detected by 0, t=36781022 jiffies, g=1051549, q=52619486)
  4328. Apr 22 09:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4329. Apr 22 09:26:38 hp-epyc kernel: Call Trace:
  4330. Apr 22 09:26:38 hp-epyc kernel: <TASK>
  4331. Apr 22 09:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4332. Apr 22 09:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4333. Apr 22 09:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4334. Apr 22 09:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4335. Apr 22 09:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4336. Apr 22 09:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4337. Apr 22 09:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4338. Apr 22 09:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4339. Apr 22 09:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4340. Apr 22 09:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4341. Apr 22 09:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4342. Apr 22 09:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4343. Apr 22 09:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  4344. Apr 22 09:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4345. Apr 22 09:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4346. Apr 22 09:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4347. Apr 22 09:26:38 hp-epyc kernel: </TASK>
  4348. Apr 22 09:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4349. Apr 22 09:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4350. Apr 22 09:29:38 hp-epyc kernel: (detected by 0, t=36961027 jiffies, g=1051549, q=52690285)
  4351. Apr 22 09:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4352. Apr 22 09:29:38 hp-epyc kernel: Call Trace:
  4353. Apr 22 09:29:38 hp-epyc kernel: <TASK>
  4354. Apr 22 09:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4355. Apr 22 09:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4356. Apr 22 09:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4357. Apr 22 09:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4358. Apr 22 09:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4359. Apr 22 09:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4360. Apr 22 09:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4361. Apr 22 09:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4362. Apr 22 09:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4363. Apr 22 09:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4364. Apr 22 09:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4365. Apr 22 09:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4366. Apr 22 09:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  4367. Apr 22 09:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4368. Apr 22 09:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4369. Apr 22 09:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4370. Apr 22 09:29:38 hp-epyc kernel: </TASK>
  4371. Apr 22 09:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4372. Apr 22 09:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4373. Apr 22 09:32:38 hp-epyc kernel: (detected by 0, t=37141032 jiffies, g=1051549, q=52763176)
  4374. Apr 22 09:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4375. Apr 22 09:32:38 hp-epyc kernel: Call Trace:
  4376. Apr 22 09:32:38 hp-epyc kernel: <TASK>
  4377. Apr 22 09:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4378. Apr 22 09:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4379. Apr 22 09:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4380. Apr 22 09:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4381. Apr 22 09:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4382. Apr 22 09:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4383. Apr 22 09:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4384. Apr 22 09:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4385. Apr 22 09:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4386. Apr 22 09:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4387. Apr 22 09:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4388. Apr 22 09:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4389. Apr 22 09:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  4390. Apr 22 09:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4391. Apr 22 09:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4392. Apr 22 09:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4393. Apr 22 09:32:38 hp-epyc kernel: </TASK>
  4394. Apr 22 09:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4395. Apr 22 09:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4396. Apr 22 09:35:38 hp-epyc kernel: (detected by 0, t=37321037 jiffies, g=1051549, q=52833078)
  4397. Apr 22 09:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4398. Apr 22 09:35:38 hp-epyc kernel: Call Trace:
  4399. Apr 22 09:35:38 hp-epyc kernel: <TASK>
  4400. Apr 22 09:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4401. Apr 22 09:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4402. Apr 22 09:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4403. Apr 22 09:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4404. Apr 22 09:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4405. Apr 22 09:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4406. Apr 22 09:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4407. Apr 22 09:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4408. Apr 22 09:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4409. Apr 22 09:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4410. Apr 22 09:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4411. Apr 22 09:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4412. Apr 22 09:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  4413. Apr 22 09:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4414. Apr 22 09:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4415. Apr 22 09:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4416. Apr 22 09:35:38 hp-epyc kernel: </TASK>
  4417. Apr 22 09:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4418. Apr 22 09:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4419. Apr 22 09:38:38 hp-epyc kernel: (detected by 0, t=37501042 jiffies, g=1051549, q=52904252)
  4420. Apr 22 09:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4421. Apr 22 09:38:38 hp-epyc kernel: Call Trace:
  4422. Apr 22 09:38:38 hp-epyc kernel: <TASK>
  4423. Apr 22 09:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4424. Apr 22 09:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4425. Apr 22 09:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4426. Apr 22 09:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4427. Apr 22 09:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4428. Apr 22 09:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4429. Apr 22 09:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4430. Apr 22 09:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4431. Apr 22 09:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4432. Apr 22 09:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4433. Apr 22 09:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4434. Apr 22 09:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4435. Apr 22 09:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  4436. Apr 22 09:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4437. Apr 22 09:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4438. Apr 22 09:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4439. Apr 22 09:38:38 hp-epyc kernel: </TASK>
  4440. Apr 22 09:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4441. Apr 22 09:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4442. Apr 22 09:44:38 hp-epyc kernel: (detected by 53, t=37681047 jiffies, g=1051549, q=52977532)
  4443. Apr 22 09:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4444. Apr 22 09:44:38 hp-epyc kernel: Call Trace:
  4445. Apr 22 09:44:38 hp-epyc kernel: <TASK>
  4446. Apr 22 09:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4447. Apr 22 09:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4448. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4449. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4450. Apr 22 09:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4451. Apr 22 09:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4452. Apr 22 09:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4453. Apr 22 09:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4454. Apr 22 09:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4455. Apr 22 09:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4456. Apr 22 09:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4457. Apr 22 09:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4458. Apr 22 09:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  4459. Apr 22 09:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4460. Apr 22 09:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4461. Apr 22 09:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4462. Apr 22 09:44:38 hp-epyc kernel: </TASK>
  4463. Apr 22 09:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4464. Apr 22 09:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4465. Apr 22 09:44:38 hp-epyc kernel: (detected by 0, t=37861052 jiffies, g=1051549, q=53048735)
  4466. Apr 22 09:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4467. Apr 22 09:44:38 hp-epyc kernel: Call Trace:
  4468. Apr 22 09:44:38 hp-epyc kernel: <TASK>
  4469. Apr 22 09:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4470. Apr 22 09:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4471. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4472. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4473. Apr 22 09:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4474. Apr 22 09:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4475. Apr 22 09:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4476. Apr 22 09:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4477. Apr 22 09:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4478. Apr 22 09:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4479. Apr 22 09:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4480. Apr 22 09:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4481. Apr 22 09:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  4482. Apr 22 09:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4483. Apr 22 09:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4484. Apr 22 09:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4485. Apr 22 09:44:38 hp-epyc kernel: </TASK>
  4486. Apr 22 09:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4487. Apr 22 09:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4488. Apr 22 09:47:38 hp-epyc kernel: (detected by 0, t=38041057 jiffies, g=1051549, q=53117116)
  4489. Apr 22 09:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4490. Apr 22 09:47:38 hp-epyc kernel: Call Trace:
  4491. Apr 22 09:47:38 hp-epyc kernel: <TASK>
  4492. Apr 22 09:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4493. Apr 22 09:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4494. Apr 22 09:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4495. Apr 22 09:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4496. Apr 22 09:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4497. Apr 22 09:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4498. Apr 22 09:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4499. Apr 22 09:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4500. Apr 22 09:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4501. Apr 22 09:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4502. Apr 22 09:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4503. Apr 22 09:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4504. Apr 22 09:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  4505. Apr 22 09:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4506. Apr 22 09:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4507. Apr 22 09:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4508. Apr 22 09:47:38 hp-epyc kernel: </TASK>
  4509. Apr 22 09:49:06 hp-epyc kernel: node-cache invoked oom-killer: gfp_mask=0x1100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=999
  4510. Apr 22 09:49:06 hp-epyc kernel: CPU: 64 PID: 4325 Comm: node-cache Tainted: G OE 5.15.0-1032-realtime #35-Ubuntu
  4511. Apr 22 09:49:06 hp-epyc kernel: Hardware name: Supermicro Super Server/H13SVW-NT, BIOS 1.1b.V1 12/25/2023
  4512. Apr 22 09:49:06 hp-epyc kernel: Call Trace:
  4513. Apr 22 09:49:06 hp-epyc kernel: <TASK>
  4514. Apr 22 09:49:06 hp-epyc kernel: show_stack+0x52/0x5c
  4515. Apr 22 09:49:06 hp-epyc kernel: dump_stack_lvl+0x4a/0x63
  4516. Apr 22 09:49:06 hp-epyc kernel: dump_stack+0x10/0x16
  4517. Apr 22 09:49:06 hp-epyc kernel: dump_header+0x4f/0x207
  4518. Apr 22 09:49:06 hp-epyc kernel: oom_kill_process.cold+0xb/0x10
  4519. Apr 22 09:49:06 hp-epyc kernel: out_of_memory+0xf9/0x2e0
  4520. Apr 22 09:49:06 hp-epyc kernel: mem_cgroup_out_of_memory+0x13f/0x160
  4521. Apr 22 09:49:06 hp-epyc kernel: try_charge_memcg+0x72b/0x7f0
  4522. Apr 22 09:49:06 hp-epyc kernel: __mem_cgroup_charge+0x38/0x100
  4523. Apr 22 09:49:06 hp-epyc kernel: __add_to_page_cache_locked+0x2fe/0x370
  4524. Apr 22 09:49:06 hp-epyc kernel: ? scan_shadow_nodes+0x40/0x40
  4525. Apr 22 09:49:06 hp-epyc kernel: add_to_page_cache_lru+0x4d/0xd0
  4526. Apr 22 09:49:06 hp-epyc kernel: pagecache_get_page+0x1de/0x4d0
  4527. Apr 22 09:49:06 hp-epyc kernel: filemap_fault+0x491/0xad0
  4528. Apr 22 09:49:06 hp-epyc kernel: ? rt_spin_unlock+0x18/0x50
  4529. Apr 22 09:49:06 hp-epyc kernel: __do_fault+0x40/0x130
  4530. Apr 22 09:49:06 hp-epyc kernel: do_read_fault+0xeb/0x160
  4531. Apr 22 09:49:06 hp-epyc kernel: do_fault+0xa2/0x370
  4532. Apr 22 09:49:06 hp-epyc kernel: handle_pte_fault+0x130/0x170
  4533. Apr 22 09:49:06 hp-epyc kernel: __handle_mm_fault+0x17e/0x210
  4534. Apr 22 09:49:06 hp-epyc kernel: handle_mm_fault+0xdd/0x2c0
  4535. Apr 22 09:49:06 hp-epyc kernel: do_user_addr_fault+0x1e4/0x680
  4536. Apr 22 09:49:06 hp-epyc kernel: exc_page_fault+0x7a/0x1c0
  4537. Apr 22 09:49:06 hp-epyc kernel: asm_exc_page_fault+0x27/0x30
  4538. Apr 22 09:49:06 hp-epyc kernel: RIP: 0033:0x456290
  4539. Apr 22 09:49:06 hp-epyc kernel: Code: 89 de 48 89 cf 48 89 c1 48 89 d0 48 89 74 24 50 48 89 8c 24 90 00 00 00 48 89 7c 24 58 48 89 44 24 40 48 8b 94 24 b0 00 00 00 <8b> 1a 48 8b 84 24 b8 00 00 00 e8 01 f7 ff ff 48 39 44 24 48 41 0f
  4540. Apr 22 09:49:06 hp-epyc kernel: RSP: 002b:000000c000909128 EFLAGS: 00010202
  4541. Apr 22 09:49:06 hp-epyc kernel: RAX: 000000000040d904 RBX: 000000000030b24a RCX: 0000000001c73b46
  4542. Apr 22 09:49:06 hp-epyc kernel: RDX: 0000000001fdf208 RSI: 000000000030b24a RDI: 000000000030b24a
  4543. Apr 22 09:49:06 hp-epyc kernel: RBP: 000000c0009091e8 R08: 0000000000000004 R09: 0000000000000000
  4544. Apr 22 09:49:06 hp-epyc kernel: R10: 000000000030f690 R11: 0000000000004444 R12: 000000c0009091a8
  4545. Apr 22 09:49:06 hp-epyc kernel: R13: 0000000000000028 R14: 000000c0000ee000 R15: 00007f631ac2e610
  4546. Apr 22 09:49:06 hp-epyc kernel: </TASK>
  4547. Apr 22 09:49:06 hp-epyc kernel: memory: usage 204800kB, limit 204800kB, failcnt 12429139
  4548. Apr 22 09:49:06 hp-epyc kernel: swap: usage 0kB, limit 9007199254740988kB, failcnt 0
  4549. Apr 22 09:49:06 hp-epyc kernel: Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393a51b_44d3_46c8_b7c9_8c7dc005d512.slice:
  4550. Apr 22 09:49:06 hp-epyc kernel: anon 14385152
  4551. file 499712
  4552. kernel_stack 573440
  4553. pagetables 237568
  4554. percpu 653312
  4555. sock 24576
  4556. shmem 0
  4557. file_mapped 176128
  4558. file_dirty 0
  4559. file_writeback 0
  4560. swapcached 0
  4561. inactive_anon 14376960
  4562. active_anon 8192
  4563. inactive_file 77824
  4564. active_file 0
  4565. unevictable 0
  4566. slab_reclaimable 134221656
  4567. slab_unreclaimable 59029112
  4568. slab 193250768
  4569. workingset_refault_anon 0
  4570. workingset_refault_file 21683701
  4571. workingset_activate_anon 0
  4572. workingset_activate_file 1219604
  4573. workingset_restore_anon 0
  4574. workingset_restore_file 520219
  4575. workingset_nodereclaim 0
  4576. pgfault 2237274
  4577. pgmajfault 902669
  4578. pgrefill 5830056
  4579. pgscan 109842130
  4580. pgsteal 21691144
  4581. pgactivate 3769869
  4582. pgdeactivate 4989506
  4583. pglazyfree 0
  4584. pglazyfreed 0
  4585. Apr 22 09:49:06 hp-epyc kernel: Tasks state (memory values in pages):
  4586. Apr 22 09:49:06 hp-epyc kernel: [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
  4587. Apr 22 09:49:06 hp-epyc kernel: [ 4242] 65535 4242 257 1 28672 0 -998 pause
  4588. Apr 22 09:49:06 hp-epyc kernel: [ 4273] 0 4273 185855 3345 200704 0 999 node-cache
  4589. Apr 22 09:49:06 hp-epyc kernel: [1295014] 0 1295014 857 40 45056 0 999 iptables
  4590. Apr 22 09:49:06 hp-epyc kernel: oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=cri-containerd-9eb805372aad7952728a0696891c15407e557a984e4bcb6a1384af5921c674bb.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393a51b_44d3_46c8_b7c9_8c7dc005d512.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393a51b_44d3_46c8_b7c9_8c7dc005d512.slice/cri-containerd-9eb805372aad7952728a0696891c15407e557a984e4bcb6a1384af5921c674bb.scope,task=node-cache,pid=4273,uid=0
  4591. Apr 22 09:49:06 hp-epyc kernel: Memory cgroup out of memory: Killed process 4273 (node-cache) total-vm:743420kB, anon-rss:13380kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:196kB oom_score_adj:999
  4592. Apr 22 09:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4593. Apr 22 09:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4594. Apr 22 09:50:38 hp-epyc kernel: (detected by 0, t=38221062 jiffies, g=1051549, q=53187805)
  4595. Apr 22 09:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4596. Apr 22 09:50:38 hp-epyc kernel: Call Trace:
  4597. Apr 22 09:50:38 hp-epyc kernel: <TASK>
  4598. Apr 22 09:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4599. Apr 22 09:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4600. Apr 22 09:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4601. Apr 22 09:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4602. Apr 22 09:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4603. Apr 22 09:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4604. Apr 22 09:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4605. Apr 22 09:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4606. Apr 22 09:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4607. Apr 22 09:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4608. Apr 22 09:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4609. Apr 22 09:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4610. Apr 22 09:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  4611. Apr 22 09:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4612. Apr 22 09:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4613. Apr 22 09:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4614. Apr 22 09:50:38 hp-epyc kernel: </TASK>
  4615. Apr 22 09:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4616. Apr 22 09:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4617. Apr 22 09:53:38 hp-epyc kernel: (detected by 0, t=38401067 jiffies, g=1051549, q=53253656)
  4618. Apr 22 09:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4619. Apr 22 09:53:38 hp-epyc kernel: Call Trace:
  4620. Apr 22 09:53:38 hp-epyc kernel: <TASK>
  4621. Apr 22 09:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4622. Apr 22 09:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4623. Apr 22 09:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4624. Apr 22 09:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4625. Apr 22 09:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4626. Apr 22 09:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4627. Apr 22 09:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4628. Apr 22 09:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4629. Apr 22 09:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4630. Apr 22 09:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4631. Apr 22 09:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4632. Apr 22 09:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4633. Apr 22 09:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  4634. Apr 22 09:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4635. Apr 22 09:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4636. Apr 22 09:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4637. Apr 22 09:53:38 hp-epyc kernel: </TASK>
  4638. Apr 22 09:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4639. Apr 22 09:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4640. Apr 22 09:56:38 hp-epyc kernel: (detected by 0, t=38581072 jiffies, g=1051549, q=53320628)
  4641. Apr 22 09:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4642. Apr 22 09:56:38 hp-epyc kernel: Call Trace:
  4643. Apr 22 09:56:38 hp-epyc kernel: <TASK>
  4644. Apr 22 09:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4645. Apr 22 09:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4646. Apr 22 09:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4647. Apr 22 09:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4648. Apr 22 09:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4649. Apr 22 09:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4650. Apr 22 09:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4651. Apr 22 09:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4652. Apr 22 09:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4653. Apr 22 09:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4654. Apr 22 09:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4655. Apr 22 09:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4656. Apr 22 09:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  4657. Apr 22 09:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4658. Apr 22 09:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4659. Apr 22 09:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4660. Apr 22 09:56:38 hp-epyc kernel: </TASK>
  4661. Apr 22 09:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4662. Apr 22 09:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4663. Apr 22 09:59:38 hp-epyc kernel: (detected by 0, t=38761077 jiffies, g=1051549, q=53388556)
  4664. Apr 22 09:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4665. Apr 22 09:59:38 hp-epyc kernel: Call Trace:
  4666. Apr 22 09:59:38 hp-epyc kernel: <TASK>
  4667. Apr 22 09:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4668. Apr 22 09:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4669. Apr 22 09:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4670. Apr 22 09:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4671. Apr 22 09:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4672. Apr 22 09:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4673. Apr 22 09:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4674. Apr 22 09:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4675. Apr 22 09:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4676. Apr 22 09:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4677. Apr 22 09:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4678. Apr 22 09:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4679. Apr 22 09:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  4680. Apr 22 09:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4681. Apr 22 09:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4682. Apr 22 09:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4683. Apr 22 09:59:38 hp-epyc kernel: </TASK>
  4684. Apr 22 10:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4685. Apr 22 10:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4686. Apr 22 10:02:38 hp-epyc kernel: (detected by 0, t=38941082 jiffies, g=1051549, q=53458277)
  4687. Apr 22 10:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4688. Apr 22 10:02:38 hp-epyc kernel: Call Trace:
  4689. Apr 22 10:02:38 hp-epyc kernel: <TASK>
  4690. Apr 22 10:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4691. Apr 22 10:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4692. Apr 22 10:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4693. Apr 22 10:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4694. Apr 22 10:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4695. Apr 22 10:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4696. Apr 22 10:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4697. Apr 22 10:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4698. Apr 22 10:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4699. Apr 22 10:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4700. Apr 22 10:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4701. Apr 22 10:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4702. Apr 22 10:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  4703. Apr 22 10:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4704. Apr 22 10:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4705. Apr 22 10:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4706. Apr 22 10:02:38 hp-epyc kernel: </TASK>
  4707. Apr 22 10:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4708. Apr 22 10:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4709. Apr 22 10:05:38 hp-epyc kernel: (detected by 0, t=39121087 jiffies, g=1051549, q=53523485)
  4710. Apr 22 10:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4711. Apr 22 10:05:38 hp-epyc kernel: Call Trace:
  4712. Apr 22 10:05:38 hp-epyc kernel: <TASK>
  4713. Apr 22 10:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4714. Apr 22 10:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4715. Apr 22 10:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4716. Apr 22 10:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4717. Apr 22 10:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4718. Apr 22 10:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4719. Apr 22 10:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4720. Apr 22 10:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4721. Apr 22 10:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4722. Apr 22 10:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4723. Apr 22 10:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4724. Apr 22 10:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4725. Apr 22 10:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  4726. Apr 22 10:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4727. Apr 22 10:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4728. Apr 22 10:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4729. Apr 22 10:05:38 hp-epyc kernel: </TASK>
  4730. Apr 22 10:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4731. Apr 22 10:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4732. Apr 22 10:08:38 hp-epyc kernel: (detected by 0, t=39301092 jiffies, g=1051549, q=53588607)
  4733. Apr 22 10:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4734. Apr 22 10:08:38 hp-epyc kernel: Call Trace:
  4735. Apr 22 10:08:38 hp-epyc kernel: <TASK>
  4736. Apr 22 10:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4737. Apr 22 10:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4738. Apr 22 10:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4739. Apr 22 10:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4740. Apr 22 10:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4741. Apr 22 10:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4742. Apr 22 10:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4743. Apr 22 10:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4744. Apr 22 10:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4745. Apr 22 10:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4746. Apr 22 10:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4747. Apr 22 10:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4748. Apr 22 10:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  4749. Apr 22 10:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4750. Apr 22 10:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4751. Apr 22 10:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4752. Apr 22 10:08:38 hp-epyc kernel: </TASK>
  4753. Apr 22 10:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4754. Apr 22 10:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4755. Apr 22 10:11:38 hp-epyc kernel: (detected by 0, t=39481097 jiffies, g=1051549, q=53657187)
  4756. Apr 22 10:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4757. Apr 22 10:11:38 hp-epyc kernel: Call Trace:
  4758. Apr 22 10:11:38 hp-epyc kernel: <TASK>
  4759. Apr 22 10:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4760. Apr 22 10:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4761. Apr 22 10:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4762. Apr 22 10:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4763. Apr 22 10:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4764. Apr 22 10:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4765. Apr 22 10:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4766. Apr 22 10:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4767. Apr 22 10:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4768. Apr 22 10:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4769. Apr 22 10:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4770. Apr 22 10:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4771. Apr 22 10:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  4772. Apr 22 10:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4773. Apr 22 10:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4774. Apr 22 10:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4775. Apr 22 10:11:38 hp-epyc kernel: </TASK>
  4776. Apr 22 10:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4777. Apr 22 10:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4778. Apr 22 10:17:38 hp-epyc kernel: (detected by 53, t=39661102 jiffies, g=1051549, q=53724327)
  4779. Apr 22 10:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4780. Apr 22 10:17:38 hp-epyc kernel: Call Trace:
  4781. Apr 22 10:17:38 hp-epyc kernel: <TASK>
  4782. Apr 22 10:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4783. Apr 22 10:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4784. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4785. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4786. Apr 22 10:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4787. Apr 22 10:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4788. Apr 22 10:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4789. Apr 22 10:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4790. Apr 22 10:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4791. Apr 22 10:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4792. Apr 22 10:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4793. Apr 22 10:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4794. Apr 22 10:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  4795. Apr 22 10:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4796. Apr 22 10:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4797. Apr 22 10:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4798. Apr 22 10:17:38 hp-epyc kernel: </TASK>
  4799. Apr 22 10:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4800. Apr 22 10:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4801. Apr 22 10:17:38 hp-epyc kernel: (detected by 0, t=39841107 jiffies, g=1051549, q=53794654)
  4802. Apr 22 10:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4803. Apr 22 10:17:38 hp-epyc kernel: Call Trace:
  4804. Apr 22 10:17:38 hp-epyc kernel: <TASK>
  4805. Apr 22 10:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4806. Apr 22 10:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4807. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4808. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4809. Apr 22 10:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4810. Apr 22 10:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4811. Apr 22 10:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4812. Apr 22 10:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4813. Apr 22 10:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4814. Apr 22 10:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4815. Apr 22 10:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4816. Apr 22 10:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4817. Apr 22 10:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  4818. Apr 22 10:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4819. Apr 22 10:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4820. Apr 22 10:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4821. Apr 22 10:17:38 hp-epyc kernel: </TASK>
  4822. Apr 22 10:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4823. Apr 22 10:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4824. Apr 22 10:20:38 hp-epyc kernel: (detected by 0, t=40021112 jiffies, g=1051549, q=53861410)
  4825. Apr 22 10:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4826. Apr 22 10:20:38 hp-epyc kernel: Call Trace:
  4827. Apr 22 10:20:38 hp-epyc kernel: <TASK>
  4828. Apr 22 10:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4829. Apr 22 10:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4830. Apr 22 10:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4831. Apr 22 10:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4832. Apr 22 10:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4833. Apr 22 10:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4834. Apr 22 10:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4835. Apr 22 10:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4836. Apr 22 10:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4837. Apr 22 10:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4838. Apr 22 10:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4839. Apr 22 10:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4840. Apr 22 10:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  4841. Apr 22 10:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4842. Apr 22 10:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4843. Apr 22 10:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4844. Apr 22 10:20:38 hp-epyc kernel: </TASK>
  4845. Apr 22 10:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4846. Apr 22 10:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4847. Apr 22 10:23:38 hp-epyc kernel: (detected by 0, t=40201117 jiffies, g=1051549, q=53929005)
  4848. Apr 22 10:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4849. Apr 22 10:23:38 hp-epyc kernel: Call Trace:
  4850. Apr 22 10:23:38 hp-epyc kernel: <TASK>
  4851. Apr 22 10:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4852. Apr 22 10:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4853. Apr 22 10:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4854. Apr 22 10:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4855. Apr 22 10:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4856. Apr 22 10:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4857. Apr 22 10:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4858. Apr 22 10:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4859. Apr 22 10:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4860. Apr 22 10:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4861. Apr 22 10:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4862. Apr 22 10:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4863. Apr 22 10:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  4864. Apr 22 10:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4865. Apr 22 10:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4866. Apr 22 10:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4867. Apr 22 10:23:38 hp-epyc kernel: </TASK>
  4868. Apr 22 10:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4869. Apr 22 10:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4870. Apr 22 10:26:38 hp-epyc kernel: (detected by 0, t=40381122 jiffies, g=1051549, q=53995897)
  4871. Apr 22 10:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4872. Apr 22 10:26:38 hp-epyc kernel: Call Trace:
  4873. Apr 22 10:26:38 hp-epyc kernel: <TASK>
  4874. Apr 22 10:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4875. Apr 22 10:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4876. Apr 22 10:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4877. Apr 22 10:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4878. Apr 22 10:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4879. Apr 22 10:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4880. Apr 22 10:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4881. Apr 22 10:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4882. Apr 22 10:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4883. Apr 22 10:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4884. Apr 22 10:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4885. Apr 22 10:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4886. Apr 22 10:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  4887. Apr 22 10:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4888. Apr 22 10:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4889. Apr 22 10:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4890. Apr 22 10:26:38 hp-epyc kernel: </TASK>
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!