Advertisement
Guest User

Untitled

a guest
Apr 22nd, 2024
64
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 325.15 KB | None | 0 0
  1. Apr 22 00:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2. Apr 22 00:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3. Apr 22 00:08:37 hp-epyc kernel: (detected by 53, t=2940082 jiffies, g=1051549, q=30752212)
  4. Apr 22 00:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  5. Apr 22 00:08:37 hp-epyc kernel: Call Trace:
  6. Apr 22 00:08:37 hp-epyc kernel: <TASK>
  7. Apr 22 00:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  8. Apr 22 00:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  9. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  10. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  11. Apr 22 00:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  12. Apr 22 00:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  13. Apr 22 00:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  14. Apr 22 00:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  15. Apr 22 00:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  16. Apr 22 00:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  17. Apr 22 00:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  18. Apr 22 00:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  19. Apr 22 00:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  20. Apr 22 00:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  21. Apr 22 00:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  22. Apr 22 00:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  23. Apr 22 00:08:37 hp-epyc kernel: </TASK>
  24. Apr 22 00:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  25. Apr 22 00:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  26. Apr 22 00:08:37 hp-epyc kernel: (detected by 53, t=3120087 jiffies, g=1051549, q=30989147)
  27. Apr 22 00:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  28. Apr 22 00:08:37 hp-epyc kernel: Call Trace:
  29. Apr 22 00:08:37 hp-epyc kernel: <TASK>
  30. Apr 22 00:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  31. Apr 22 00:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  32. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  33. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  34. Apr 22 00:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  35. Apr 22 00:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  36. Apr 22 00:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  37. Apr 22 00:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  38. Apr 22 00:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  39. Apr 22 00:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  40. Apr 22 00:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  41. Apr 22 00:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  42. Apr 22 00:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  43. Apr 22 00:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  44. Apr 22 00:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  45. Apr 22 00:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  46. Apr 22 00:08:37 hp-epyc kernel: </TASK>
  47. Apr 22 00:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  48. Apr 22 00:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  49. Apr 22 00:08:37 hp-epyc kernel: (detected by 0, t=3300092 jiffies, g=1051549, q=31246683)
  50. Apr 22 00:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  51. Apr 22 00:08:37 hp-epyc kernel: Call Trace:
  52. Apr 22 00:08:37 hp-epyc kernel: <TASK>
  53. Apr 22 00:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  54. Apr 22 00:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  55. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  56. Apr 22 00:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  57. Apr 22 00:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  58. Apr 22 00:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  59. Apr 22 00:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  60. Apr 22 00:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  61. Apr 22 00:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  62. Apr 22 00:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  63. Apr 22 00:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  64. Apr 22 00:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  65. Apr 22 00:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  66. Apr 22 00:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  67. Apr 22 00:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  68. Apr 22 00:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  69. Apr 22 00:08:37 hp-epyc kernel: </TASK>
  70. Apr 22 00:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  71. Apr 22 00:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  72. Apr 22 00:14:37 hp-epyc kernel: (detected by 53, t=3480097 jiffies, g=1051549, q=31484294)
  73. Apr 22 00:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  74. Apr 22 00:14:37 hp-epyc kernel: Call Trace:
  75. Apr 22 00:14:37 hp-epyc kernel: <TASK>
  76. Apr 22 00:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  77. Apr 22 00:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  78. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  79. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  80. Apr 22 00:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  81. Apr 22 00:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  82. Apr 22 00:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  83. Apr 22 00:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  84. Apr 22 00:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  85. Apr 22 00:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  86. Apr 22 00:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  87. Apr 22 00:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  88. Apr 22 00:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  89. Apr 22 00:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  90. Apr 22 00:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  91. Apr 22 00:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  92. Apr 22 00:14:37 hp-epyc kernel: </TASK>
  93. Apr 22 00:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  94. Apr 22 00:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  95. Apr 22 00:14:37 hp-epyc kernel: (detected by 0, t=3660102 jiffies, g=1051549, q=31714568)
  96. Apr 22 00:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  97. Apr 22 00:14:37 hp-epyc kernel: Call Trace:
  98. Apr 22 00:14:37 hp-epyc kernel: <TASK>
  99. Apr 22 00:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  100. Apr 22 00:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  101. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  102. Apr 22 00:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  103. Apr 22 00:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  104. Apr 22 00:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  105. Apr 22 00:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  106. Apr 22 00:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  107. Apr 22 00:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  108. Apr 22 00:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  109. Apr 22 00:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  110. Apr 22 00:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  111. Apr 22 00:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  112. Apr 22 00:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  113. Apr 22 00:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  114. Apr 22 00:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  115. Apr 22 00:14:37 hp-epyc kernel: </TASK>
  116. Apr 22 00:17:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  117. Apr 22 00:17:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  118. Apr 22 00:17:37 hp-epyc kernel: (detected by 0, t=3840107 jiffies, g=1051549, q=31964421)
  119. Apr 22 00:17:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  120. Apr 22 00:17:37 hp-epyc kernel: Call Trace:
  121. Apr 22 00:17:37 hp-epyc kernel: <TASK>
  122. Apr 22 00:17:37 hp-epyc kernel: __schedule+0x238/0x5e0
  123. Apr 22 00:17:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  124. Apr 22 00:17:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  125. Apr 22 00:17:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  126. Apr 22 00:17:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  127. Apr 22 00:17:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  128. Apr 22 00:17:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  129. Apr 22 00:17:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  130. Apr 22 00:17:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  131. Apr 22 00:17:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  132. Apr 22 00:17:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  133. Apr 22 00:17:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  134. Apr 22 00:17:37 hp-epyc kernel: kthread+0x191/0x1b0
  135. Apr 22 00:17:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  136. Apr 22 00:17:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  137. Apr 22 00:17:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  138. Apr 22 00:17:37 hp-epyc kernel: </TASK>
  139. Apr 22 00:23:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  140. Apr 22 00:23:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  141. Apr 22 00:23:37 hp-epyc kernel: (detected by 53, t=4020112 jiffies, g=1051549, q=32196901)
  142. Apr 22 00:23:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  143. Apr 22 00:23:37 hp-epyc kernel: Call Trace:
  144. Apr 22 00:23:37 hp-epyc kernel: <TASK>
  145. Apr 22 00:23:37 hp-epyc kernel: __schedule+0x238/0x5e0
  146. Apr 22 00:23:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  147. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  148. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  149. Apr 22 00:23:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  150. Apr 22 00:23:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  151. Apr 22 00:23:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  152. Apr 22 00:23:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  153. Apr 22 00:23:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  154. Apr 22 00:23:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  155. Apr 22 00:23:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  156. Apr 22 00:23:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  157. Apr 22 00:23:37 hp-epyc kernel: kthread+0x191/0x1b0
  158. Apr 22 00:23:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  159. Apr 22 00:23:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  160. Apr 22 00:23:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  161. Apr 22 00:23:37 hp-epyc kernel: </TASK>
  162. Apr 22 00:23:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  163. Apr 22 00:23:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  164. Apr 22 00:23:37 hp-epyc kernel: (detected by 0, t=4200117 jiffies, g=1051549, q=32420343)
  165. Apr 22 00:23:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  166. Apr 22 00:23:37 hp-epyc kernel: Call Trace:
  167. Apr 22 00:23:37 hp-epyc kernel: <TASK>
  168. Apr 22 00:23:37 hp-epyc kernel: __schedule+0x238/0x5e0
  169. Apr 22 00:23:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  170. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  171. Apr 22 00:23:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  172. Apr 22 00:23:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  173. Apr 22 00:23:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  174. Apr 22 00:23:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  175. Apr 22 00:23:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  176. Apr 22 00:23:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  177. Apr 22 00:23:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  178. Apr 22 00:23:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  179. Apr 22 00:23:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  180. Apr 22 00:23:37 hp-epyc kernel: kthread+0x191/0x1b0
  181. Apr 22 00:23:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  182. Apr 22 00:23:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  183. Apr 22 00:23:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  184. Apr 22 00:23:37 hp-epyc kernel: </TASK>
  185. Apr 22 00:26:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  186. Apr 22 00:26:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  187. Apr 22 00:26:37 hp-epyc kernel: (detected by 0, t=4380122 jiffies, g=1051549, q=32626777)
  188. Apr 22 00:26:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  189. Apr 22 00:26:37 hp-epyc kernel: Call Trace:
  190. Apr 22 00:26:37 hp-epyc kernel: <TASK>
  191. Apr 22 00:26:37 hp-epyc kernel: __schedule+0x238/0x5e0
  192. Apr 22 00:26:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  193. Apr 22 00:26:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  194. Apr 22 00:26:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  195. Apr 22 00:26:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  196. Apr 22 00:26:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  197. Apr 22 00:26:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  198. Apr 22 00:26:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  199. Apr 22 00:26:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  200. Apr 22 00:26:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  201. Apr 22 00:26:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  202. Apr 22 00:26:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  203. Apr 22 00:26:37 hp-epyc kernel: kthread+0x191/0x1b0
  204. Apr 22 00:26:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  205. Apr 22 00:26:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  206. Apr 22 00:26:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  207. Apr 22 00:26:37 hp-epyc kernel: </TASK>
  208. Apr 22 00:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  209. Apr 22 00:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  210. Apr 22 00:35:37 hp-epyc kernel: (detected by 53, t=4560127 jiffies, g=1051549, q=32835543)
  211. Apr 22 00:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  212. Apr 22 00:35:37 hp-epyc kernel: Call Trace:
  213. Apr 22 00:35:37 hp-epyc kernel: <TASK>
  214. Apr 22 00:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  215. Apr 22 00:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  216. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  217. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  218. Apr 22 00:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  219. Apr 22 00:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  220. Apr 22 00:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  221. Apr 22 00:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  222. Apr 22 00:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  223. Apr 22 00:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  224. Apr 22 00:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  225. Apr 22 00:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  226. Apr 22 00:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  227. Apr 22 00:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  228. Apr 22 00:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  229. Apr 22 00:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  230. Apr 22 00:35:37 hp-epyc kernel: </TASK>
  231. Apr 22 00:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  232. Apr 22 00:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  233. Apr 22 00:35:37 hp-epyc kernel: (detected by 53, t=4740132 jiffies, g=1051549, q=33046636)
  234. Apr 22 00:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  235. Apr 22 00:35:37 hp-epyc kernel: Call Trace:
  236. Apr 22 00:35:37 hp-epyc kernel: <TASK>
  237. Apr 22 00:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  238. Apr 22 00:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  239. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  240. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  241. Apr 22 00:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  242. Apr 22 00:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  243. Apr 22 00:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  244. Apr 22 00:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  245. Apr 22 00:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  246. Apr 22 00:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  247. Apr 22 00:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  248. Apr 22 00:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  249. Apr 22 00:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  250. Apr 22 00:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  251. Apr 22 00:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  252. Apr 22 00:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  253. Apr 22 00:35:37 hp-epyc kernel: </TASK>
  254. Apr 22 00:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  255. Apr 22 00:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  256. Apr 22 00:35:37 hp-epyc kernel: (detected by 0, t=4920137 jiffies, g=1051549, q=33238458)
  257. Apr 22 00:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  258. Apr 22 00:35:37 hp-epyc kernel: Call Trace:
  259. Apr 22 00:35:37 hp-epyc kernel: <TASK>
  260. Apr 22 00:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  261. Apr 22 00:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  262. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  263. Apr 22 00:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  264. Apr 22 00:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  265. Apr 22 00:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  266. Apr 22 00:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  267. Apr 22 00:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  268. Apr 22 00:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  269. Apr 22 00:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  270. Apr 22 00:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  271. Apr 22 00:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  272. Apr 22 00:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  273. Apr 22 00:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  274. Apr 22 00:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  275. Apr 22 00:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  276. Apr 22 00:35:37 hp-epyc kernel: </TASK>
  277. Apr 22 00:41:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  278. Apr 22 00:41:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  279. Apr 22 00:41:37 hp-epyc kernel: (detected by 53, t=5100142 jiffies, g=1051549, q=33447572)
  280. Apr 22 00:41:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  281. Apr 22 00:41:37 hp-epyc kernel: Call Trace:
  282. Apr 22 00:41:37 hp-epyc kernel: <TASK>
  283. Apr 22 00:41:37 hp-epyc kernel: __schedule+0x238/0x5e0
  284. Apr 22 00:41:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  285. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  286. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  287. Apr 22 00:41:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  288. Apr 22 00:41:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  289. Apr 22 00:41:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  290. Apr 22 00:41:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  291. Apr 22 00:41:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  292. Apr 22 00:41:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  293. Apr 22 00:41:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  294. Apr 22 00:41:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  295. Apr 22 00:41:37 hp-epyc kernel: kthread+0x191/0x1b0
  296. Apr 22 00:41:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  297. Apr 22 00:41:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  298. Apr 22 00:41:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  299. Apr 22 00:41:37 hp-epyc kernel: </TASK>
  300. Apr 22 00:41:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  301. Apr 22 00:41:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  302. Apr 22 00:41:37 hp-epyc kernel: (detected by 0, t=5280147 jiffies, g=1051549, q=33701577)
  303. Apr 22 00:41:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  304. Apr 22 00:41:37 hp-epyc kernel: Call Trace:
  305. Apr 22 00:41:37 hp-epyc kernel: <TASK>
  306. Apr 22 00:41:37 hp-epyc kernel: __schedule+0x238/0x5e0
  307. Apr 22 00:41:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  308. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  309. Apr 22 00:41:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  310. Apr 22 00:41:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  311. Apr 22 00:41:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  312. Apr 22 00:41:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  313. Apr 22 00:41:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  314. Apr 22 00:41:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  315. Apr 22 00:41:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  316. Apr 22 00:41:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  317. Apr 22 00:41:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  318. Apr 22 00:41:37 hp-epyc kernel: kthread+0x191/0x1b0
  319. Apr 22 00:41:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  320. Apr 22 00:41:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  321. Apr 22 00:41:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  322. Apr 22 00:41:37 hp-epyc kernel: </TASK>
  323. Apr 22 00:44:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  324. Apr 22 00:44:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  325. Apr 22 00:44:37 hp-epyc kernel: (detected by 0, t=5460152 jiffies, g=1051549, q=33937355)
  326. Apr 22 00:44:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  327. Apr 22 00:44:37 hp-epyc kernel: Call Trace:
  328. Apr 22 00:44:37 hp-epyc kernel: <TASK>
  329. Apr 22 00:44:37 hp-epyc kernel: __schedule+0x238/0x5e0
  330. Apr 22 00:44:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  331. Apr 22 00:44:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  332. Apr 22 00:44:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  333. Apr 22 00:44:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  334. Apr 22 00:44:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  335. Apr 22 00:44:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  336. Apr 22 00:44:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  337. Apr 22 00:44:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  338. Apr 22 00:44:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  339. Apr 22 00:44:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  340. Apr 22 00:44:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  341. Apr 22 00:44:37 hp-epyc kernel: kthread+0x191/0x1b0
  342. Apr 22 00:44:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  343. Apr 22 00:44:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  344. Apr 22 00:44:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  345. Apr 22 00:44:37 hp-epyc kernel: </TASK>
  346. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  347. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  348. Apr 22 00:56:37 hp-epyc kernel: (detected by 53, t=5640157 jiffies, g=1051549, q=34176171)
  349. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  350. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  351. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  352. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  353. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  354. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  355. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  356. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  357. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  358. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  359. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  360. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  361. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  362. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  363. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  364. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  365. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  366. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  367. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  368. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  369. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  370. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  371. Apr 22 00:56:37 hp-epyc kernel: (detected by 53, t=5820162 jiffies, g=1051549, q=34420493)
  372. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  373. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  374. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  375. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  376. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  377. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  378. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  379. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  380. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  381. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  382. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  383. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  384. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  385. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  386. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  387. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  388. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  389. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  390. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  391. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  392. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  393. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  394. Apr 22 00:56:37 hp-epyc kernel: (detected by 53, t=6000167 jiffies, g=1051549, q=34635233)
  395. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  396. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  397. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  398. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  399. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  400. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  401. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  402. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  403. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  404. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  405. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  406. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  407. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  408. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  409. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  410. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  411. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  412. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  413. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  414. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  415. Apr 22 00:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  416. Apr 22 00:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  417. Apr 22 00:56:37 hp-epyc kernel: (detected by 0, t=6180172 jiffies, g=1051549, q=34862643)
  418. Apr 22 00:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  419. Apr 22 00:56:37 hp-epyc kernel: Call Trace:
  420. Apr 22 00:56:37 hp-epyc kernel: <TASK>
  421. Apr 22 00:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  422. Apr 22 00:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  423. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  424. Apr 22 00:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  425. Apr 22 00:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  426. Apr 22 00:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  427. Apr 22 00:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  428. Apr 22 00:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  429. Apr 22 00:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  430. Apr 22 00:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  431. Apr 22 00:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  432. Apr 22 00:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  433. Apr 22 00:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  434. Apr 22 00:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  435. Apr 22 00:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  436. Apr 22 00:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  437. Apr 22 00:56:37 hp-epyc kernel: </TASK>
  438. Apr 22 01:02:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  439. Apr 22 01:02:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  440. Apr 22 01:02:37 hp-epyc kernel: (detected by 53, t=6360177 jiffies, g=1051549, q=35066406)
  441. Apr 22 01:02:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  442. Apr 22 01:02:37 hp-epyc kernel: Call Trace:
  443. Apr 22 01:02:37 hp-epyc kernel: <TASK>
  444. Apr 22 01:02:37 hp-epyc kernel: __schedule+0x238/0x5e0
  445. Apr 22 01:02:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  446. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  447. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  448. Apr 22 01:02:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  449. Apr 22 01:02:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  450. Apr 22 01:02:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  451. Apr 22 01:02:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  452. Apr 22 01:02:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  453. Apr 22 01:02:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  454. Apr 22 01:02:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  455. Apr 22 01:02:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  456. Apr 22 01:02:37 hp-epyc kernel: kthread+0x191/0x1b0
  457. Apr 22 01:02:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  458. Apr 22 01:02:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  459. Apr 22 01:02:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  460. Apr 22 01:02:37 hp-epyc kernel: </TASK>
  461. Apr 22 01:02:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  462. Apr 22 01:02:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  463. Apr 22 01:02:37 hp-epyc kernel: (detected by 0, t=6540182 jiffies, g=1051549, q=35287503)
  464. Apr 22 01:02:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  465. Apr 22 01:02:37 hp-epyc kernel: Call Trace:
  466. Apr 22 01:02:37 hp-epyc kernel: <TASK>
  467. Apr 22 01:02:37 hp-epyc kernel: __schedule+0x238/0x5e0
  468. Apr 22 01:02:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  469. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  470. Apr 22 01:02:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  471. Apr 22 01:02:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  472. Apr 22 01:02:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  473. Apr 22 01:02:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  474. Apr 22 01:02:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  475. Apr 22 01:02:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  476. Apr 22 01:02:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  477. Apr 22 01:02:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  478. Apr 22 01:02:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  479. Apr 22 01:02:37 hp-epyc kernel: kthread+0x191/0x1b0
  480. Apr 22 01:02:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  481. Apr 22 01:02:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  482. Apr 22 01:02:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  483. Apr 22 01:02:37 hp-epyc kernel: </TASK>
  484. Apr 22 01:05:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  485. Apr 22 01:05:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  486. Apr 22 01:05:37 hp-epyc kernel: (detected by 0, t=6720187 jiffies, g=1051549, q=35506516)
  487. Apr 22 01:05:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  488. Apr 22 01:05:37 hp-epyc kernel: Call Trace:
  489. Apr 22 01:05:37 hp-epyc kernel: <TASK>
  490. Apr 22 01:05:37 hp-epyc kernel: __schedule+0x238/0x5e0
  491. Apr 22 01:05:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  492. Apr 22 01:05:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  493. Apr 22 01:05:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  494. Apr 22 01:05:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  495. Apr 22 01:05:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  496. Apr 22 01:05:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  497. Apr 22 01:05:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  498. Apr 22 01:05:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  499. Apr 22 01:05:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  500. Apr 22 01:05:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  501. Apr 22 01:05:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  502. Apr 22 01:05:37 hp-epyc kernel: kthread+0x191/0x1b0
  503. Apr 22 01:05:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  504. Apr 22 01:05:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  505. Apr 22 01:05:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  506. Apr 22 01:05:37 hp-epyc kernel: </TASK>
  507. Apr 22 01:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  508. Apr 22 01:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  509. Apr 22 01:14:37 hp-epyc kernel: (detected by 53, t=6900192 jiffies, g=1051549, q=35708638)
  510. Apr 22 01:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  511. Apr 22 01:14:37 hp-epyc kernel: Call Trace:
  512. Apr 22 01:14:37 hp-epyc kernel: <TASK>
  513. Apr 22 01:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  514. Apr 22 01:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  515. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  516. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  517. Apr 22 01:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  518. Apr 22 01:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  519. Apr 22 01:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  520. Apr 22 01:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  521. Apr 22 01:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  522. Apr 22 01:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  523. Apr 22 01:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  524. Apr 22 01:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  525. Apr 22 01:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  526. Apr 22 01:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  527. Apr 22 01:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  528. Apr 22 01:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  529. Apr 22 01:14:37 hp-epyc kernel: </TASK>
  530. Apr 22 01:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  531. Apr 22 01:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  532. Apr 22 01:14:37 hp-epyc kernel: (detected by 53, t=7080197 jiffies, g=1051549, q=35909647)
  533. Apr 22 01:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  534. Apr 22 01:14:37 hp-epyc kernel: Call Trace:
  535. Apr 22 01:14:37 hp-epyc kernel: <TASK>
  536. Apr 22 01:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  537. Apr 22 01:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  538. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  539. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  540. Apr 22 01:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  541. Apr 22 01:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  542. Apr 22 01:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  543. Apr 22 01:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  544. Apr 22 01:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  545. Apr 22 01:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  546. Apr 22 01:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  547. Apr 22 01:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  548. Apr 22 01:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  549. Apr 22 01:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  550. Apr 22 01:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  551. Apr 22 01:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  552. Apr 22 01:14:37 hp-epyc kernel: </TASK>
  553. Apr 22 01:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  554. Apr 22 01:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  555. Apr 22 01:14:37 hp-epyc kernel: (detected by 0, t=7260202 jiffies, g=1051549, q=36145235)
  556. Apr 22 01:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  557. Apr 22 01:14:37 hp-epyc kernel: Call Trace:
  558. Apr 22 01:14:37 hp-epyc kernel: <TASK>
  559. Apr 22 01:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  560. Apr 22 01:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  561. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  562. Apr 22 01:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  563. Apr 22 01:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  564. Apr 22 01:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  565. Apr 22 01:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  566. Apr 22 01:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  567. Apr 22 01:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  568. Apr 22 01:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  569. Apr 22 01:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  570. Apr 22 01:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  571. Apr 22 01:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  572. Apr 22 01:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  573. Apr 22 01:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  574. Apr 22 01:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  575. Apr 22 01:14:37 hp-epyc kernel: </TASK>
  576. Apr 22 01:20:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  577. Apr 22 01:20:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  578. Apr 22 01:20:37 hp-epyc kernel: (detected by 53, t=7440207 jiffies, g=1051549, q=36382957)
  579. Apr 22 01:20:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  580. Apr 22 01:20:37 hp-epyc kernel: Call Trace:
  581. Apr 22 01:20:37 hp-epyc kernel: <TASK>
  582. Apr 22 01:20:37 hp-epyc kernel: __schedule+0x238/0x5e0
  583. Apr 22 01:20:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  584. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  585. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  586. Apr 22 01:20:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  587. Apr 22 01:20:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  588. Apr 22 01:20:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  589. Apr 22 01:20:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  590. Apr 22 01:20:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  591. Apr 22 01:20:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  592. Apr 22 01:20:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  593. Apr 22 01:20:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  594. Apr 22 01:20:37 hp-epyc kernel: kthread+0x191/0x1b0
  595. Apr 22 01:20:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  596. Apr 22 01:20:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  597. Apr 22 01:20:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  598. Apr 22 01:20:37 hp-epyc kernel: </TASK>
  599. Apr 22 01:20:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  600. Apr 22 01:20:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  601. Apr 22 01:20:37 hp-epyc kernel: (detected by 0, t=7620212 jiffies, g=1051549, q=36632327)
  602. Apr 22 01:20:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  603. Apr 22 01:20:37 hp-epyc kernel: Call Trace:
  604. Apr 22 01:20:37 hp-epyc kernel: <TASK>
  605. Apr 22 01:20:37 hp-epyc kernel: __schedule+0x238/0x5e0
  606. Apr 22 01:20:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  607. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  608. Apr 22 01:20:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  609. Apr 22 01:20:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  610. Apr 22 01:20:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  611. Apr 22 01:20:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  612. Apr 22 01:20:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  613. Apr 22 01:20:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  614. Apr 22 01:20:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  615. Apr 22 01:20:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  616. Apr 22 01:20:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  617. Apr 22 01:20:37 hp-epyc kernel: kthread+0x191/0x1b0
  618. Apr 22 01:20:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  619. Apr 22 01:20:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  620. Apr 22 01:20:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  621. Apr 22 01:20:37 hp-epyc kernel: </TASK>
  622. Apr 22 01:23:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  623. Apr 22 01:23:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  624. Apr 22 01:23:37 hp-epyc kernel: (detected by 0, t=7800217 jiffies, g=1051549, q=36870836)
  625. Apr 22 01:23:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  626. Apr 22 01:23:37 hp-epyc kernel: Call Trace:
  627. Apr 22 01:23:37 hp-epyc kernel: <TASK>
  628. Apr 22 01:23:37 hp-epyc kernel: __schedule+0x238/0x5e0
  629. Apr 22 01:23:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  630. Apr 22 01:23:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  631. Apr 22 01:23:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  632. Apr 22 01:23:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  633. Apr 22 01:23:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  634. Apr 22 01:23:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  635. Apr 22 01:23:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  636. Apr 22 01:23:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  637. Apr 22 01:23:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  638. Apr 22 01:23:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  639. Apr 22 01:23:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  640. Apr 22 01:23:37 hp-epyc kernel: kthread+0x191/0x1b0
  641. Apr 22 01:23:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  642. Apr 22 01:23:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  643. Apr 22 01:23:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  644. Apr 22 01:23:37 hp-epyc kernel: </TASK>
  645. Apr 22 01:26:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  646. Apr 22 01:26:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  647. Apr 22 01:26:37 hp-epyc kernel: (detected by 0, t=7980222 jiffies, g=1051549, q=37106710)
  648. Apr 22 01:26:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  649. Apr 22 01:26:37 hp-epyc kernel: Call Trace:
  650. Apr 22 01:26:37 hp-epyc kernel: <TASK>
  651. Apr 22 01:26:37 hp-epyc kernel: __schedule+0x238/0x5e0
  652. Apr 22 01:26:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  653. Apr 22 01:26:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  654. Apr 22 01:26:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  655. Apr 22 01:26:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  656. Apr 22 01:26:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  657. Apr 22 01:26:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  658. Apr 22 01:26:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  659. Apr 22 01:26:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  660. Apr 22 01:26:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  661. Apr 22 01:26:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  662. Apr 22 01:26:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  663. Apr 22 01:26:37 hp-epyc kernel: kthread+0x191/0x1b0
  664. Apr 22 01:26:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  665. Apr 22 01:26:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  666. Apr 22 01:26:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  667. Apr 22 01:26:37 hp-epyc kernel: </TASK>
  668. Apr 22 01:29:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  669. Apr 22 01:29:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  670. Apr 22 01:29:37 hp-epyc kernel: (detected by 0, t=8160227 jiffies, g=1051549, q=37332962)
  671. Apr 22 01:29:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  672. Apr 22 01:29:37 hp-epyc kernel: Call Trace:
  673. Apr 22 01:29:37 hp-epyc kernel: <TASK>
  674. Apr 22 01:29:37 hp-epyc kernel: __schedule+0x238/0x5e0
  675. Apr 22 01:29:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  676. Apr 22 01:29:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  677. Apr 22 01:29:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  678. Apr 22 01:29:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  679. Apr 22 01:29:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  680. Apr 22 01:29:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  681. Apr 22 01:29:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  682. Apr 22 01:29:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  683. Apr 22 01:29:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  684. Apr 22 01:29:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  685. Apr 22 01:29:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  686. Apr 22 01:29:37 hp-epyc kernel: kthread+0x191/0x1b0
  687. Apr 22 01:29:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  688. Apr 22 01:29:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  689. Apr 22 01:29:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  690. Apr 22 01:29:37 hp-epyc kernel: </TASK>
  691. Apr 22 01:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  692. Apr 22 01:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  693. Apr 22 01:35:37 hp-epyc kernel: (detected by 53, t=8340232 jiffies, g=1051549, q=37558255)
  694. Apr 22 01:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  695. Apr 22 01:35:37 hp-epyc kernel: Call Trace:
  696. Apr 22 01:35:37 hp-epyc kernel: <TASK>
  697. Apr 22 01:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  698. Apr 22 01:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  699. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  700. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  701. Apr 22 01:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  702. Apr 22 01:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  703. Apr 22 01:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  704. Apr 22 01:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  705. Apr 22 01:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  706. Apr 22 01:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  707. Apr 22 01:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  708. Apr 22 01:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  709. Apr 22 01:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  710. Apr 22 01:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  711. Apr 22 01:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  712. Apr 22 01:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  713. Apr 22 01:35:37 hp-epyc kernel: </TASK>
  714. Apr 22 01:35:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  715. Apr 22 01:35:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  716. Apr 22 01:35:37 hp-epyc kernel: (detected by 0, t=8520237 jiffies, g=1051549, q=37784603)
  717. Apr 22 01:35:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  718. Apr 22 01:35:37 hp-epyc kernel: Call Trace:
  719. Apr 22 01:35:37 hp-epyc kernel: <TASK>
  720. Apr 22 01:35:37 hp-epyc kernel: __schedule+0x238/0x5e0
  721. Apr 22 01:35:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  722. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  723. Apr 22 01:35:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  724. Apr 22 01:35:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  725. Apr 22 01:35:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  726. Apr 22 01:35:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  727. Apr 22 01:35:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  728. Apr 22 01:35:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  729. Apr 22 01:35:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  730. Apr 22 01:35:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  731. Apr 22 01:35:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  732. Apr 22 01:35:37 hp-epyc kernel: kthread+0x191/0x1b0
  733. Apr 22 01:35:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  734. Apr 22 01:35:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  735. Apr 22 01:35:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  736. Apr 22 01:35:37 hp-epyc kernel: </TASK>
  737. Apr 22 01:38:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  738. Apr 22 01:38:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  739. Apr 22 01:38:37 hp-epyc kernel: (detected by 0, t=8700242 jiffies, g=1051549, q=37987800)
  740. Apr 22 01:38:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  741. Apr 22 01:38:37 hp-epyc kernel: Call Trace:
  742. Apr 22 01:38:37 hp-epyc kernel: <TASK>
  743. Apr 22 01:38:37 hp-epyc kernel: __schedule+0x238/0x5e0
  744. Apr 22 01:38:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  745. Apr 22 01:38:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  746. Apr 22 01:38:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  747. Apr 22 01:38:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  748. Apr 22 01:38:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  749. Apr 22 01:38:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  750. Apr 22 01:38:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  751. Apr 22 01:38:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  752. Apr 22 01:38:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  753. Apr 22 01:38:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  754. Apr 22 01:38:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  755. Apr 22 01:38:37 hp-epyc kernel: kthread+0x191/0x1b0
  756. Apr 22 01:38:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  757. Apr 22 01:38:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  758. Apr 22 01:38:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  759. Apr 22 01:38:37 hp-epyc kernel: </TASK>
  760. Apr 22 01:41:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  761. Apr 22 01:41:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  762. Apr 22 01:41:37 hp-epyc kernel: (detected by 0, t=8880247 jiffies, g=1051549, q=38194572)
  763. Apr 22 01:41:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  764. Apr 22 01:41:37 hp-epyc kernel: Call Trace:
  765. Apr 22 01:41:37 hp-epyc kernel: <TASK>
  766. Apr 22 01:41:37 hp-epyc kernel: __schedule+0x238/0x5e0
  767. Apr 22 01:41:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  768. Apr 22 01:41:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  769. Apr 22 01:41:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  770. Apr 22 01:41:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  771. Apr 22 01:41:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  772. Apr 22 01:41:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  773. Apr 22 01:41:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  774. Apr 22 01:41:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  775. Apr 22 01:41:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  776. Apr 22 01:41:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  777. Apr 22 01:41:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  778. Apr 22 01:41:37 hp-epyc kernel: kthread+0x191/0x1b0
  779. Apr 22 01:41:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  780. Apr 22 01:41:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  781. Apr 22 01:41:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  782. Apr 22 01:41:37 hp-epyc kernel: </TASK>
  783. Apr 22 01:47:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  784. Apr 22 01:47:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  785. Apr 22 01:47:37 hp-epyc kernel: (detected by 53, t=9060252 jiffies, g=1051549, q=38389833)
  786. Apr 22 01:47:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  787. Apr 22 01:47:37 hp-epyc kernel: Call Trace:
  788. Apr 22 01:47:37 hp-epyc kernel: <TASK>
  789. Apr 22 01:47:37 hp-epyc kernel: __schedule+0x238/0x5e0
  790. Apr 22 01:47:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  791. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  792. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  793. Apr 22 01:47:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  794. Apr 22 01:47:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  795. Apr 22 01:47:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  796. Apr 22 01:47:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  797. Apr 22 01:47:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  798. Apr 22 01:47:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  799. Apr 22 01:47:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  800. Apr 22 01:47:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  801. Apr 22 01:47:37 hp-epyc kernel: kthread+0x191/0x1b0
  802. Apr 22 01:47:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  803. Apr 22 01:47:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  804. Apr 22 01:47:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  805. Apr 22 01:47:37 hp-epyc kernel: </TASK>
  806. Apr 22 01:47:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  807. Apr 22 01:47:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  808. Apr 22 01:47:37 hp-epyc kernel: (detected by 0, t=9240257 jiffies, g=1051549, q=38588168)
  809. Apr 22 01:47:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  810. Apr 22 01:47:37 hp-epyc kernel: Call Trace:
  811. Apr 22 01:47:37 hp-epyc kernel: <TASK>
  812. Apr 22 01:47:37 hp-epyc kernel: __schedule+0x238/0x5e0
  813. Apr 22 01:47:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  814. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  815. Apr 22 01:47:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  816. Apr 22 01:47:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  817. Apr 22 01:47:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  818. Apr 22 01:47:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  819. Apr 22 01:47:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  820. Apr 22 01:47:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  821. Apr 22 01:47:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  822. Apr 22 01:47:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  823. Apr 22 01:47:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  824. Apr 22 01:47:37 hp-epyc kernel: kthread+0x191/0x1b0
  825. Apr 22 01:47:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  826. Apr 22 01:47:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  827. Apr 22 01:47:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  828. Apr 22 01:47:37 hp-epyc kernel: </TASK>
  829. Apr 22 01:50:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  830. Apr 22 01:50:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  831. Apr 22 01:50:37 hp-epyc kernel: (detected by 0, t=9420262 jiffies, g=1051549, q=38843604)
  832. Apr 22 01:50:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  833. Apr 22 01:50:37 hp-epyc kernel: Call Trace:
  834. Apr 22 01:50:37 hp-epyc kernel: <TASK>
  835. Apr 22 01:50:37 hp-epyc kernel: __schedule+0x238/0x5e0
  836. Apr 22 01:50:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  837. Apr 22 01:50:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  838. Apr 22 01:50:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  839. Apr 22 01:50:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  840. Apr 22 01:50:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  841. Apr 22 01:50:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  842. Apr 22 01:50:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  843. Apr 22 01:50:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  844. Apr 22 01:50:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  845. Apr 22 01:50:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  846. Apr 22 01:50:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  847. Apr 22 01:50:37 hp-epyc kernel: kthread+0x191/0x1b0
  848. Apr 22 01:50:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  849. Apr 22 01:50:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  850. Apr 22 01:50:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  851. Apr 22 01:50:37 hp-epyc kernel: </TASK>
  852. Apr 22 01:53:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  853. Apr 22 01:53:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  854. Apr 22 01:53:37 hp-epyc kernel: (detected by 0, t=9600267 jiffies, g=1051549, q=39096901)
  855. Apr 22 01:53:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  856. Apr 22 01:53:37 hp-epyc kernel: Call Trace:
  857. Apr 22 01:53:37 hp-epyc kernel: <TASK>
  858. Apr 22 01:53:37 hp-epyc kernel: __schedule+0x238/0x5e0
  859. Apr 22 01:53:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  860. Apr 22 01:53:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  861. Apr 22 01:53:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  862. Apr 22 01:53:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  863. Apr 22 01:53:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  864. Apr 22 01:53:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  865. Apr 22 01:53:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  866. Apr 22 01:53:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  867. Apr 22 01:53:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  868. Apr 22 01:53:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  869. Apr 22 01:53:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  870. Apr 22 01:53:37 hp-epyc kernel: kthread+0x191/0x1b0
  871. Apr 22 01:53:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  872. Apr 22 01:53:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  873. Apr 22 01:53:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  874. Apr 22 01:53:37 hp-epyc kernel: </TASK>
  875. Apr 22 01:56:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  876. Apr 22 01:56:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  877. Apr 22 01:56:37 hp-epyc kernel: (detected by 0, t=9780272 jiffies, g=1051549, q=39336394)
  878. Apr 22 01:56:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  879. Apr 22 01:56:37 hp-epyc kernel: Call Trace:
  880. Apr 22 01:56:37 hp-epyc kernel: <TASK>
  881. Apr 22 01:56:37 hp-epyc kernel: __schedule+0x238/0x5e0
  882. Apr 22 01:56:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  883. Apr 22 01:56:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  884. Apr 22 01:56:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  885. Apr 22 01:56:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  886. Apr 22 01:56:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  887. Apr 22 01:56:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  888. Apr 22 01:56:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  889. Apr 22 01:56:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  890. Apr 22 01:56:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  891. Apr 22 01:56:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  892. Apr 22 01:56:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  893. Apr 22 01:56:37 hp-epyc kernel: kthread+0x191/0x1b0
  894. Apr 22 01:56:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  895. Apr 22 01:56:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  896. Apr 22 01:56:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  897. Apr 22 01:56:37 hp-epyc kernel: </TASK>
  898. Apr 22 01:59:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  899. Apr 22 01:59:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  900. Apr 22 01:59:37 hp-epyc kernel: (detected by 0, t=9960277 jiffies, g=1051549, q=39569336)
  901. Apr 22 01:59:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  902. Apr 22 01:59:37 hp-epyc kernel: Call Trace:
  903. Apr 22 01:59:37 hp-epyc kernel: <TASK>
  904. Apr 22 01:59:37 hp-epyc kernel: __schedule+0x238/0x5e0
  905. Apr 22 01:59:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  906. Apr 22 01:59:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  907. Apr 22 01:59:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  908. Apr 22 01:59:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  909. Apr 22 01:59:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  910. Apr 22 01:59:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  911. Apr 22 01:59:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  912. Apr 22 01:59:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  913. Apr 22 01:59:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  914. Apr 22 01:59:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  915. Apr 22 01:59:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  916. Apr 22 01:59:37 hp-epyc kernel: kthread+0x191/0x1b0
  917. Apr 22 01:59:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  918. Apr 22 01:59:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  919. Apr 22 01:59:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  920. Apr 22 01:59:37 hp-epyc kernel: </TASK>
  921. Apr 22 02:02:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  922. Apr 22 02:02:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  923. Apr 22 02:02:37 hp-epyc kernel: (detected by 0, t=10140282 jiffies, g=1051549, q=39786158)
  924. Apr 22 02:02:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  925. Apr 22 02:02:37 hp-epyc kernel: Call Trace:
  926. Apr 22 02:02:37 hp-epyc kernel: <TASK>
  927. Apr 22 02:02:37 hp-epyc kernel: __schedule+0x238/0x5e0
  928. Apr 22 02:02:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  929. Apr 22 02:02:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  930. Apr 22 02:02:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  931. Apr 22 02:02:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  932. Apr 22 02:02:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  933. Apr 22 02:02:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  934. Apr 22 02:02:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  935. Apr 22 02:02:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  936. Apr 22 02:02:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  937. Apr 22 02:02:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  938. Apr 22 02:02:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  939. Apr 22 02:02:37 hp-epyc kernel: kthread+0x191/0x1b0
  940. Apr 22 02:02:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  941. Apr 22 02:02:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  942. Apr 22 02:02:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  943. Apr 22 02:02:37 hp-epyc kernel: </TASK>
  944. Apr 22 02:05:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  945. Apr 22 02:05:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  946. Apr 22 02:05:37 hp-epyc kernel: (detected by 0, t=10320287 jiffies, g=1051549, q=40020632)
  947. Apr 22 02:05:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  948. Apr 22 02:05:37 hp-epyc kernel: Call Trace:
  949. Apr 22 02:05:37 hp-epyc kernel: <TASK>
  950. Apr 22 02:05:37 hp-epyc kernel: __schedule+0x238/0x5e0
  951. Apr 22 02:05:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  952. Apr 22 02:05:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  953. Apr 22 02:05:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  954. Apr 22 02:05:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  955. Apr 22 02:05:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  956. Apr 22 02:05:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  957. Apr 22 02:05:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  958. Apr 22 02:05:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  959. Apr 22 02:05:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  960. Apr 22 02:05:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  961. Apr 22 02:05:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  962. Apr 22 02:05:37 hp-epyc kernel: kthread+0x191/0x1b0
  963. Apr 22 02:05:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  964. Apr 22 02:05:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  965. Apr 22 02:05:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  966. Apr 22 02:05:37 hp-epyc kernel: </TASK>
  967. Apr 22 02:08:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  968. Apr 22 02:08:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  969. Apr 22 02:08:37 hp-epyc kernel: (detected by 0, t=10500292 jiffies, g=1051549, q=40225083)
  970. Apr 22 02:08:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  971. Apr 22 02:08:37 hp-epyc kernel: Call Trace:
  972. Apr 22 02:08:37 hp-epyc kernel: <TASK>
  973. Apr 22 02:08:37 hp-epyc kernel: __schedule+0x238/0x5e0
  974. Apr 22 02:08:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  975. Apr 22 02:08:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  976. Apr 22 02:08:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  977. Apr 22 02:08:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  978. Apr 22 02:08:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  979. Apr 22 02:08:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  980. Apr 22 02:08:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  981. Apr 22 02:08:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  982. Apr 22 02:08:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  983. Apr 22 02:08:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  984. Apr 22 02:08:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  985. Apr 22 02:08:37 hp-epyc kernel: kthread+0x191/0x1b0
  986. Apr 22 02:08:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  987. Apr 22 02:08:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  988. Apr 22 02:08:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  989. Apr 22 02:08:37 hp-epyc kernel: </TASK>
  990. Apr 22 02:11:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  991. Apr 22 02:11:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  992. Apr 22 02:11:37 hp-epyc kernel: (detected by 0, t=10680297 jiffies, g=1051549, q=40453831)
  993. Apr 22 02:11:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  994. Apr 22 02:11:37 hp-epyc kernel: Call Trace:
  995. Apr 22 02:11:37 hp-epyc kernel: <TASK>
  996. Apr 22 02:11:37 hp-epyc kernel: __schedule+0x238/0x5e0
  997. Apr 22 02:11:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  998. Apr 22 02:11:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  999. Apr 22 02:11:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1000. Apr 22 02:11:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1001. Apr 22 02:11:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1002. Apr 22 02:11:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1003. Apr 22 02:11:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1004. Apr 22 02:11:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1005. Apr 22 02:11:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1006. Apr 22 02:11:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1007. Apr 22 02:11:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1008. Apr 22 02:11:37 hp-epyc kernel: kthread+0x191/0x1b0
  1009. Apr 22 02:11:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1010. Apr 22 02:11:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1011. Apr 22 02:11:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  1012. Apr 22 02:11:37 hp-epyc kernel: </TASK>
  1013. Apr 22 02:14:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1014. Apr 22 02:14:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1015. Apr 22 02:14:37 hp-epyc kernel: (detected by 0, t=10860302 jiffies, g=1051549, q=40652533)
  1016. Apr 22 02:14:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1017. Apr 22 02:14:37 hp-epyc kernel: Call Trace:
  1018. Apr 22 02:14:37 hp-epyc kernel: <TASK>
  1019. Apr 22 02:14:37 hp-epyc kernel: __schedule+0x238/0x5e0
  1020. Apr 22 02:14:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1021. Apr 22 02:14:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  1022. Apr 22 02:14:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1023. Apr 22 02:14:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1024. Apr 22 02:14:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1025. Apr 22 02:14:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1026. Apr 22 02:14:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1027. Apr 22 02:14:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1028. Apr 22 02:14:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1029. Apr 22 02:14:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1030. Apr 22 02:14:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1031. Apr 22 02:14:37 hp-epyc kernel: kthread+0x191/0x1b0
  1032. Apr 22 02:14:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1033. Apr 22 02:14:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1034. Apr 22 02:14:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  1035. Apr 22 02:14:37 hp-epyc kernel: </TASK>
  1036. Apr 22 02:17:37 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1037. Apr 22 02:17:37 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1038. Apr 22 02:17:37 hp-epyc kernel: (detected by 0, t=11040307 jiffies, g=1051549, q=40863289)
  1039. Apr 22 02:17:37 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1040. Apr 22 02:17:37 hp-epyc kernel: Call Trace:
  1041. Apr 22 02:17:37 hp-epyc kernel: <TASK>
  1042. Apr 22 02:17:37 hp-epyc kernel: __schedule+0x238/0x5e0
  1043. Apr 22 02:17:37 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1044. Apr 22 02:17:37 hp-epyc kernel: preempt_schedule+0x60/0x80
  1045. Apr 22 02:17:37 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1046. Apr 22 02:17:37 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1047. Apr 22 02:17:37 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1048. Apr 22 02:17:37 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1049. Apr 22 02:17:37 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1050. Apr 22 02:17:37 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1051. Apr 22 02:17:37 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1052. Apr 22 02:17:37 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1053. Apr 22 02:17:37 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1054. Apr 22 02:17:37 hp-epyc kernel: kthread+0x191/0x1b0
  1055. Apr 22 02:17:37 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1056. Apr 22 02:17:37 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1057. Apr 22 02:17:37 hp-epyc kernel: ret_from_fork+0x22/0x30
  1058. Apr 22 02:17:37 hp-epyc kernel: </TASK>
  1059. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1060. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1061. Apr 22 02:29:38 hp-epyc kernel: (detected by 53, t=11220312 jiffies, g=1051549, q=41089101)
  1062. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1063. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1064. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1065. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1066. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1067. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1068. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1069. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1070. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1071. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1072. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1073. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1074. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1075. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1076. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1077. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1078. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1079. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1080. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1081. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1082. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1083. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1084. Apr 22 02:29:38 hp-epyc kernel: (detected by 53, t=11400317 jiffies, g=1051549, q=41341577)
  1085. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1086. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1087. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1088. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1089. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1090. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1091. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1092. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1093. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1094. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1095. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1096. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1097. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1098. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1099. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1100. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1101. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1102. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1103. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1104. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1105. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1106. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1107. Apr 22 02:29:38 hp-epyc kernel: (detected by 53, t=11580322 jiffies, g=1051549, q=41593746)
  1108. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1109. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1110. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1111. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1112. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1113. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1114. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1115. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1116. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1117. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1118. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1119. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1120. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1121. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1122. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1123. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1124. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1125. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1126. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1127. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1128. Apr 22 02:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1129. Apr 22 02:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1130. Apr 22 02:29:38 hp-epyc kernel: (detected by 0, t=11760327 jiffies, g=1051549, q=41843999)
  1131. Apr 22 02:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1132. Apr 22 02:29:38 hp-epyc kernel: Call Trace:
  1133. Apr 22 02:29:38 hp-epyc kernel: <TASK>
  1134. Apr 22 02:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1135. Apr 22 02:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1136. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1137. Apr 22 02:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1138. Apr 22 02:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1139. Apr 22 02:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1140. Apr 22 02:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1141. Apr 22 02:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1142. Apr 22 02:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1143. Apr 22 02:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1144. Apr 22 02:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1145. Apr 22 02:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1146. Apr 22 02:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1147. Apr 22 02:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1148. Apr 22 02:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1149. Apr 22 02:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1150. Apr 22 02:29:38 hp-epyc kernel: </TASK>
  1151. Apr 22 02:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1152. Apr 22 02:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1153. Apr 22 02:38:38 hp-epyc kernel: (detected by 53, t=11940332 jiffies, g=1051549, q=42070451)
  1154. Apr 22 02:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1155. Apr 22 02:38:38 hp-epyc kernel: Call Trace:
  1156. Apr 22 02:38:38 hp-epyc kernel: <TASK>
  1157. Apr 22 02:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1158. Apr 22 02:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1159. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1160. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1161. Apr 22 02:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1162. Apr 22 02:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1163. Apr 22 02:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1164. Apr 22 02:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1165. Apr 22 02:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1166. Apr 22 02:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1167. Apr 22 02:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1168. Apr 22 02:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1169. Apr 22 02:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1170. Apr 22 02:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1171. Apr 22 02:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1172. Apr 22 02:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1173. Apr 22 02:38:38 hp-epyc kernel: </TASK>
  1174. Apr 22 02:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1175. Apr 22 02:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1176. Apr 22 02:38:38 hp-epyc kernel: (detected by 53, t=12120337 jiffies, g=1051549, q=42294718)
  1177. Apr 22 02:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1178. Apr 22 02:38:38 hp-epyc kernel: Call Trace:
  1179. Apr 22 02:38:38 hp-epyc kernel: <TASK>
  1180. Apr 22 02:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1181. Apr 22 02:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1182. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1183. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1184. Apr 22 02:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1185. Apr 22 02:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1186. Apr 22 02:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1187. Apr 22 02:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1188. Apr 22 02:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1189. Apr 22 02:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1190. Apr 22 02:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1191. Apr 22 02:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1192. Apr 22 02:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1193. Apr 22 02:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1194. Apr 22 02:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1195. Apr 22 02:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1196. Apr 22 02:38:38 hp-epyc kernel: </TASK>
  1197. Apr 22 02:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1198. Apr 22 02:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1199. Apr 22 02:38:38 hp-epyc kernel: (detected by 0, t=12300342 jiffies, g=1051549, q=42513832)
  1200. Apr 22 02:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1201. Apr 22 02:38:38 hp-epyc kernel: Call Trace:
  1202. Apr 22 02:38:38 hp-epyc kernel: <TASK>
  1203. Apr 22 02:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1204. Apr 22 02:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1205. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1206. Apr 22 02:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1207. Apr 22 02:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1208. Apr 22 02:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1209. Apr 22 02:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1210. Apr 22 02:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1211. Apr 22 02:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1212. Apr 22 02:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1213. Apr 22 02:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1214. Apr 22 02:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1215. Apr 22 02:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1216. Apr 22 02:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1217. Apr 22 02:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1218. Apr 22 02:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1219. Apr 22 02:38:38 hp-epyc kernel: </TASK>
  1220. Apr 22 02:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1221. Apr 22 02:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1222. Apr 22 02:47:38 hp-epyc kernel: (detected by 53, t=12480347 jiffies, g=1051549, q=42679121)
  1223. Apr 22 02:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1224. Apr 22 02:47:38 hp-epyc kernel: Call Trace:
  1225. Apr 22 02:47:38 hp-epyc kernel: <TASK>
  1226. Apr 22 02:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1227. Apr 22 02:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1228. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1229. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1230. Apr 22 02:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1231. Apr 22 02:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1232. Apr 22 02:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1233. Apr 22 02:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1234. Apr 22 02:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1235. Apr 22 02:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1236. Apr 22 02:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1237. Apr 22 02:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1238. Apr 22 02:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  1239. Apr 22 02:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1240. Apr 22 02:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1241. Apr 22 02:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1242. Apr 22 02:47:38 hp-epyc kernel: </TASK>
  1243. Apr 22 02:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1244. Apr 22 02:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1245. Apr 22 02:47:38 hp-epyc kernel: (detected by 53, t=12660352 jiffies, g=1051549, q=42830586)
  1246. Apr 22 02:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1247. Apr 22 02:47:38 hp-epyc kernel: Call Trace:
  1248. Apr 22 02:47:38 hp-epyc kernel: <TASK>
  1249. Apr 22 02:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1250. Apr 22 02:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1251. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1252. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1253. Apr 22 02:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1254. Apr 22 02:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1255. Apr 22 02:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1256. Apr 22 02:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1257. Apr 22 02:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1258. Apr 22 02:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1259. Apr 22 02:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1260. Apr 22 02:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1261. Apr 22 02:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  1262. Apr 22 02:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1263. Apr 22 02:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1264. Apr 22 02:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1265. Apr 22 02:47:38 hp-epyc kernel: </TASK>
  1266. Apr 22 02:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1267. Apr 22 02:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1268. Apr 22 02:47:38 hp-epyc kernel: (detected by 0, t=12840357 jiffies, g=1051549, q=42986729)
  1269. Apr 22 02:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1270. Apr 22 02:47:38 hp-epyc kernel: Call Trace:
  1271. Apr 22 02:47:38 hp-epyc kernel: <TASK>
  1272. Apr 22 02:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1273. Apr 22 02:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1274. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1275. Apr 22 02:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1276. Apr 22 02:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1277. Apr 22 02:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1278. Apr 22 02:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1279. Apr 22 02:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1280. Apr 22 02:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1281. Apr 22 02:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1282. Apr 22 02:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1283. Apr 22 02:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1284. Apr 22 02:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  1285. Apr 22 02:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1286. Apr 22 02:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1287. Apr 22 02:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1288. Apr 22 02:47:38 hp-epyc kernel: </TASK>
  1289. Apr 22 02:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1290. Apr 22 02:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1291. Apr 22 02:53:38 hp-epyc kernel: (detected by 53, t=13020362 jiffies, g=1051549, q=43137643)
  1292. Apr 22 02:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1293. Apr 22 02:53:38 hp-epyc kernel: Call Trace:
  1294. Apr 22 02:53:38 hp-epyc kernel: <TASK>
  1295. Apr 22 02:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1296. Apr 22 02:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1297. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1298. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1299. Apr 22 02:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1300. Apr 22 02:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1301. Apr 22 02:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1302. Apr 22 02:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1303. Apr 22 02:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1304. Apr 22 02:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1305. Apr 22 02:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1306. Apr 22 02:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1307. Apr 22 02:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  1308. Apr 22 02:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1309. Apr 22 02:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1310. Apr 22 02:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1311. Apr 22 02:53:38 hp-epyc kernel: </TASK>
  1312. Apr 22 02:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1313. Apr 22 02:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1314. Apr 22 02:53:38 hp-epyc kernel: (detected by 0, t=13200367 jiffies, g=1051549, q=43283977)
  1315. Apr 22 02:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1316. Apr 22 02:53:38 hp-epyc kernel: Call Trace:
  1317. Apr 22 02:53:38 hp-epyc kernel: <TASK>
  1318. Apr 22 02:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1319. Apr 22 02:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1320. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1321. Apr 22 02:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1322. Apr 22 02:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1323. Apr 22 02:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1324. Apr 22 02:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1325. Apr 22 02:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1326. Apr 22 02:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1327. Apr 22 02:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1328. Apr 22 02:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1329. Apr 22 02:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1330. Apr 22 02:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  1331. Apr 22 02:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1332. Apr 22 02:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1333. Apr 22 02:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1334. Apr 22 02:53:38 hp-epyc kernel: </TASK>
  1335. Apr 22 02:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1336. Apr 22 02:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1337. Apr 22 02:56:38 hp-epyc kernel: (detected by 0, t=13380372 jiffies, g=1051549, q=43441996)
  1338. Apr 22 02:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1339. Apr 22 02:56:38 hp-epyc kernel: Call Trace:
  1340. Apr 22 02:56:38 hp-epyc kernel: <TASK>
  1341. Apr 22 02:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1342. Apr 22 02:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1343. Apr 22 02:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1344. Apr 22 02:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1345. Apr 22 02:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1346. Apr 22 02:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1347. Apr 22 02:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1348. Apr 22 02:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1349. Apr 22 02:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1350. Apr 22 02:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1351. Apr 22 02:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1352. Apr 22 02:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1353. Apr 22 02:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  1354. Apr 22 02:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1355. Apr 22 02:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1356. Apr 22 02:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1357. Apr 22 02:56:38 hp-epyc kernel: </TASK>
  1358. Apr 22 03:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1359. Apr 22 03:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1360. Apr 22 03:02:38 hp-epyc kernel: (detected by 53, t=13560377 jiffies, g=1051549, q=43557827)
  1361. Apr 22 03:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1362. Apr 22 03:02:38 hp-epyc kernel: Call Trace:
  1363. Apr 22 03:02:38 hp-epyc kernel: <TASK>
  1364. Apr 22 03:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1365. Apr 22 03:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1366. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1367. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1368. Apr 22 03:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1369. Apr 22 03:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1370. Apr 22 03:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1371. Apr 22 03:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1372. Apr 22 03:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1373. Apr 22 03:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1374. Apr 22 03:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1375. Apr 22 03:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1376. Apr 22 03:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  1377. Apr 22 03:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1378. Apr 22 03:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1379. Apr 22 03:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1380. Apr 22 03:02:38 hp-epyc kernel: </TASK>
  1381. Apr 22 03:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1382. Apr 22 03:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1383. Apr 22 03:02:38 hp-epyc kernel: (detected by 0, t=13740382 jiffies, g=1051549, q=43625244)
  1384. Apr 22 03:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1385. Apr 22 03:02:38 hp-epyc kernel: Call Trace:
  1386. Apr 22 03:02:38 hp-epyc kernel: <TASK>
  1387. Apr 22 03:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1388. Apr 22 03:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1389. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1390. Apr 22 03:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1391. Apr 22 03:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1392. Apr 22 03:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1393. Apr 22 03:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1394. Apr 22 03:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1395. Apr 22 03:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1396. Apr 22 03:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1397. Apr 22 03:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1398. Apr 22 03:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1399. Apr 22 03:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  1400. Apr 22 03:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1401. Apr 22 03:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1402. Apr 22 03:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1403. Apr 22 03:02:38 hp-epyc kernel: </TASK>
  1404. Apr 22 03:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1405. Apr 22 03:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1406. Apr 22 03:05:38 hp-epyc kernel: (detected by 0, t=13920387 jiffies, g=1051549, q=43695184)
  1407. Apr 22 03:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1408. Apr 22 03:05:38 hp-epyc kernel: Call Trace:
  1409. Apr 22 03:05:38 hp-epyc kernel: <TASK>
  1410. Apr 22 03:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1411. Apr 22 03:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1412. Apr 22 03:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1413. Apr 22 03:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1414. Apr 22 03:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1415. Apr 22 03:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1416. Apr 22 03:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1417. Apr 22 03:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1418. Apr 22 03:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1419. Apr 22 03:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1420. Apr 22 03:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1421. Apr 22 03:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1422. Apr 22 03:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  1423. Apr 22 03:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1424. Apr 22 03:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1425. Apr 22 03:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1426. Apr 22 03:05:38 hp-epyc kernel: </TASK>
  1427. Apr 22 03:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1428. Apr 22 03:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1429. Apr 22 03:08:38 hp-epyc kernel: (detected by 0, t=14100392 jiffies, g=1051549, q=43768144)
  1430. Apr 22 03:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1431. Apr 22 03:08:38 hp-epyc kernel: Call Trace:
  1432. Apr 22 03:08:38 hp-epyc kernel: <TASK>
  1433. Apr 22 03:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1434. Apr 22 03:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1435. Apr 22 03:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1436. Apr 22 03:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1437. Apr 22 03:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1438. Apr 22 03:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1439. Apr 22 03:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1440. Apr 22 03:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1441. Apr 22 03:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1442. Apr 22 03:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1443. Apr 22 03:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1444. Apr 22 03:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1445. Apr 22 03:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  1446. Apr 22 03:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1447. Apr 22 03:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1448. Apr 22 03:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1449. Apr 22 03:08:38 hp-epyc kernel: </TASK>
  1450. Apr 22 03:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1451. Apr 22 03:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1452. Apr 22 03:11:38 hp-epyc kernel: (detected by 0, t=14280397 jiffies, g=1051549, q=43837142)
  1453. Apr 22 03:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1454. Apr 22 03:11:38 hp-epyc kernel: Call Trace:
  1455. Apr 22 03:11:38 hp-epyc kernel: <TASK>
  1456. Apr 22 03:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1457. Apr 22 03:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1458. Apr 22 03:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1459. Apr 22 03:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1460. Apr 22 03:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1461. Apr 22 03:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1462. Apr 22 03:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1463. Apr 22 03:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1464. Apr 22 03:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1465. Apr 22 03:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1466. Apr 22 03:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1467. Apr 22 03:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1468. Apr 22 03:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  1469. Apr 22 03:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1470. Apr 22 03:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1471. Apr 22 03:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1472. Apr 22 03:11:38 hp-epyc kernel: </TASK>
  1473. Apr 22 03:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1474. Apr 22 03:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1475. Apr 22 03:14:38 hp-epyc kernel: (detected by 0, t=14460402 jiffies, g=1051549, q=43905578)
  1476. Apr 22 03:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1477. Apr 22 03:14:38 hp-epyc kernel: Call Trace:
  1478. Apr 22 03:14:38 hp-epyc kernel: <TASK>
  1479. Apr 22 03:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1480. Apr 22 03:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1481. Apr 22 03:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1482. Apr 22 03:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1483. Apr 22 03:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1484. Apr 22 03:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1485. Apr 22 03:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1486. Apr 22 03:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1487. Apr 22 03:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1488. Apr 22 03:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1489. Apr 22 03:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1490. Apr 22 03:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1491. Apr 22 03:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  1492. Apr 22 03:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1493. Apr 22 03:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1494. Apr 22 03:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1495. Apr 22 03:14:38 hp-epyc kernel: </TASK>
  1496. Apr 22 03:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1497. Apr 22 03:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1498. Apr 22 03:17:38 hp-epyc kernel: (detected by 0, t=14640407 jiffies, g=1051549, q=43975166)
  1499. Apr 22 03:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1500. Apr 22 03:17:38 hp-epyc kernel: Call Trace:
  1501. Apr 22 03:17:38 hp-epyc kernel: <TASK>
  1502. Apr 22 03:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1503. Apr 22 03:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1504. Apr 22 03:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1505. Apr 22 03:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1506. Apr 22 03:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1507. Apr 22 03:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1508. Apr 22 03:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1509. Apr 22 03:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1510. Apr 22 03:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1511. Apr 22 03:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1512. Apr 22 03:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1513. Apr 22 03:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1514. Apr 22 03:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  1515. Apr 22 03:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1516. Apr 22 03:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1517. Apr 22 03:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1518. Apr 22 03:17:38 hp-epyc kernel: </TASK>
  1519. Apr 22 03:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1520. Apr 22 03:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1521. Apr 22 03:20:38 hp-epyc kernel: (detected by 0, t=14820412 jiffies, g=1051549, q=44044548)
  1522. Apr 22 03:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1523. Apr 22 03:20:38 hp-epyc kernel: Call Trace:
  1524. Apr 22 03:20:38 hp-epyc kernel: <TASK>
  1525. Apr 22 03:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1526. Apr 22 03:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1527. Apr 22 03:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1528. Apr 22 03:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1529. Apr 22 03:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1530. Apr 22 03:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1531. Apr 22 03:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1532. Apr 22 03:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1533. Apr 22 03:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1534. Apr 22 03:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1535. Apr 22 03:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1536. Apr 22 03:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1537. Apr 22 03:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  1538. Apr 22 03:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1539. Apr 22 03:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1540. Apr 22 03:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1541. Apr 22 03:20:38 hp-epyc kernel: </TASK>
  1542. Apr 22 03:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1543. Apr 22 03:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1544. Apr 22 03:23:38 hp-epyc kernel: (detected by 0, t=15000417 jiffies, g=1051549, q=44113947)
  1545. Apr 22 03:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1546. Apr 22 03:23:38 hp-epyc kernel: Call Trace:
  1547. Apr 22 03:23:38 hp-epyc kernel: <TASK>
  1548. Apr 22 03:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1549. Apr 22 03:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1550. Apr 22 03:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1551. Apr 22 03:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1552. Apr 22 03:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1553. Apr 22 03:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1554. Apr 22 03:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1555. Apr 22 03:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1556. Apr 22 03:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1557. Apr 22 03:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1558. Apr 22 03:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1559. Apr 22 03:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1560. Apr 22 03:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  1561. Apr 22 03:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1562. Apr 22 03:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1563. Apr 22 03:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1564. Apr 22 03:23:38 hp-epyc kernel: </TASK>
  1565. Apr 22 03:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1566. Apr 22 03:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1567. Apr 22 03:26:38 hp-epyc kernel: (detected by 0, t=15180422 jiffies, g=1051549, q=44181071)
  1568. Apr 22 03:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1569. Apr 22 03:26:38 hp-epyc kernel: Call Trace:
  1570. Apr 22 03:26:38 hp-epyc kernel: <TASK>
  1571. Apr 22 03:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1572. Apr 22 03:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1573. Apr 22 03:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1574. Apr 22 03:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1575. Apr 22 03:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1576. Apr 22 03:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1577. Apr 22 03:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1578. Apr 22 03:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1579. Apr 22 03:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1580. Apr 22 03:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1581. Apr 22 03:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1582. Apr 22 03:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1583. Apr 22 03:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  1584. Apr 22 03:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1585. Apr 22 03:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1586. Apr 22 03:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1587. Apr 22 03:26:38 hp-epyc kernel: </TASK>
  1588. Apr 22 03:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1589. Apr 22 03:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1590. Apr 22 03:29:38 hp-epyc kernel: (detected by 0, t=15360427 jiffies, g=1051549, q=44248689)
  1591. Apr 22 03:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1592. Apr 22 03:29:38 hp-epyc kernel: Call Trace:
  1593. Apr 22 03:29:38 hp-epyc kernel: <TASK>
  1594. Apr 22 03:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1595. Apr 22 03:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1596. Apr 22 03:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1597. Apr 22 03:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1598. Apr 22 03:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1599. Apr 22 03:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1600. Apr 22 03:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1601. Apr 22 03:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1602. Apr 22 03:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1603. Apr 22 03:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1604. Apr 22 03:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1605. Apr 22 03:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1606. Apr 22 03:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  1607. Apr 22 03:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1608. Apr 22 03:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1609. Apr 22 03:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1610. Apr 22 03:29:38 hp-epyc kernel: </TASK>
  1611. Apr 22 03:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1612. Apr 22 03:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1613. Apr 22 03:35:38 hp-epyc kernel: (detected by 53, t=15540432 jiffies, g=1051549, q=44320557)
  1614. Apr 22 03:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1615. Apr 22 03:35:38 hp-epyc kernel: Call Trace:
  1616. Apr 22 03:35:38 hp-epyc kernel: <TASK>
  1617. Apr 22 03:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1618. Apr 22 03:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1619. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1620. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1621. Apr 22 03:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1622. Apr 22 03:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1623. Apr 22 03:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1624. Apr 22 03:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1625. Apr 22 03:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1626. Apr 22 03:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1627. Apr 22 03:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1628. Apr 22 03:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1629. Apr 22 03:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  1630. Apr 22 03:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1631. Apr 22 03:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1632. Apr 22 03:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1633. Apr 22 03:35:38 hp-epyc kernel: </TASK>
  1634. Apr 22 03:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1635. Apr 22 03:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1636. Apr 22 03:35:38 hp-epyc kernel: (detected by 0, t=15720437 jiffies, g=1051549, q=44389826)
  1637. Apr 22 03:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1638. Apr 22 03:35:38 hp-epyc kernel: Call Trace:
  1639. Apr 22 03:35:38 hp-epyc kernel: <TASK>
  1640. Apr 22 03:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1641. Apr 22 03:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1642. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1643. Apr 22 03:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1644. Apr 22 03:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1645. Apr 22 03:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1646. Apr 22 03:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1647. Apr 22 03:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1648. Apr 22 03:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1649. Apr 22 03:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1650. Apr 22 03:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1651. Apr 22 03:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1652. Apr 22 03:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  1653. Apr 22 03:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1654. Apr 22 03:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1655. Apr 22 03:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1656. Apr 22 03:35:38 hp-epyc kernel: </TASK>
  1657. Apr 22 03:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1658. Apr 22 03:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1659. Apr 22 03:38:38 hp-epyc kernel: (detected by 0, t=15900442 jiffies, g=1051549, q=44458606)
  1660. Apr 22 03:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1661. Apr 22 03:38:38 hp-epyc kernel: Call Trace:
  1662. Apr 22 03:38:38 hp-epyc kernel: <TASK>
  1663. Apr 22 03:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1664. Apr 22 03:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1665. Apr 22 03:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1666. Apr 22 03:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1667. Apr 22 03:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1668. Apr 22 03:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1669. Apr 22 03:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1670. Apr 22 03:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1671. Apr 22 03:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1672. Apr 22 03:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1673. Apr 22 03:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1674. Apr 22 03:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1675. Apr 22 03:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  1676. Apr 22 03:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1677. Apr 22 03:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1678. Apr 22 03:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1679. Apr 22 03:38:38 hp-epyc kernel: </TASK>
  1680. Apr 22 03:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1681. Apr 22 03:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1682. Apr 22 03:41:38 hp-epyc kernel: (detected by 0, t=16080447 jiffies, g=1051549, q=44529597)
  1683. Apr 22 03:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1684. Apr 22 03:41:38 hp-epyc kernel: Call Trace:
  1685. Apr 22 03:41:38 hp-epyc kernel: <TASK>
  1686. Apr 22 03:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1687. Apr 22 03:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1688. Apr 22 03:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1689. Apr 22 03:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1690. Apr 22 03:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1691. Apr 22 03:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1692. Apr 22 03:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1693. Apr 22 03:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1694. Apr 22 03:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1695. Apr 22 03:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1696. Apr 22 03:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1697. Apr 22 03:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1698. Apr 22 03:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  1699. Apr 22 03:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1700. Apr 22 03:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1701. Apr 22 03:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1702. Apr 22 03:41:38 hp-epyc kernel: </TASK>
  1703. Apr 22 03:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1704. Apr 22 03:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1705. Apr 22 03:44:38 hp-epyc kernel: (detected by 0, t=16260452 jiffies, g=1051549, q=44599555)
  1706. Apr 22 03:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1707. Apr 22 03:44:38 hp-epyc kernel: Call Trace:
  1708. Apr 22 03:44:38 hp-epyc kernel: <TASK>
  1709. Apr 22 03:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1710. Apr 22 03:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1711. Apr 22 03:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1712. Apr 22 03:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1713. Apr 22 03:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1714. Apr 22 03:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1715. Apr 22 03:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1716. Apr 22 03:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1717. Apr 22 03:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1718. Apr 22 03:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1719. Apr 22 03:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1720. Apr 22 03:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1721. Apr 22 03:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  1722. Apr 22 03:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1723. Apr 22 03:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1724. Apr 22 03:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1725. Apr 22 03:44:38 hp-epyc kernel: </TASK>
  1726. Apr 22 03:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1727. Apr 22 03:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1728. Apr 22 03:50:38 hp-epyc kernel: (detected by 53, t=16440457 jiffies, g=1051549, q=44669187)
  1729. Apr 22 03:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1730. Apr 22 03:50:38 hp-epyc kernel: Call Trace:
  1731. Apr 22 03:50:38 hp-epyc kernel: <TASK>
  1732. Apr 22 03:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1733. Apr 22 03:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1734. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1735. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1736. Apr 22 03:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1737. Apr 22 03:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1738. Apr 22 03:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1739. Apr 22 03:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1740. Apr 22 03:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1741. Apr 22 03:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1742. Apr 22 03:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1743. Apr 22 03:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1744. Apr 22 03:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  1745. Apr 22 03:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1746. Apr 22 03:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1747. Apr 22 03:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1748. Apr 22 03:50:38 hp-epyc kernel: </TASK>
  1749. Apr 22 03:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1750. Apr 22 03:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1751. Apr 22 03:50:38 hp-epyc kernel: (detected by 0, t=16620462 jiffies, g=1051549, q=44740497)
  1752. Apr 22 03:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1753. Apr 22 03:50:38 hp-epyc kernel: Call Trace:
  1754. Apr 22 03:50:38 hp-epyc kernel: <TASK>
  1755. Apr 22 03:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1756. Apr 22 03:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1757. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1758. Apr 22 03:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1759. Apr 22 03:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1760. Apr 22 03:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1761. Apr 22 03:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1762. Apr 22 03:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1763. Apr 22 03:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1764. Apr 22 03:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1765. Apr 22 03:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1766. Apr 22 03:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1767. Apr 22 03:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  1768. Apr 22 03:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1769. Apr 22 03:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1770. Apr 22 03:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1771. Apr 22 03:50:38 hp-epyc kernel: </TASK>
  1772. Apr 22 03:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1773. Apr 22 03:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1774. Apr 22 03:53:38 hp-epyc kernel: (detected by 0, t=16800467 jiffies, g=1051549, q=44808454)
  1775. Apr 22 03:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1776. Apr 22 03:53:38 hp-epyc kernel: Call Trace:
  1777. Apr 22 03:53:38 hp-epyc kernel: <TASK>
  1778. Apr 22 03:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1779. Apr 22 03:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1780. Apr 22 03:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1781. Apr 22 03:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1782. Apr 22 03:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1783. Apr 22 03:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1784. Apr 22 03:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1785. Apr 22 03:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1786. Apr 22 03:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1787. Apr 22 03:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1788. Apr 22 03:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1789. Apr 22 03:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1790. Apr 22 03:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  1791. Apr 22 03:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1792. Apr 22 03:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1793. Apr 22 03:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1794. Apr 22 03:53:38 hp-epyc kernel: </TASK>
  1795. Apr 22 03:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1796. Apr 22 03:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1797. Apr 22 03:56:38 hp-epyc kernel: (detected by 0, t=16980472 jiffies, g=1051549, q=44875941)
  1798. Apr 22 03:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1799. Apr 22 03:56:38 hp-epyc kernel: Call Trace:
  1800. Apr 22 03:56:38 hp-epyc kernel: <TASK>
  1801. Apr 22 03:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1802. Apr 22 03:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1803. Apr 22 03:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1804. Apr 22 03:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1805. Apr 22 03:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1806. Apr 22 03:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1807. Apr 22 03:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1808. Apr 22 03:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1809. Apr 22 03:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1810. Apr 22 03:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1811. Apr 22 03:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1812. Apr 22 03:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1813. Apr 22 03:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  1814. Apr 22 03:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1815. Apr 22 03:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1816. Apr 22 03:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1817. Apr 22 03:56:38 hp-epyc kernel: </TASK>
  1818. Apr 22 03:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1819. Apr 22 03:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1820. Apr 22 03:59:38 hp-epyc kernel: (detected by 0, t=17160477 jiffies, g=1051549, q=44945246)
  1821. Apr 22 03:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1822. Apr 22 03:59:38 hp-epyc kernel: Call Trace:
  1823. Apr 22 03:59:38 hp-epyc kernel: <TASK>
  1824. Apr 22 03:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1825. Apr 22 03:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1826. Apr 22 03:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1827. Apr 22 03:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1828. Apr 22 03:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1829. Apr 22 03:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1830. Apr 22 03:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1831. Apr 22 03:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1832. Apr 22 03:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1833. Apr 22 03:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1834. Apr 22 03:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1835. Apr 22 03:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1836. Apr 22 03:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  1837. Apr 22 03:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1838. Apr 22 03:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1839. Apr 22 03:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1840. Apr 22 03:59:38 hp-epyc kernel: </TASK>
  1841. Apr 22 04:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1842. Apr 22 04:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1843. Apr 22 04:02:38 hp-epyc kernel: (detected by 0, t=17340482 jiffies, g=1051549, q=45010981)
  1844. Apr 22 04:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1845. Apr 22 04:02:38 hp-epyc kernel: Call Trace:
  1846. Apr 22 04:02:38 hp-epyc kernel: <TASK>
  1847. Apr 22 04:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1848. Apr 22 04:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1849. Apr 22 04:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1850. Apr 22 04:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1851. Apr 22 04:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1852. Apr 22 04:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1853. Apr 22 04:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1854. Apr 22 04:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1855. Apr 22 04:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1856. Apr 22 04:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1857. Apr 22 04:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1858. Apr 22 04:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1859. Apr 22 04:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  1860. Apr 22 04:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1861. Apr 22 04:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1862. Apr 22 04:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1863. Apr 22 04:02:38 hp-epyc kernel: </TASK>
  1864. Apr 22 04:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1865. Apr 22 04:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1866. Apr 22 04:05:38 hp-epyc kernel: (detected by 0, t=17520487 jiffies, g=1051549, q=45081057)
  1867. Apr 22 04:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1868. Apr 22 04:05:38 hp-epyc kernel: Call Trace:
  1869. Apr 22 04:05:38 hp-epyc kernel: <TASK>
  1870. Apr 22 04:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1871. Apr 22 04:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1872. Apr 22 04:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1873. Apr 22 04:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1874. Apr 22 04:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1875. Apr 22 04:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1876. Apr 22 04:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1877. Apr 22 04:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1878. Apr 22 04:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1879. Apr 22 04:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1880. Apr 22 04:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1881. Apr 22 04:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1882. Apr 22 04:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  1883. Apr 22 04:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1884. Apr 22 04:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1885. Apr 22 04:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1886. Apr 22 04:05:38 hp-epyc kernel: </TASK>
  1887. Apr 22 04:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1888. Apr 22 04:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1889. Apr 22 04:08:38 hp-epyc kernel: (detected by 0, t=17700492 jiffies, g=1051549, q=45152685)
  1890. Apr 22 04:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1891. Apr 22 04:08:38 hp-epyc kernel: Call Trace:
  1892. Apr 22 04:08:38 hp-epyc kernel: <TASK>
  1893. Apr 22 04:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1894. Apr 22 04:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1895. Apr 22 04:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1896. Apr 22 04:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1897. Apr 22 04:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1898. Apr 22 04:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1899. Apr 22 04:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1900. Apr 22 04:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1901. Apr 22 04:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1902. Apr 22 04:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1903. Apr 22 04:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1904. Apr 22 04:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1905. Apr 22 04:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  1906. Apr 22 04:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1907. Apr 22 04:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1908. Apr 22 04:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1909. Apr 22 04:08:38 hp-epyc kernel: </TASK>
  1910. Apr 22 04:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1911. Apr 22 04:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1912. Apr 22 04:11:38 hp-epyc kernel: (detected by 0, t=17880497 jiffies, g=1051549, q=45222556)
  1913. Apr 22 04:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1914. Apr 22 04:11:38 hp-epyc kernel: Call Trace:
  1915. Apr 22 04:11:38 hp-epyc kernel: <TASK>
  1916. Apr 22 04:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1917. Apr 22 04:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1918. Apr 22 04:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1919. Apr 22 04:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1920. Apr 22 04:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1921. Apr 22 04:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1922. Apr 22 04:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1923. Apr 22 04:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1924. Apr 22 04:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1925. Apr 22 04:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1926. Apr 22 04:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1927. Apr 22 04:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1928. Apr 22 04:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  1929. Apr 22 04:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1930. Apr 22 04:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1931. Apr 22 04:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1932. Apr 22 04:11:38 hp-epyc kernel: </TASK>
  1933. Apr 22 04:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1934. Apr 22 04:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1935. Apr 22 04:14:38 hp-epyc kernel: (detected by 0, t=18060502 jiffies, g=1051549, q=45291648)
  1936. Apr 22 04:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1937. Apr 22 04:14:38 hp-epyc kernel: Call Trace:
  1938. Apr 22 04:14:38 hp-epyc kernel: <TASK>
  1939. Apr 22 04:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1940. Apr 22 04:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1941. Apr 22 04:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1942. Apr 22 04:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1943. Apr 22 04:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1944. Apr 22 04:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1945. Apr 22 04:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1946. Apr 22 04:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1947. Apr 22 04:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1948. Apr 22 04:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1949. Apr 22 04:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1950. Apr 22 04:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1951. Apr 22 04:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  1952. Apr 22 04:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1953. Apr 22 04:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1954. Apr 22 04:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1955. Apr 22 04:14:38 hp-epyc kernel: </TASK>
  1956. Apr 22 04:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1957. Apr 22 04:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1958. Apr 22 04:17:38 hp-epyc kernel: (detected by 0, t=18240507 jiffies, g=1051549, q=45360384)
  1959. Apr 22 04:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1960. Apr 22 04:17:38 hp-epyc kernel: Call Trace:
  1961. Apr 22 04:17:38 hp-epyc kernel: <TASK>
  1962. Apr 22 04:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1963. Apr 22 04:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1964. Apr 22 04:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1965. Apr 22 04:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1966. Apr 22 04:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1967. Apr 22 04:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1968. Apr 22 04:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1969. Apr 22 04:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1970. Apr 22 04:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1971. Apr 22 04:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1972. Apr 22 04:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1973. Apr 22 04:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1974. Apr 22 04:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  1975. Apr 22 04:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1976. Apr 22 04:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  1977. Apr 22 04:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  1978. Apr 22 04:17:38 hp-epyc kernel: </TASK>
  1979. Apr 22 04:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  1980. Apr 22 04:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  1981. Apr 22 04:20:38 hp-epyc kernel: (detected by 0, t=18420512 jiffies, g=1051549, q=45429874)
  1982. Apr 22 04:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  1983. Apr 22 04:20:38 hp-epyc kernel: Call Trace:
  1984. Apr 22 04:20:38 hp-epyc kernel: <TASK>
  1985. Apr 22 04:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  1986. Apr 22 04:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  1987. Apr 22 04:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  1988. Apr 22 04:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  1989. Apr 22 04:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  1990. Apr 22 04:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  1991. Apr 22 04:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  1992. Apr 22 04:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  1993. Apr 22 04:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  1994. Apr 22 04:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  1995. Apr 22 04:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  1996. Apr 22 04:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  1997. Apr 22 04:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  1998. Apr 22 04:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  1999. Apr 22 04:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2000. Apr 22 04:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2001. Apr 22 04:20:38 hp-epyc kernel: </TASK>
  2002. Apr 22 04:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2003. Apr 22 04:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2004. Apr 22 04:23:38 hp-epyc kernel: (detected by 0, t=18600517 jiffies, g=1051549, q=45499635)
  2005. Apr 22 04:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2006. Apr 22 04:23:38 hp-epyc kernel: Call Trace:
  2007. Apr 22 04:23:38 hp-epyc kernel: <TASK>
  2008. Apr 22 04:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2009. Apr 22 04:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2010. Apr 22 04:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2011. Apr 22 04:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2012. Apr 22 04:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2013. Apr 22 04:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2014. Apr 22 04:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2015. Apr 22 04:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2016. Apr 22 04:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2017. Apr 22 04:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2018. Apr 22 04:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2019. Apr 22 04:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2020. Apr 22 04:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  2021. Apr 22 04:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2022. Apr 22 04:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2023. Apr 22 04:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2024. Apr 22 04:23:38 hp-epyc kernel: </TASK>
  2025. Apr 22 04:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2026. Apr 22 04:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2027. Apr 22 04:26:38 hp-epyc kernel: (detected by 0, t=18780522 jiffies, g=1051549, q=45566737)
  2028. Apr 22 04:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2029. Apr 22 04:26:38 hp-epyc kernel: Call Trace:
  2030. Apr 22 04:26:38 hp-epyc kernel: <TASK>
  2031. Apr 22 04:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2032. Apr 22 04:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2033. Apr 22 04:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2034. Apr 22 04:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2035. Apr 22 04:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2036. Apr 22 04:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2037. Apr 22 04:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2038. Apr 22 04:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2039. Apr 22 04:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2040. Apr 22 04:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2041. Apr 22 04:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2042. Apr 22 04:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2043. Apr 22 04:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  2044. Apr 22 04:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2045. Apr 22 04:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2046. Apr 22 04:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2047. Apr 22 04:26:38 hp-epyc kernel: </TASK>
  2048. Apr 22 04:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2049. Apr 22 04:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2050. Apr 22 04:29:38 hp-epyc kernel: (detected by 0, t=18960527 jiffies, g=1051549, q=45636964)
  2051. Apr 22 04:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2052. Apr 22 04:29:38 hp-epyc kernel: Call Trace:
  2053. Apr 22 04:29:38 hp-epyc kernel: <TASK>
  2054. Apr 22 04:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2055. Apr 22 04:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2056. Apr 22 04:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2057. Apr 22 04:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2058. Apr 22 04:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2059. Apr 22 04:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2060. Apr 22 04:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2061. Apr 22 04:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2062. Apr 22 04:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2063. Apr 22 04:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2064. Apr 22 04:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2065. Apr 22 04:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2066. Apr 22 04:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  2067. Apr 22 04:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2068. Apr 22 04:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2069. Apr 22 04:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2070. Apr 22 04:29:38 hp-epyc kernel: </TASK>
  2071. Apr 22 04:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2072. Apr 22 04:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2073. Apr 22 04:32:38 hp-epyc kernel: (detected by 0, t=19140532 jiffies, g=1051549, q=45704064)
  2074. Apr 22 04:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2075. Apr 22 04:32:38 hp-epyc kernel: Call Trace:
  2076. Apr 22 04:32:38 hp-epyc kernel: <TASK>
  2077. Apr 22 04:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2078. Apr 22 04:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2079. Apr 22 04:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2080. Apr 22 04:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2081. Apr 22 04:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2082. Apr 22 04:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2083. Apr 22 04:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2084. Apr 22 04:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2085. Apr 22 04:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2086. Apr 22 04:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2087. Apr 22 04:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2088. Apr 22 04:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2089. Apr 22 04:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2090. Apr 22 04:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2091. Apr 22 04:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2092. Apr 22 04:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2093. Apr 22 04:32:38 hp-epyc kernel: </TASK>
  2094. Apr 22 04:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2095. Apr 22 04:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2096. Apr 22 04:35:38 hp-epyc kernel: (detected by 0, t=19320537 jiffies, g=1051549, q=45778498)
  2097. Apr 22 04:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2098. Apr 22 04:35:38 hp-epyc kernel: Call Trace:
  2099. Apr 22 04:35:38 hp-epyc kernel: <TASK>
  2100. Apr 22 04:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2101. Apr 22 04:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2102. Apr 22 04:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2103. Apr 22 04:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2104. Apr 22 04:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2105. Apr 22 04:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2106. Apr 22 04:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2107. Apr 22 04:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2108. Apr 22 04:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2109. Apr 22 04:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2110. Apr 22 04:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2111. Apr 22 04:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2112. Apr 22 04:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  2113. Apr 22 04:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2114. Apr 22 04:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2115. Apr 22 04:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2116. Apr 22 04:35:38 hp-epyc kernel: </TASK>
  2117. Apr 22 04:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2118. Apr 22 04:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2119. Apr 22 04:38:38 hp-epyc kernel: (detected by 0, t=19500542 jiffies, g=1051549, q=45848126)
  2120. Apr 22 04:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2121. Apr 22 04:38:38 hp-epyc kernel: Call Trace:
  2122. Apr 22 04:38:38 hp-epyc kernel: <TASK>
  2123. Apr 22 04:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2124. Apr 22 04:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2125. Apr 22 04:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2126. Apr 22 04:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2127. Apr 22 04:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2128. Apr 22 04:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2129. Apr 22 04:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2130. Apr 22 04:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2131. Apr 22 04:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2132. Apr 22 04:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2133. Apr 22 04:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2134. Apr 22 04:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2135. Apr 22 04:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  2136. Apr 22 04:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2137. Apr 22 04:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2138. Apr 22 04:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2139. Apr 22 04:38:38 hp-epyc kernel: </TASK>
  2140. Apr 22 04:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2141. Apr 22 04:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2142. Apr 22 04:44:38 hp-epyc kernel: (detected by 53, t=19680547 jiffies, g=1051549, q=45915847)
  2143. Apr 22 04:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2144. Apr 22 04:44:38 hp-epyc kernel: Call Trace:
  2145. Apr 22 04:44:38 hp-epyc kernel: <TASK>
  2146. Apr 22 04:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2147. Apr 22 04:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2148. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2149. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2150. Apr 22 04:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2151. Apr 22 04:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2152. Apr 22 04:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2153. Apr 22 04:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2154. Apr 22 04:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2155. Apr 22 04:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2156. Apr 22 04:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2157. Apr 22 04:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2158. Apr 22 04:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  2159. Apr 22 04:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2160. Apr 22 04:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2161. Apr 22 04:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2162. Apr 22 04:44:38 hp-epyc kernel: </TASK>
  2163. Apr 22 04:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2164. Apr 22 04:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2165. Apr 22 04:44:38 hp-epyc kernel: (detected by 0, t=19860552 jiffies, g=1051549, q=45986400)
  2166. Apr 22 04:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2167. Apr 22 04:44:38 hp-epyc kernel: Call Trace:
  2168. Apr 22 04:44:38 hp-epyc kernel: <TASK>
  2169. Apr 22 04:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2170. Apr 22 04:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2171. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2172. Apr 22 04:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2173. Apr 22 04:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2174. Apr 22 04:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2175. Apr 22 04:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2176. Apr 22 04:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2177. Apr 22 04:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2178. Apr 22 04:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2179. Apr 22 04:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2180. Apr 22 04:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2181. Apr 22 04:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  2182. Apr 22 04:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2183. Apr 22 04:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2184. Apr 22 04:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2185. Apr 22 04:44:38 hp-epyc kernel: </TASK>
  2186. Apr 22 04:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2187. Apr 22 04:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2188. Apr 22 04:47:38 hp-epyc kernel: (detected by 0, t=20040557 jiffies, g=1051549, q=46056444)
  2189. Apr 22 04:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2190. Apr 22 04:47:38 hp-epyc kernel: Call Trace:
  2191. Apr 22 04:47:38 hp-epyc kernel: <TASK>
  2192. Apr 22 04:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2193. Apr 22 04:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2194. Apr 22 04:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2195. Apr 22 04:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2196. Apr 22 04:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2197. Apr 22 04:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2198. Apr 22 04:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2199. Apr 22 04:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2200. Apr 22 04:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2201. Apr 22 04:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2202. Apr 22 04:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2203. Apr 22 04:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2204. Apr 22 04:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  2205. Apr 22 04:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2206. Apr 22 04:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2207. Apr 22 04:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2208. Apr 22 04:47:38 hp-epyc kernel: </TASK>
  2209. Apr 22 04:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2210. Apr 22 04:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2211. Apr 22 04:50:38 hp-epyc kernel: (detected by 0, t=20220562 jiffies, g=1051549, q=46129040)
  2212. Apr 22 04:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2213. Apr 22 04:50:38 hp-epyc kernel: Call Trace:
  2214. Apr 22 04:50:38 hp-epyc kernel: <TASK>
  2215. Apr 22 04:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2216. Apr 22 04:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2217. Apr 22 04:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2218. Apr 22 04:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2219. Apr 22 04:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2220. Apr 22 04:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2221. Apr 22 04:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2222. Apr 22 04:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2223. Apr 22 04:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2224. Apr 22 04:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2225. Apr 22 04:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2226. Apr 22 04:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2227. Apr 22 04:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  2228. Apr 22 04:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2229. Apr 22 04:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2230. Apr 22 04:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2231. Apr 22 04:50:38 hp-epyc kernel: </TASK>
  2232. Apr 22 04:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2233. Apr 22 04:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2234. Apr 22 04:53:38 hp-epyc kernel: (detected by 0, t=20400567 jiffies, g=1051549, q=46198670)
  2235. Apr 22 04:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2236. Apr 22 04:53:38 hp-epyc kernel: Call Trace:
  2237. Apr 22 04:53:38 hp-epyc kernel: <TASK>
  2238. Apr 22 04:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2239. Apr 22 04:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2240. Apr 22 04:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2241. Apr 22 04:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2242. Apr 22 04:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2243. Apr 22 04:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2244. Apr 22 04:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2245. Apr 22 04:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2246. Apr 22 04:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2247. Apr 22 04:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2248. Apr 22 04:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2249. Apr 22 04:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2250. Apr 22 04:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  2251. Apr 22 04:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2252. Apr 22 04:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2253. Apr 22 04:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2254. Apr 22 04:53:38 hp-epyc kernel: </TASK>
  2255. Apr 22 04:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2256. Apr 22 04:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2257. Apr 22 04:56:38 hp-epyc kernel: (detected by 0, t=20580572 jiffies, g=1051549, q=46268433)
  2258. Apr 22 04:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2259. Apr 22 04:56:38 hp-epyc kernel: Call Trace:
  2260. Apr 22 04:56:38 hp-epyc kernel: <TASK>
  2261. Apr 22 04:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2262. Apr 22 04:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2263. Apr 22 04:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2264. Apr 22 04:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2265. Apr 22 04:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2266. Apr 22 04:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2267. Apr 22 04:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2268. Apr 22 04:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2269. Apr 22 04:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2270. Apr 22 04:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2271. Apr 22 04:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2272. Apr 22 04:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2273. Apr 22 04:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  2274. Apr 22 04:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2275. Apr 22 04:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2276. Apr 22 04:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2277. Apr 22 04:56:38 hp-epyc kernel: </TASK>
  2278. Apr 22 05:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2279. Apr 22 05:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2280. Apr 22 05:02:38 hp-epyc kernel: (detected by 53, t=20760577 jiffies, g=1051549, q=46338587)
  2281. Apr 22 05:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2282. Apr 22 05:02:38 hp-epyc kernel: Call Trace:
  2283. Apr 22 05:02:38 hp-epyc kernel: <TASK>
  2284. Apr 22 05:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2285. Apr 22 05:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2286. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2287. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2288. Apr 22 05:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2289. Apr 22 05:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2290. Apr 22 05:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2291. Apr 22 05:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2292. Apr 22 05:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2293. Apr 22 05:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2294. Apr 22 05:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2295. Apr 22 05:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2296. Apr 22 05:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2297. Apr 22 05:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2298. Apr 22 05:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2299. Apr 22 05:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2300. Apr 22 05:02:38 hp-epyc kernel: </TASK>
  2301. Apr 22 05:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2302. Apr 22 05:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2303. Apr 22 05:02:38 hp-epyc kernel: (detected by 0, t=20940582 jiffies, g=1051549, q=46407036)
  2304. Apr 22 05:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2305. Apr 22 05:02:38 hp-epyc kernel: Call Trace:
  2306. Apr 22 05:02:38 hp-epyc kernel: <TASK>
  2307. Apr 22 05:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2308. Apr 22 05:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2309. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2310. Apr 22 05:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2311. Apr 22 05:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2312. Apr 22 05:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2313. Apr 22 05:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2314. Apr 22 05:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2315. Apr 22 05:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2316. Apr 22 05:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2317. Apr 22 05:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2318. Apr 22 05:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2319. Apr 22 05:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2320. Apr 22 05:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2321. Apr 22 05:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2322. Apr 22 05:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2323. Apr 22 05:02:38 hp-epyc kernel: </TASK>
  2324. Apr 22 05:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2325. Apr 22 05:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2326. Apr 22 05:05:38 hp-epyc kernel: (detected by 0, t=21120587 jiffies, g=1051549, q=46477314)
  2327. Apr 22 05:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2328. Apr 22 05:05:38 hp-epyc kernel: Call Trace:
  2329. Apr 22 05:05:38 hp-epyc kernel: <TASK>
  2330. Apr 22 05:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2331. Apr 22 05:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2332. Apr 22 05:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2333. Apr 22 05:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2334. Apr 22 05:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2335. Apr 22 05:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2336. Apr 22 05:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2337. Apr 22 05:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2338. Apr 22 05:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2339. Apr 22 05:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2340. Apr 22 05:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2341. Apr 22 05:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2342. Apr 22 05:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  2343. Apr 22 05:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2344. Apr 22 05:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2345. Apr 22 05:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2346. Apr 22 05:05:38 hp-epyc kernel: </TASK>
  2347. Apr 22 05:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2348. Apr 22 05:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2349. Apr 22 05:11:38 hp-epyc kernel: (detected by 53, t=21300592 jiffies, g=1051549, q=46547926)
  2350. Apr 22 05:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2351. Apr 22 05:11:38 hp-epyc kernel: Call Trace:
  2352. Apr 22 05:11:38 hp-epyc kernel: <TASK>
  2353. Apr 22 05:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2354. Apr 22 05:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2355. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2356. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2357. Apr 22 05:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2358. Apr 22 05:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2359. Apr 22 05:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2360. Apr 22 05:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2361. Apr 22 05:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2362. Apr 22 05:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2363. Apr 22 05:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2364. Apr 22 05:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2365. Apr 22 05:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  2366. Apr 22 05:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2367. Apr 22 05:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2368. Apr 22 05:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2369. Apr 22 05:11:38 hp-epyc kernel: </TASK>
  2370. Apr 22 05:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2371. Apr 22 05:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2372. Apr 22 05:11:38 hp-epyc kernel: (detected by 0, t=21480597 jiffies, g=1051549, q=46615612)
  2373. Apr 22 05:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2374. Apr 22 05:11:38 hp-epyc kernel: Call Trace:
  2375. Apr 22 05:11:38 hp-epyc kernel: <TASK>
  2376. Apr 22 05:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2377. Apr 22 05:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2378. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2379. Apr 22 05:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2380. Apr 22 05:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2381. Apr 22 05:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2382. Apr 22 05:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2383. Apr 22 05:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2384. Apr 22 05:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2385. Apr 22 05:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2386. Apr 22 05:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2387. Apr 22 05:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2388. Apr 22 05:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  2389. Apr 22 05:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2390. Apr 22 05:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2391. Apr 22 05:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2392. Apr 22 05:11:38 hp-epyc kernel: </TASK>
  2393. Apr 22 05:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2394. Apr 22 05:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2395. Apr 22 05:14:38 hp-epyc kernel: (detected by 0, t=21660602 jiffies, g=1051549, q=46685224)
  2396. Apr 22 05:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2397. Apr 22 05:14:38 hp-epyc kernel: Call Trace:
  2398. Apr 22 05:14:38 hp-epyc kernel: <TASK>
  2399. Apr 22 05:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2400. Apr 22 05:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2401. Apr 22 05:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2402. Apr 22 05:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2403. Apr 22 05:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2404. Apr 22 05:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2405. Apr 22 05:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2406. Apr 22 05:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2407. Apr 22 05:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2408. Apr 22 05:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2409. Apr 22 05:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2410. Apr 22 05:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2411. Apr 22 05:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  2412. Apr 22 05:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2413. Apr 22 05:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2414. Apr 22 05:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2415. Apr 22 05:14:38 hp-epyc kernel: </TASK>
  2416. Apr 22 05:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2417. Apr 22 05:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2418. Apr 22 05:17:38 hp-epyc kernel: (detected by 0, t=21840607 jiffies, g=1051549, q=46754062)
  2419. Apr 22 05:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2420. Apr 22 05:17:38 hp-epyc kernel: Call Trace:
  2421. Apr 22 05:17:38 hp-epyc kernel: <TASK>
  2422. Apr 22 05:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2423. Apr 22 05:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2424. Apr 22 05:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2425. Apr 22 05:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2426. Apr 22 05:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2427. Apr 22 05:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2428. Apr 22 05:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2429. Apr 22 05:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2430. Apr 22 05:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2431. Apr 22 05:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2432. Apr 22 05:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2433. Apr 22 05:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2434. Apr 22 05:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  2435. Apr 22 05:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2436. Apr 22 05:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2437. Apr 22 05:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2438. Apr 22 05:17:38 hp-epyc kernel: </TASK>
  2439. Apr 22 05:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2440. Apr 22 05:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2441. Apr 22 05:20:38 hp-epyc kernel: (detected by 0, t=22020612 jiffies, g=1051549, q=46823999)
  2442. Apr 22 05:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2443. Apr 22 05:20:38 hp-epyc kernel: Call Trace:
  2444. Apr 22 05:20:38 hp-epyc kernel: <TASK>
  2445. Apr 22 05:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2446. Apr 22 05:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2447. Apr 22 05:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2448. Apr 22 05:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2449. Apr 22 05:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2450. Apr 22 05:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2451. Apr 22 05:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2452. Apr 22 05:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2453. Apr 22 05:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2454. Apr 22 05:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2455. Apr 22 05:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2456. Apr 22 05:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2457. Apr 22 05:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  2458. Apr 22 05:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2459. Apr 22 05:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2460. Apr 22 05:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2461. Apr 22 05:20:38 hp-epyc kernel: </TASK>
  2462. Apr 22 05:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2463. Apr 22 05:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2464. Apr 22 05:23:38 hp-epyc kernel: (detected by 0, t=22200617 jiffies, g=1051549, q=46894131)
  2465. Apr 22 05:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2466. Apr 22 05:23:38 hp-epyc kernel: Call Trace:
  2467. Apr 22 05:23:38 hp-epyc kernel: <TASK>
  2468. Apr 22 05:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2469. Apr 22 05:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2470. Apr 22 05:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2471. Apr 22 05:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2472. Apr 22 05:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2473. Apr 22 05:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2474. Apr 22 05:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2475. Apr 22 05:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2476. Apr 22 05:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2477. Apr 22 05:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2478. Apr 22 05:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2479. Apr 22 05:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2480. Apr 22 05:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  2481. Apr 22 05:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2482. Apr 22 05:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2483. Apr 22 05:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2484. Apr 22 05:23:38 hp-epyc kernel: </TASK>
  2485. Apr 22 05:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2486. Apr 22 05:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2487. Apr 22 05:26:38 hp-epyc kernel: (detected by 0, t=22380622 jiffies, g=1051549, q=46961925)
  2488. Apr 22 05:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2489. Apr 22 05:26:38 hp-epyc kernel: Call Trace:
  2490. Apr 22 05:26:38 hp-epyc kernel: <TASK>
  2491. Apr 22 05:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2492. Apr 22 05:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2493. Apr 22 05:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2494. Apr 22 05:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2495. Apr 22 05:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2496. Apr 22 05:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2497. Apr 22 05:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2498. Apr 22 05:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2499. Apr 22 05:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2500. Apr 22 05:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2501. Apr 22 05:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2502. Apr 22 05:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2503. Apr 22 05:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  2504. Apr 22 05:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2505. Apr 22 05:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2506. Apr 22 05:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2507. Apr 22 05:26:38 hp-epyc kernel: </TASK>
  2508. Apr 22 05:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2509. Apr 22 05:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2510. Apr 22 05:29:38 hp-epyc kernel: (detected by 0, t=22560627 jiffies, g=1051549, q=47032041)
  2511. Apr 22 05:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2512. Apr 22 05:29:38 hp-epyc kernel: Call Trace:
  2513. Apr 22 05:29:38 hp-epyc kernel: <TASK>
  2514. Apr 22 05:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2515. Apr 22 05:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2516. Apr 22 05:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2517. Apr 22 05:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2518. Apr 22 05:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2519. Apr 22 05:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2520. Apr 22 05:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2521. Apr 22 05:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2522. Apr 22 05:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2523. Apr 22 05:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2524. Apr 22 05:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2525. Apr 22 05:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2526. Apr 22 05:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  2527. Apr 22 05:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2528. Apr 22 05:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2529. Apr 22 05:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2530. Apr 22 05:29:38 hp-epyc kernel: </TASK>
  2531. Apr 22 05:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2532. Apr 22 05:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2533. Apr 22 05:32:38 hp-epyc kernel: (detected by 0, t=22740632 jiffies, g=1051549, q=47102144)
  2534. Apr 22 05:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2535. Apr 22 05:32:38 hp-epyc kernel: Call Trace:
  2536. Apr 22 05:32:38 hp-epyc kernel: <TASK>
  2537. Apr 22 05:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2538. Apr 22 05:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2539. Apr 22 05:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2540. Apr 22 05:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2541. Apr 22 05:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2542. Apr 22 05:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2543. Apr 22 05:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2544. Apr 22 05:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2545. Apr 22 05:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2546. Apr 22 05:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2547. Apr 22 05:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2548. Apr 22 05:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2549. Apr 22 05:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2550. Apr 22 05:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2551. Apr 22 05:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2552. Apr 22 05:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2553. Apr 22 05:32:38 hp-epyc kernel: </TASK>
  2554. Apr 22 05:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2555. Apr 22 05:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2556. Apr 22 05:35:38 hp-epyc kernel: (detected by 0, t=22920637 jiffies, g=1051549, q=47176871)
  2557. Apr 22 05:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2558. Apr 22 05:35:38 hp-epyc kernel: Call Trace:
  2559. Apr 22 05:35:38 hp-epyc kernel: <TASK>
  2560. Apr 22 05:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2561. Apr 22 05:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2562. Apr 22 05:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2563. Apr 22 05:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2564. Apr 22 05:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2565. Apr 22 05:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2566. Apr 22 05:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2567. Apr 22 05:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2568. Apr 22 05:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2569. Apr 22 05:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2570. Apr 22 05:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2571. Apr 22 05:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2572. Apr 22 05:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  2573. Apr 22 05:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2574. Apr 22 05:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2575. Apr 22 05:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2576. Apr 22 05:35:38 hp-epyc kernel: </TASK>
  2577. Apr 22 05:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2578. Apr 22 05:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2579. Apr 22 05:38:38 hp-epyc kernel: (detected by 0, t=23100642 jiffies, g=1051549, q=47246811)
  2580. Apr 22 05:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2581. Apr 22 05:38:38 hp-epyc kernel: Call Trace:
  2582. Apr 22 05:38:38 hp-epyc kernel: <TASK>
  2583. Apr 22 05:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2584. Apr 22 05:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2585. Apr 22 05:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2586. Apr 22 05:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2587. Apr 22 05:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2588. Apr 22 05:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2589. Apr 22 05:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2590. Apr 22 05:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2591. Apr 22 05:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2592. Apr 22 05:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2593. Apr 22 05:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2594. Apr 22 05:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2595. Apr 22 05:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  2596. Apr 22 05:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2597. Apr 22 05:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2598. Apr 22 05:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2599. Apr 22 05:38:38 hp-epyc kernel: </TASK>
  2600. Apr 22 05:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2601. Apr 22 05:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2602. Apr 22 05:41:38 hp-epyc kernel: (detected by 0, t=23280647 jiffies, g=1051549, q=47315513)
  2603. Apr 22 05:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2604. Apr 22 05:41:38 hp-epyc kernel: Call Trace:
  2605. Apr 22 05:41:38 hp-epyc kernel: <TASK>
  2606. Apr 22 05:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2607. Apr 22 05:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2608. Apr 22 05:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2609. Apr 22 05:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2610. Apr 22 05:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2611. Apr 22 05:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2612. Apr 22 05:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2613. Apr 22 05:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2614. Apr 22 05:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2615. Apr 22 05:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2616. Apr 22 05:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2617. Apr 22 05:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2618. Apr 22 05:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  2619. Apr 22 05:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2620. Apr 22 05:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2621. Apr 22 05:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2622. Apr 22 05:41:38 hp-epyc kernel: </TASK>
  2623. Apr 22 05:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2624. Apr 22 05:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2625. Apr 22 05:44:38 hp-epyc kernel: (detected by 0, t=23460652 jiffies, g=1051549, q=47385102)
  2626. Apr 22 05:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2627. Apr 22 05:44:38 hp-epyc kernel: Call Trace:
  2628. Apr 22 05:44:38 hp-epyc kernel: <TASK>
  2629. Apr 22 05:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2630. Apr 22 05:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2631. Apr 22 05:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2632. Apr 22 05:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2633. Apr 22 05:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2634. Apr 22 05:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2635. Apr 22 05:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2636. Apr 22 05:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2637. Apr 22 05:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2638. Apr 22 05:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2639. Apr 22 05:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2640. Apr 22 05:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2641. Apr 22 05:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  2642. Apr 22 05:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2643. Apr 22 05:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2644. Apr 22 05:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2645. Apr 22 05:44:38 hp-epyc kernel: </TASK>
  2646. Apr 22 05:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2647. Apr 22 05:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2648. Apr 22 05:47:38 hp-epyc kernel: (detected by 0, t=23640657 jiffies, g=1051549, q=47451357)
  2649. Apr 22 05:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2650. Apr 22 05:47:38 hp-epyc kernel: Call Trace:
  2651. Apr 22 05:47:38 hp-epyc kernel: <TASK>
  2652. Apr 22 05:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2653. Apr 22 05:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2654. Apr 22 05:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2655. Apr 22 05:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2656. Apr 22 05:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2657. Apr 22 05:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2658. Apr 22 05:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2659. Apr 22 05:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2660. Apr 22 05:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2661. Apr 22 05:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2662. Apr 22 05:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2663. Apr 22 05:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2664. Apr 22 05:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  2665. Apr 22 05:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2666. Apr 22 05:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2667. Apr 22 05:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2668. Apr 22 05:47:38 hp-epyc kernel: </TASK>
  2669. Apr 22 05:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2670. Apr 22 05:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2671. Apr 22 05:50:38 hp-epyc kernel: (detected by 0, t=23820662 jiffies, g=1051549, q=47521550)
  2672. Apr 22 05:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2673. Apr 22 05:50:38 hp-epyc kernel: Call Trace:
  2674. Apr 22 05:50:38 hp-epyc kernel: <TASK>
  2675. Apr 22 05:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2676. Apr 22 05:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2677. Apr 22 05:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2678. Apr 22 05:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2679. Apr 22 05:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2680. Apr 22 05:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2681. Apr 22 05:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2682. Apr 22 05:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2683. Apr 22 05:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2684. Apr 22 05:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2685. Apr 22 05:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2686. Apr 22 05:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2687. Apr 22 05:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  2688. Apr 22 05:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2689. Apr 22 05:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2690. Apr 22 05:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2691. Apr 22 05:50:38 hp-epyc kernel: </TASK>
  2692. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2693. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2694. Apr 22 06:02:38 hp-epyc kernel: (detected by 53, t=24000667 jiffies, g=1051549, q=47592133)
  2695. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2696. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2697. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2698. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2699. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2700. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2701. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2702. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2703. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2704. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2705. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2706. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2707. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2708. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2709. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2710. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2711. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2712. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2713. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2714. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2715. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2716. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2717. Apr 22 06:02:38 hp-epyc kernel: (detected by 53, t=24180672 jiffies, g=1051549, q=47662342)
  2718. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2719. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2720. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2721. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2722. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2723. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2724. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2725. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2726. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2727. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2728. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2729. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2730. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2731. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2732. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2733. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2734. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2735. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2736. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2737. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2738. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2739. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2740. Apr 22 06:02:38 hp-epyc kernel: (detected by 53, t=24360677 jiffies, g=1051549, q=47733548)
  2741. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2742. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2743. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2744. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2745. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2746. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2747. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2748. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2749. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2750. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2751. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2752. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2753. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2754. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2755. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2756. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2757. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2758. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2759. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2760. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2761. Apr 22 06:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2762. Apr 22 06:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2763. Apr 22 06:02:38 hp-epyc kernel: (detected by 0, t=24540682 jiffies, g=1051549, q=47801588)
  2764. Apr 22 06:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2765. Apr 22 06:02:38 hp-epyc kernel: Call Trace:
  2766. Apr 22 06:02:38 hp-epyc kernel: <TASK>
  2767. Apr 22 06:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2768. Apr 22 06:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2769. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2770. Apr 22 06:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2771. Apr 22 06:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2772. Apr 22 06:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2773. Apr 22 06:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2774. Apr 22 06:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2775. Apr 22 06:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2776. Apr 22 06:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2777. Apr 22 06:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2778. Apr 22 06:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2779. Apr 22 06:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  2780. Apr 22 06:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2781. Apr 22 06:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2782. Apr 22 06:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2783. Apr 22 06:02:38 hp-epyc kernel: </TASK>
  2784. Apr 22 06:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2785. Apr 22 06:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2786. Apr 22 06:08:38 hp-epyc kernel: (detected by 53, t=24720687 jiffies, g=1051549, q=47873137)
  2787. Apr 22 06:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2788. Apr 22 06:08:38 hp-epyc kernel: Call Trace:
  2789. Apr 22 06:08:38 hp-epyc kernel: <TASK>
  2790. Apr 22 06:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2791. Apr 22 06:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2792. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2793. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2794. Apr 22 06:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2795. Apr 22 06:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2796. Apr 22 06:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2797. Apr 22 06:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2798. Apr 22 06:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2799. Apr 22 06:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2800. Apr 22 06:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2801. Apr 22 06:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2802. Apr 22 06:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  2803. Apr 22 06:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2804. Apr 22 06:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2805. Apr 22 06:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2806. Apr 22 06:08:38 hp-epyc kernel: </TASK>
  2807. Apr 22 06:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2808. Apr 22 06:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2809. Apr 22 06:08:38 hp-epyc kernel: (detected by 0, t=24900692 jiffies, g=1051549, q=47940961)
  2810. Apr 22 06:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2811. Apr 22 06:08:38 hp-epyc kernel: Call Trace:
  2812. Apr 22 06:08:38 hp-epyc kernel: <TASK>
  2813. Apr 22 06:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2814. Apr 22 06:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2815. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2816. Apr 22 06:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2817. Apr 22 06:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2818. Apr 22 06:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2819. Apr 22 06:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2820. Apr 22 06:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2821. Apr 22 06:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2822. Apr 22 06:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2823. Apr 22 06:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2824. Apr 22 06:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2825. Apr 22 06:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  2826. Apr 22 06:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2827. Apr 22 06:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2828. Apr 22 06:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2829. Apr 22 06:08:38 hp-epyc kernel: </TASK>
  2830. Apr 22 06:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2831. Apr 22 06:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2832. Apr 22 06:11:38 hp-epyc kernel: (detected by 0, t=25080697 jiffies, g=1051549, q=48013209)
  2833. Apr 22 06:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2834. Apr 22 06:11:38 hp-epyc kernel: Call Trace:
  2835. Apr 22 06:11:38 hp-epyc kernel: <TASK>
  2836. Apr 22 06:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2837. Apr 22 06:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2838. Apr 22 06:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2839. Apr 22 06:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2840. Apr 22 06:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2841. Apr 22 06:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2842. Apr 22 06:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2843. Apr 22 06:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2844. Apr 22 06:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2845. Apr 22 06:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2846. Apr 22 06:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2847. Apr 22 06:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2848. Apr 22 06:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  2849. Apr 22 06:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2850. Apr 22 06:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2851. Apr 22 06:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2852. Apr 22 06:11:38 hp-epyc kernel: </TASK>
  2853. Apr 22 06:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2854. Apr 22 06:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2855. Apr 22 06:14:38 hp-epyc kernel: (detected by 0, t=25260702 jiffies, g=1051549, q=48085937)
  2856. Apr 22 06:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2857. Apr 22 06:14:38 hp-epyc kernel: Call Trace:
  2858. Apr 22 06:14:38 hp-epyc kernel: <TASK>
  2859. Apr 22 06:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2860. Apr 22 06:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2861. Apr 22 06:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2862. Apr 22 06:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2863. Apr 22 06:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2864. Apr 22 06:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2865. Apr 22 06:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2866. Apr 22 06:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2867. Apr 22 06:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2868. Apr 22 06:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2869. Apr 22 06:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2870. Apr 22 06:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2871. Apr 22 06:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  2872. Apr 22 06:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2873. Apr 22 06:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2874. Apr 22 06:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2875. Apr 22 06:14:38 hp-epyc kernel: </TASK>
  2876. Apr 22 06:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2877. Apr 22 06:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2878. Apr 22 06:17:38 hp-epyc kernel: (detected by 0, t=25440707 jiffies, g=1051549, q=48155756)
  2879. Apr 22 06:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2880. Apr 22 06:17:38 hp-epyc kernel: Call Trace:
  2881. Apr 22 06:17:38 hp-epyc kernel: <TASK>
  2882. Apr 22 06:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2883. Apr 22 06:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2884. Apr 22 06:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2885. Apr 22 06:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2886. Apr 22 06:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2887. Apr 22 06:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2888. Apr 22 06:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2889. Apr 22 06:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2890. Apr 22 06:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2891. Apr 22 06:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2892. Apr 22 06:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2893. Apr 22 06:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2894. Apr 22 06:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  2895. Apr 22 06:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2896. Apr 22 06:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2897. Apr 22 06:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2898. Apr 22 06:17:38 hp-epyc kernel: </TASK>
  2899. Apr 22 06:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2900. Apr 22 06:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2901. Apr 22 06:20:38 hp-epyc kernel: (detected by 0, t=25620712 jiffies, g=1051549, q=48225117)
  2902. Apr 22 06:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2903. Apr 22 06:20:38 hp-epyc kernel: Call Trace:
  2904. Apr 22 06:20:38 hp-epyc kernel: <TASK>
  2905. Apr 22 06:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2906. Apr 22 06:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2907. Apr 22 06:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2908. Apr 22 06:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2909. Apr 22 06:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2910. Apr 22 06:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2911. Apr 22 06:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2912. Apr 22 06:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2913. Apr 22 06:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2914. Apr 22 06:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2915. Apr 22 06:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2916. Apr 22 06:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2917. Apr 22 06:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  2918. Apr 22 06:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2919. Apr 22 06:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2920. Apr 22 06:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2921. Apr 22 06:20:38 hp-epyc kernel: </TASK>
  2922. Apr 22 06:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2923. Apr 22 06:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2924. Apr 22 06:23:38 hp-epyc kernel: (detected by 0, t=25800717 jiffies, g=1051549, q=48295609)
  2925. Apr 22 06:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2926. Apr 22 06:23:38 hp-epyc kernel: Call Trace:
  2927. Apr 22 06:23:38 hp-epyc kernel: <TASK>
  2928. Apr 22 06:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2929. Apr 22 06:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2930. Apr 22 06:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2931. Apr 22 06:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2932. Apr 22 06:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2933. Apr 22 06:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2934. Apr 22 06:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2935. Apr 22 06:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2936. Apr 22 06:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2937. Apr 22 06:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2938. Apr 22 06:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2939. Apr 22 06:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2940. Apr 22 06:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  2941. Apr 22 06:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2942. Apr 22 06:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2943. Apr 22 06:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2944. Apr 22 06:23:38 hp-epyc kernel: </TASK>
  2945. Apr 22 06:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2946. Apr 22 06:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2947. Apr 22 06:32:38 hp-epyc kernel: (detected by 53, t=25980722 jiffies, g=1051549, q=48364564)
  2948. Apr 22 06:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2949. Apr 22 06:32:38 hp-epyc kernel: Call Trace:
  2950. Apr 22 06:32:38 hp-epyc kernel: <TASK>
  2951. Apr 22 06:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2952. Apr 22 06:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2953. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2954. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2955. Apr 22 06:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2956. Apr 22 06:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2957. Apr 22 06:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2958. Apr 22 06:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2959. Apr 22 06:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2960. Apr 22 06:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2961. Apr 22 06:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2962. Apr 22 06:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2963. Apr 22 06:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2964. Apr 22 06:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2965. Apr 22 06:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2966. Apr 22 06:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2967. Apr 22 06:32:38 hp-epyc kernel: </TASK>
  2968. Apr 22 06:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2969. Apr 22 06:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2970. Apr 22 06:32:38 hp-epyc kernel: (detected by 53, t=26160727 jiffies, g=1051549, q=48437261)
  2971. Apr 22 06:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2972. Apr 22 06:32:38 hp-epyc kernel: Call Trace:
  2973. Apr 22 06:32:38 hp-epyc kernel: <TASK>
  2974. Apr 22 06:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2975. Apr 22 06:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2976. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  2977. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  2978. Apr 22 06:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  2979. Apr 22 06:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  2980. Apr 22 06:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  2981. Apr 22 06:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  2982. Apr 22 06:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  2983. Apr 22 06:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  2984. Apr 22 06:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  2985. Apr 22 06:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  2986. Apr 22 06:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  2987. Apr 22 06:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  2988. Apr 22 06:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  2989. Apr 22 06:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  2990. Apr 22 06:32:38 hp-epyc kernel: </TASK>
  2991. Apr 22 06:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  2992. Apr 22 06:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  2993. Apr 22 06:32:38 hp-epyc kernel: (detected by 0, t=26340732 jiffies, g=1051549, q=48507658)
  2994. Apr 22 06:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  2995. Apr 22 06:32:38 hp-epyc kernel: Call Trace:
  2996. Apr 22 06:32:38 hp-epyc kernel: <TASK>
  2997. Apr 22 06:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  2998. Apr 22 06:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  2999. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3000. Apr 22 06:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3001. Apr 22 06:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3002. Apr 22 06:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3003. Apr 22 06:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3004. Apr 22 06:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3005. Apr 22 06:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3006. Apr 22 06:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3007. Apr 22 06:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3008. Apr 22 06:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3009. Apr 22 06:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  3010. Apr 22 06:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3011. Apr 22 06:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3012. Apr 22 06:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3013. Apr 22 06:32:38 hp-epyc kernel: </TASK>
  3014. Apr 22 06:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3015. Apr 22 06:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3016. Apr 22 06:35:38 hp-epyc kernel: (detected by 0, t=26520737 jiffies, g=1051549, q=48576084)
  3017. Apr 22 06:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3018. Apr 22 06:35:38 hp-epyc kernel: Call Trace:
  3019. Apr 22 06:35:38 hp-epyc kernel: <TASK>
  3020. Apr 22 06:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3021. Apr 22 06:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3022. Apr 22 06:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3023. Apr 22 06:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3024. Apr 22 06:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3025. Apr 22 06:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3026. Apr 22 06:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3027. Apr 22 06:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3028. Apr 22 06:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3029. Apr 22 06:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3030. Apr 22 06:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3031. Apr 22 06:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3032. Apr 22 06:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3033. Apr 22 06:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3034. Apr 22 06:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3035. Apr 22 06:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3036. Apr 22 06:35:38 hp-epyc kernel: </TASK>
  3037. Apr 22 06:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3038. Apr 22 06:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3039. Apr 22 06:38:38 hp-epyc kernel: (detected by 0, t=26700742 jiffies, g=1051549, q=48647327)
  3040. Apr 22 06:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3041. Apr 22 06:38:38 hp-epyc kernel: Call Trace:
  3042. Apr 22 06:38:38 hp-epyc kernel: <TASK>
  3043. Apr 22 06:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3044. Apr 22 06:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3045. Apr 22 06:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3046. Apr 22 06:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3047. Apr 22 06:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3048. Apr 22 06:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3049. Apr 22 06:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3050. Apr 22 06:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3051. Apr 22 06:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3052. Apr 22 06:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3053. Apr 22 06:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3054. Apr 22 06:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3055. Apr 22 06:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  3056. Apr 22 06:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3057. Apr 22 06:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3058. Apr 22 06:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3059. Apr 22 06:38:38 hp-epyc kernel: </TASK>
  3060. Apr 22 06:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3061. Apr 22 06:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3062. Apr 22 06:41:38 hp-epyc kernel: (detected by 0, t=26880747 jiffies, g=1051549, q=48719245)
  3063. Apr 22 06:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3064. Apr 22 06:41:38 hp-epyc kernel: Call Trace:
  3065. Apr 22 06:41:38 hp-epyc kernel: <TASK>
  3066. Apr 22 06:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3067. Apr 22 06:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3068. Apr 22 06:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3069. Apr 22 06:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3070. Apr 22 06:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3071. Apr 22 06:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3072. Apr 22 06:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3073. Apr 22 06:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3074. Apr 22 06:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3075. Apr 22 06:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3076. Apr 22 06:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3077. Apr 22 06:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3078. Apr 22 06:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  3079. Apr 22 06:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3080. Apr 22 06:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3081. Apr 22 06:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3082. Apr 22 06:41:38 hp-epyc kernel: </TASK>
  3083. Apr 22 06:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3084. Apr 22 06:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3085. Apr 22 06:44:38 hp-epyc kernel: (detected by 0, t=27060752 jiffies, g=1051549, q=48792412)
  3086. Apr 22 06:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3087. Apr 22 06:44:38 hp-epyc kernel: Call Trace:
  3088. Apr 22 06:44:38 hp-epyc kernel: <TASK>
  3089. Apr 22 06:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3090. Apr 22 06:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3091. Apr 22 06:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3092. Apr 22 06:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3093. Apr 22 06:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3094. Apr 22 06:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3095. Apr 22 06:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3096. Apr 22 06:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3097. Apr 22 06:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3098. Apr 22 06:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3099. Apr 22 06:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3100. Apr 22 06:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3101. Apr 22 06:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  3102. Apr 22 06:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3103. Apr 22 06:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3104. Apr 22 06:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3105. Apr 22 06:44:38 hp-epyc kernel: </TASK>
  3106. Apr 22 06:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3107. Apr 22 06:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3108. Apr 22 06:47:38 hp-epyc kernel: (detected by 0, t=27240757 jiffies, g=1051549, q=48864650)
  3109. Apr 22 06:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3110. Apr 22 06:47:38 hp-epyc kernel: Call Trace:
  3111. Apr 22 06:47:38 hp-epyc kernel: <TASK>
  3112. Apr 22 06:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3113. Apr 22 06:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3114. Apr 22 06:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3115. Apr 22 06:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3116. Apr 22 06:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3117. Apr 22 06:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3118. Apr 22 06:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3119. Apr 22 06:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3120. Apr 22 06:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3121. Apr 22 06:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3122. Apr 22 06:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3123. Apr 22 06:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3124. Apr 22 06:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  3125. Apr 22 06:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3126. Apr 22 06:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3127. Apr 22 06:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3128. Apr 22 06:47:38 hp-epyc kernel: </TASK>
  3129. Apr 22 06:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3130. Apr 22 06:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3131. Apr 22 06:56:38 hp-epyc kernel: (detected by 53, t=27420762 jiffies, g=1051549, q=48933422)
  3132. Apr 22 06:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3133. Apr 22 06:56:38 hp-epyc kernel: Call Trace:
  3134. Apr 22 06:56:38 hp-epyc kernel: <TASK>
  3135. Apr 22 06:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3136. Apr 22 06:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3137. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3138. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3139. Apr 22 06:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3140. Apr 22 06:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3141. Apr 22 06:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3142. Apr 22 06:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3143. Apr 22 06:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3144. Apr 22 06:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3145. Apr 22 06:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3146. Apr 22 06:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3147. Apr 22 06:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3148. Apr 22 06:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3149. Apr 22 06:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3150. Apr 22 06:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3151. Apr 22 06:56:38 hp-epyc kernel: </TASK>
  3152. Apr 22 06:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3153. Apr 22 06:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3154. Apr 22 06:56:38 hp-epyc kernel: (detected by 53, t=27600767 jiffies, g=1051549, q=49003985)
  3155. Apr 22 06:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3156. Apr 22 06:56:38 hp-epyc kernel: Call Trace:
  3157. Apr 22 06:56:38 hp-epyc kernel: <TASK>
  3158. Apr 22 06:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3159. Apr 22 06:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3160. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3161. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3162. Apr 22 06:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3163. Apr 22 06:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3164. Apr 22 06:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3165. Apr 22 06:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3166. Apr 22 06:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3167. Apr 22 06:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3168. Apr 22 06:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3169. Apr 22 06:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3170. Apr 22 06:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3171. Apr 22 06:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3172. Apr 22 06:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3173. Apr 22 06:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3174. Apr 22 06:56:38 hp-epyc kernel: </TASK>
  3175. Apr 22 06:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3176. Apr 22 06:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3177. Apr 22 06:56:38 hp-epyc kernel: (detected by 0, t=27780772 jiffies, g=1051549, q=49073222)
  3178. Apr 22 06:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3179. Apr 22 06:56:38 hp-epyc kernel: Call Trace:
  3180. Apr 22 06:56:38 hp-epyc kernel: <TASK>
  3181. Apr 22 06:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3182. Apr 22 06:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3183. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3184. Apr 22 06:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3185. Apr 22 06:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3186. Apr 22 06:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3187. Apr 22 06:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3188. Apr 22 06:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3189. Apr 22 06:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3190. Apr 22 06:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3191. Apr 22 06:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3192. Apr 22 06:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3193. Apr 22 06:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3194. Apr 22 06:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3195. Apr 22 06:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3196. Apr 22 06:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3197. Apr 22 06:56:38 hp-epyc kernel: </TASK>
  3198. Apr 22 06:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3199. Apr 22 06:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3200. Apr 22 06:59:38 hp-epyc kernel: (detected by 0, t=27960777 jiffies, g=1051549, q=49145625)
  3201. Apr 22 06:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3202. Apr 22 06:59:38 hp-epyc kernel: Call Trace:
  3203. Apr 22 06:59:38 hp-epyc kernel: <TASK>
  3204. Apr 22 06:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3205. Apr 22 06:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3206. Apr 22 06:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3207. Apr 22 06:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3208. Apr 22 06:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3209. Apr 22 06:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3210. Apr 22 06:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3211. Apr 22 06:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3212. Apr 22 06:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3213. Apr 22 06:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3214. Apr 22 06:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3215. Apr 22 06:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3216. Apr 22 06:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  3217. Apr 22 06:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3218. Apr 22 06:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3219. Apr 22 06:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3220. Apr 22 06:59:38 hp-epyc kernel: </TASK>
  3221. Apr 22 07:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3222. Apr 22 07:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3223. Apr 22 07:05:38 hp-epyc kernel: (detected by 53, t=28140782 jiffies, g=1051549, q=49218746)
  3224. Apr 22 07:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3225. Apr 22 07:05:38 hp-epyc kernel: Call Trace:
  3226. Apr 22 07:05:38 hp-epyc kernel: <TASK>
  3227. Apr 22 07:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3228. Apr 22 07:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3229. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3230. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3231. Apr 22 07:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3232. Apr 22 07:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3233. Apr 22 07:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3234. Apr 22 07:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3235. Apr 22 07:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3236. Apr 22 07:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3237. Apr 22 07:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3238. Apr 22 07:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3239. Apr 22 07:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  3240. Apr 22 07:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3241. Apr 22 07:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3242. Apr 22 07:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3243. Apr 22 07:05:38 hp-epyc kernel: </TASK>
  3244. Apr 22 07:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3245. Apr 22 07:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3246. Apr 22 07:05:38 hp-epyc kernel: (detected by 0, t=28320787 jiffies, g=1051549, q=49289236)
  3247. Apr 22 07:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3248. Apr 22 07:05:38 hp-epyc kernel: Call Trace:
  3249. Apr 22 07:05:38 hp-epyc kernel: <TASK>
  3250. Apr 22 07:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3251. Apr 22 07:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3252. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3253. Apr 22 07:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3254. Apr 22 07:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3255. Apr 22 07:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3256. Apr 22 07:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3257. Apr 22 07:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3258. Apr 22 07:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3259. Apr 22 07:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3260. Apr 22 07:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3261. Apr 22 07:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3262. Apr 22 07:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  3263. Apr 22 07:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3264. Apr 22 07:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3265. Apr 22 07:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3266. Apr 22 07:05:38 hp-epyc kernel: </TASK>
  3267. Apr 22 07:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3268. Apr 22 07:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3269. Apr 22 07:11:38 hp-epyc kernel: (detected by 53, t=28500792 jiffies, g=1051549, q=49362055)
  3270. Apr 22 07:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3271. Apr 22 07:11:38 hp-epyc kernel: Call Trace:
  3272. Apr 22 07:11:38 hp-epyc kernel: <TASK>
  3273. Apr 22 07:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3274. Apr 22 07:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3275. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3276. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3277. Apr 22 07:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3278. Apr 22 07:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3279. Apr 22 07:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3280. Apr 22 07:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3281. Apr 22 07:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3282. Apr 22 07:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3283. Apr 22 07:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3284. Apr 22 07:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3285. Apr 22 07:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3286. Apr 22 07:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3287. Apr 22 07:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3288. Apr 22 07:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3289. Apr 22 07:11:38 hp-epyc kernel: </TASK>
  3290. Apr 22 07:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3291. Apr 22 07:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3292. Apr 22 07:11:38 hp-epyc kernel: (detected by 0, t=28680797 jiffies, g=1051549, q=49433277)
  3293. Apr 22 07:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3294. Apr 22 07:11:38 hp-epyc kernel: Call Trace:
  3295. Apr 22 07:11:38 hp-epyc kernel: <TASK>
  3296. Apr 22 07:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3297. Apr 22 07:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3298. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3299. Apr 22 07:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3300. Apr 22 07:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3301. Apr 22 07:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3302. Apr 22 07:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3303. Apr 22 07:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3304. Apr 22 07:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3305. Apr 22 07:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3306. Apr 22 07:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3307. Apr 22 07:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3308. Apr 22 07:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3309. Apr 22 07:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3310. Apr 22 07:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3311. Apr 22 07:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3312. Apr 22 07:11:38 hp-epyc kernel: </TASK>
  3313. Apr 22 07:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3314. Apr 22 07:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3315. Apr 22 07:14:38 hp-epyc kernel: (detected by 0, t=28860802 jiffies, g=1051549, q=49502128)
  3316. Apr 22 07:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3317. Apr 22 07:14:38 hp-epyc kernel: Call Trace:
  3318. Apr 22 07:14:38 hp-epyc kernel: <TASK>
  3319. Apr 22 07:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3320. Apr 22 07:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3321. Apr 22 07:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3322. Apr 22 07:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3323. Apr 22 07:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3324. Apr 22 07:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3325. Apr 22 07:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3326. Apr 22 07:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3327. Apr 22 07:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3328. Apr 22 07:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3329. Apr 22 07:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3330. Apr 22 07:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3331. Apr 22 07:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  3332. Apr 22 07:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3333. Apr 22 07:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3334. Apr 22 07:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3335. Apr 22 07:14:38 hp-epyc kernel: </TASK>
  3336. Apr 22 07:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3337. Apr 22 07:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3338. Apr 22 07:17:38 hp-epyc kernel: (detected by 0, t=29040807 jiffies, g=1051549, q=49573403)
  3339. Apr 22 07:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3340. Apr 22 07:17:38 hp-epyc kernel: Call Trace:
  3341. Apr 22 07:17:38 hp-epyc kernel: <TASK>
  3342. Apr 22 07:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3343. Apr 22 07:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3344. Apr 22 07:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3345. Apr 22 07:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3346. Apr 22 07:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3347. Apr 22 07:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3348. Apr 22 07:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3349. Apr 22 07:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3350. Apr 22 07:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3351. Apr 22 07:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3352. Apr 22 07:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3353. Apr 22 07:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3354. Apr 22 07:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  3355. Apr 22 07:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3356. Apr 22 07:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3357. Apr 22 07:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3358. Apr 22 07:17:38 hp-epyc kernel: </TASK>
  3359. Apr 22 07:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3360. Apr 22 07:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3361. Apr 22 07:23:38 hp-epyc kernel: (detected by 53, t=29220812 jiffies, g=1051549, q=49644760)
  3362. Apr 22 07:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3363. Apr 22 07:23:38 hp-epyc kernel: Call Trace:
  3364. Apr 22 07:23:38 hp-epyc kernel: <TASK>
  3365. Apr 22 07:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3366. Apr 22 07:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3367. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3368. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3369. Apr 22 07:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3370. Apr 22 07:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3371. Apr 22 07:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3372. Apr 22 07:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3373. Apr 22 07:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3374. Apr 22 07:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3375. Apr 22 07:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3376. Apr 22 07:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3377. Apr 22 07:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3378. Apr 22 07:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3379. Apr 22 07:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3380. Apr 22 07:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3381. Apr 22 07:23:38 hp-epyc kernel: </TASK>
  3382. Apr 22 07:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3383. Apr 22 07:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3384. Apr 22 07:23:38 hp-epyc kernel: (detected by 0, t=29400817 jiffies, g=1051549, q=49715433)
  3385. Apr 22 07:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3386. Apr 22 07:23:38 hp-epyc kernel: Call Trace:
  3387. Apr 22 07:23:38 hp-epyc kernel: <TASK>
  3388. Apr 22 07:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3389. Apr 22 07:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3390. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3391. Apr 22 07:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3392. Apr 22 07:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3393. Apr 22 07:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3394. Apr 22 07:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3395. Apr 22 07:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3396. Apr 22 07:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3397. Apr 22 07:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3398. Apr 22 07:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3399. Apr 22 07:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3400. Apr 22 07:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3401. Apr 22 07:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3402. Apr 22 07:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3403. Apr 22 07:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3404. Apr 22 07:23:38 hp-epyc kernel: </TASK>
  3405. Apr 22 07:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3406. Apr 22 07:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3407. Apr 22 07:26:38 hp-epyc kernel: (detected by 0, t=29580822 jiffies, g=1051549, q=49786826)
  3408. Apr 22 07:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3409. Apr 22 07:26:38 hp-epyc kernel: Call Trace:
  3410. Apr 22 07:26:38 hp-epyc kernel: <TASK>
  3411. Apr 22 07:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3412. Apr 22 07:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3413. Apr 22 07:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3414. Apr 22 07:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3415. Apr 22 07:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3416. Apr 22 07:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3417. Apr 22 07:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3418. Apr 22 07:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3419. Apr 22 07:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3420. Apr 22 07:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3421. Apr 22 07:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3422. Apr 22 07:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3423. Apr 22 07:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  3424. Apr 22 07:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3425. Apr 22 07:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3426. Apr 22 07:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3427. Apr 22 07:26:38 hp-epyc kernel: </TASK>
  3428. Apr 22 07:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3429. Apr 22 07:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3430. Apr 22 07:29:38 hp-epyc kernel: (detected by 0, t=29760827 jiffies, g=1051549, q=49855820)
  3431. Apr 22 07:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3432. Apr 22 07:29:38 hp-epyc kernel: Call Trace:
  3433. Apr 22 07:29:38 hp-epyc kernel: <TASK>
  3434. Apr 22 07:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3435. Apr 22 07:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3436. Apr 22 07:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3437. Apr 22 07:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3438. Apr 22 07:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3439. Apr 22 07:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3440. Apr 22 07:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3441. Apr 22 07:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3442. Apr 22 07:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3443. Apr 22 07:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3444. Apr 22 07:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3445. Apr 22 07:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3446. Apr 22 07:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  3447. Apr 22 07:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3448. Apr 22 07:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3449. Apr 22 07:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3450. Apr 22 07:29:38 hp-epyc kernel: </TASK>
  3451. Apr 22 07:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3452. Apr 22 07:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3453. Apr 22 07:32:38 hp-epyc kernel: (detected by 0, t=29940832 jiffies, g=1051549, q=49926228)
  3454. Apr 22 07:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3455. Apr 22 07:32:38 hp-epyc kernel: Call Trace:
  3456. Apr 22 07:32:38 hp-epyc kernel: <TASK>
  3457. Apr 22 07:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3458. Apr 22 07:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3459. Apr 22 07:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3460. Apr 22 07:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3461. Apr 22 07:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3462. Apr 22 07:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3463. Apr 22 07:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3464. Apr 22 07:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3465. Apr 22 07:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3466. Apr 22 07:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3467. Apr 22 07:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3468. Apr 22 07:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3469. Apr 22 07:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  3470. Apr 22 07:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3471. Apr 22 07:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3472. Apr 22 07:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3473. Apr 22 07:32:38 hp-epyc kernel: </TASK>
  3474. Apr 22 07:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3475. Apr 22 07:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3476. Apr 22 07:35:38 hp-epyc kernel: (detected by 0, t=30120837 jiffies, g=1051549, q=49998070)
  3477. Apr 22 07:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3478. Apr 22 07:35:38 hp-epyc kernel: Call Trace:
  3479. Apr 22 07:35:38 hp-epyc kernel: <TASK>
  3480. Apr 22 07:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3481. Apr 22 07:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3482. Apr 22 07:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3483. Apr 22 07:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3484. Apr 22 07:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3485. Apr 22 07:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3486. Apr 22 07:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3487. Apr 22 07:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3488. Apr 22 07:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3489. Apr 22 07:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3490. Apr 22 07:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3491. Apr 22 07:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3492. Apr 22 07:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3493. Apr 22 07:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3494. Apr 22 07:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3495. Apr 22 07:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3496. Apr 22 07:35:38 hp-epyc kernel: </TASK>
  3497. Apr 22 07:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3498. Apr 22 07:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3499. Apr 22 07:38:38 hp-epyc kernel: (detected by 0, t=30300842 jiffies, g=1051549, q=50066661)
  3500. Apr 22 07:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3501. Apr 22 07:38:38 hp-epyc kernel: Call Trace:
  3502. Apr 22 07:38:38 hp-epyc kernel: <TASK>
  3503. Apr 22 07:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3504. Apr 22 07:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3505. Apr 22 07:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3506. Apr 22 07:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3507. Apr 22 07:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3508. Apr 22 07:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3509. Apr 22 07:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3510. Apr 22 07:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3511. Apr 22 07:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3512. Apr 22 07:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3513. Apr 22 07:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3514. Apr 22 07:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3515. Apr 22 07:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  3516. Apr 22 07:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3517. Apr 22 07:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3518. Apr 22 07:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3519. Apr 22 07:38:38 hp-epyc kernel: </TASK>
  3520. Apr 22 07:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3521. Apr 22 07:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3522. Apr 22 07:44:38 hp-epyc kernel: (detected by 53, t=30480847 jiffies, g=1051549, q=50137831)
  3523. Apr 22 07:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3524. Apr 22 07:44:38 hp-epyc kernel: Call Trace:
  3525. Apr 22 07:44:38 hp-epyc kernel: <TASK>
  3526. Apr 22 07:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3527. Apr 22 07:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3528. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3529. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3530. Apr 22 07:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3531. Apr 22 07:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3532. Apr 22 07:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3533. Apr 22 07:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3534. Apr 22 07:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3535. Apr 22 07:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3536. Apr 22 07:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3537. Apr 22 07:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3538. Apr 22 07:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  3539. Apr 22 07:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3540. Apr 22 07:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3541. Apr 22 07:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3542. Apr 22 07:44:38 hp-epyc kernel: </TASK>
  3543. Apr 22 07:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3544. Apr 22 07:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3545. Apr 22 07:44:38 hp-epyc kernel: (detected by 0, t=30660852 jiffies, g=1051549, q=50208287)
  3546. Apr 22 07:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3547. Apr 22 07:44:38 hp-epyc kernel: Call Trace:
  3548. Apr 22 07:44:38 hp-epyc kernel: <TASK>
  3549. Apr 22 07:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3550. Apr 22 07:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3551. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3552. Apr 22 07:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3553. Apr 22 07:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3554. Apr 22 07:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3555. Apr 22 07:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3556. Apr 22 07:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3557. Apr 22 07:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3558. Apr 22 07:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3559. Apr 22 07:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3560. Apr 22 07:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3561. Apr 22 07:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  3562. Apr 22 07:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3563. Apr 22 07:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3564. Apr 22 07:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3565. Apr 22 07:44:38 hp-epyc kernel: </TASK>
  3566. Apr 22 07:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3567. Apr 22 07:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3568. Apr 22 07:47:38 hp-epyc kernel: (detected by 0, t=30840857 jiffies, g=1051549, q=50281342)
  3569. Apr 22 07:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3570. Apr 22 07:47:38 hp-epyc kernel: Call Trace:
  3571. Apr 22 07:47:38 hp-epyc kernel: <TASK>
  3572. Apr 22 07:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3573. Apr 22 07:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3574. Apr 22 07:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3575. Apr 22 07:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3576. Apr 22 07:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3577. Apr 22 07:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3578. Apr 22 07:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3579. Apr 22 07:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3580. Apr 22 07:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3581. Apr 22 07:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3582. Apr 22 07:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3583. Apr 22 07:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3584. Apr 22 07:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  3585. Apr 22 07:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3586. Apr 22 07:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3587. Apr 22 07:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3588. Apr 22 07:47:38 hp-epyc kernel: </TASK>
  3589. Apr 22 07:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3590. Apr 22 07:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3591. Apr 22 07:53:38 hp-epyc kernel: (detected by 53, t=31020862 jiffies, g=1051549, q=50351981)
  3592. Apr 22 07:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3593. Apr 22 07:53:38 hp-epyc kernel: Call Trace:
  3594. Apr 22 07:53:38 hp-epyc kernel: <TASK>
  3595. Apr 22 07:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3596. Apr 22 07:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3597. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3598. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3599. Apr 22 07:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3600. Apr 22 07:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3601. Apr 22 07:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3602. Apr 22 07:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3603. Apr 22 07:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3604. Apr 22 07:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3605. Apr 22 07:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3606. Apr 22 07:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3607. Apr 22 07:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  3608. Apr 22 07:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3609. Apr 22 07:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3610. Apr 22 07:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3611. Apr 22 07:53:38 hp-epyc kernel: </TASK>
  3612. Apr 22 07:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3613. Apr 22 07:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3614. Apr 22 07:53:38 hp-epyc kernel: (detected by 0, t=31200867 jiffies, g=1051549, q=50424813)
  3615. Apr 22 07:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3616. Apr 22 07:53:38 hp-epyc kernel: Call Trace:
  3617. Apr 22 07:53:38 hp-epyc kernel: <TASK>
  3618. Apr 22 07:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3619. Apr 22 07:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3620. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3621. Apr 22 07:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3622. Apr 22 07:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3623. Apr 22 07:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3624. Apr 22 07:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3625. Apr 22 07:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3626. Apr 22 07:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3627. Apr 22 07:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3628. Apr 22 07:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3629. Apr 22 07:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3630. Apr 22 07:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  3631. Apr 22 07:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3632. Apr 22 07:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3633. Apr 22 07:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3634. Apr 22 07:53:38 hp-epyc kernel: </TASK>
  3635. Apr 22 07:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3636. Apr 22 07:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3637. Apr 22 07:56:38 hp-epyc kernel: (detected by 0, t=31380872 jiffies, g=1051549, q=50496095)
  3638. Apr 22 07:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3639. Apr 22 07:56:38 hp-epyc kernel: Call Trace:
  3640. Apr 22 07:56:38 hp-epyc kernel: <TASK>
  3641. Apr 22 07:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3642. Apr 22 07:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3643. Apr 22 07:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3644. Apr 22 07:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3645. Apr 22 07:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3646. Apr 22 07:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3647. Apr 22 07:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3648. Apr 22 07:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3649. Apr 22 07:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3650. Apr 22 07:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3651. Apr 22 07:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3652. Apr 22 07:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3653. Apr 22 07:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  3654. Apr 22 07:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3655. Apr 22 07:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3656. Apr 22 07:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3657. Apr 22 07:56:38 hp-epyc kernel: </TASK>
  3658. Apr 22 07:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3659. Apr 22 07:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3660. Apr 22 07:59:38 hp-epyc kernel: (detected by 0, t=31560877 jiffies, g=1051549, q=50568146)
  3661. Apr 22 07:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3662. Apr 22 07:59:38 hp-epyc kernel: Call Trace:
  3663. Apr 22 07:59:38 hp-epyc kernel: <TASK>
  3664. Apr 22 07:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3665. Apr 22 07:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3666. Apr 22 07:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3667. Apr 22 07:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3668. Apr 22 07:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3669. Apr 22 07:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3670. Apr 22 07:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3671. Apr 22 07:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3672. Apr 22 07:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3673. Apr 22 07:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3674. Apr 22 07:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3675. Apr 22 07:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3676. Apr 22 07:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  3677. Apr 22 07:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3678. Apr 22 07:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3679. Apr 22 07:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3680. Apr 22 07:59:38 hp-epyc kernel: </TASK>
  3681. Apr 22 08:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3682. Apr 22 08:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3683. Apr 22 08:02:38 hp-epyc kernel: (detected by 0, t=31740882 jiffies, g=1051549, q=50639150)
  3684. Apr 22 08:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3685. Apr 22 08:02:38 hp-epyc kernel: Call Trace:
  3686. Apr 22 08:02:38 hp-epyc kernel: <TASK>
  3687. Apr 22 08:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3688. Apr 22 08:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3689. Apr 22 08:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3690. Apr 22 08:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3691. Apr 22 08:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3692. Apr 22 08:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3693. Apr 22 08:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3694. Apr 22 08:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3695. Apr 22 08:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3696. Apr 22 08:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3697. Apr 22 08:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3698. Apr 22 08:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3699. Apr 22 08:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  3700. Apr 22 08:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3701. Apr 22 08:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3702. Apr 22 08:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3703. Apr 22 08:02:38 hp-epyc kernel: </TASK>
  3704. Apr 22 08:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3705. Apr 22 08:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3706. Apr 22 08:05:38 hp-epyc kernel: (detected by 0, t=31920887 jiffies, g=1051549, q=50709619)
  3707. Apr 22 08:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3708. Apr 22 08:05:38 hp-epyc kernel: Call Trace:
  3709. Apr 22 08:05:38 hp-epyc kernel: <TASK>
  3710. Apr 22 08:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3711. Apr 22 08:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3712. Apr 22 08:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3713. Apr 22 08:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3714. Apr 22 08:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3715. Apr 22 08:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3716. Apr 22 08:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3717. Apr 22 08:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3718. Apr 22 08:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3719. Apr 22 08:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3720. Apr 22 08:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3721. Apr 22 08:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3722. Apr 22 08:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  3723. Apr 22 08:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3724. Apr 22 08:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3725. Apr 22 08:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3726. Apr 22 08:05:38 hp-epyc kernel: </TASK>
  3727. Apr 22 08:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3728. Apr 22 08:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3729. Apr 22 08:11:38 hp-epyc kernel: (detected by 53, t=32100892 jiffies, g=1051549, q=50778446)
  3730. Apr 22 08:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3731. Apr 22 08:11:38 hp-epyc kernel: Call Trace:
  3732. Apr 22 08:11:38 hp-epyc kernel: <TASK>
  3733. Apr 22 08:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3734. Apr 22 08:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3735. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3736. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3737. Apr 22 08:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3738. Apr 22 08:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3739. Apr 22 08:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3740. Apr 22 08:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3741. Apr 22 08:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3742. Apr 22 08:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3743. Apr 22 08:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3744. Apr 22 08:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3745. Apr 22 08:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3746. Apr 22 08:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3747. Apr 22 08:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3748. Apr 22 08:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3749. Apr 22 08:11:38 hp-epyc kernel: </TASK>
  3750. Apr 22 08:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3751. Apr 22 08:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3752. Apr 22 08:11:38 hp-epyc kernel: (detected by 0, t=32280897 jiffies, g=1051549, q=50848666)
  3753. Apr 22 08:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3754. Apr 22 08:11:38 hp-epyc kernel: Call Trace:
  3755. Apr 22 08:11:38 hp-epyc kernel: <TASK>
  3756. Apr 22 08:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3757. Apr 22 08:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3758. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3759. Apr 22 08:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3760. Apr 22 08:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3761. Apr 22 08:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3762. Apr 22 08:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3763. Apr 22 08:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3764. Apr 22 08:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3765. Apr 22 08:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3766. Apr 22 08:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3767. Apr 22 08:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3768. Apr 22 08:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  3769. Apr 22 08:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3770. Apr 22 08:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3771. Apr 22 08:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3772. Apr 22 08:11:38 hp-epyc kernel: </TASK>
  3773. Apr 22 08:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3774. Apr 22 08:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3775. Apr 22 08:14:38 hp-epyc kernel: (detected by 0, t=32460902 jiffies, g=1051549, q=50919769)
  3776. Apr 22 08:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3777. Apr 22 08:14:38 hp-epyc kernel: Call Trace:
  3778. Apr 22 08:14:38 hp-epyc kernel: <TASK>
  3779. Apr 22 08:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3780. Apr 22 08:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3781. Apr 22 08:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3782. Apr 22 08:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3783. Apr 22 08:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3784. Apr 22 08:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3785. Apr 22 08:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3786. Apr 22 08:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3787. Apr 22 08:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3788. Apr 22 08:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3789. Apr 22 08:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3790. Apr 22 08:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3791. Apr 22 08:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  3792. Apr 22 08:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3793. Apr 22 08:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3794. Apr 22 08:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3795. Apr 22 08:14:38 hp-epyc kernel: </TASK>
  3796. Apr 22 08:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3797. Apr 22 08:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3798. Apr 22 08:17:38 hp-epyc kernel: (detected by 0, t=32640907 jiffies, g=1051549, q=50991759)
  3799. Apr 22 08:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3800. Apr 22 08:17:38 hp-epyc kernel: Call Trace:
  3801. Apr 22 08:17:38 hp-epyc kernel: <TASK>
  3802. Apr 22 08:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3803. Apr 22 08:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3804. Apr 22 08:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3805. Apr 22 08:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3806. Apr 22 08:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3807. Apr 22 08:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3808. Apr 22 08:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3809. Apr 22 08:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3810. Apr 22 08:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3811. Apr 22 08:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3812. Apr 22 08:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3813. Apr 22 08:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3814. Apr 22 08:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  3815. Apr 22 08:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3816. Apr 22 08:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3817. Apr 22 08:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3818. Apr 22 08:17:38 hp-epyc kernel: </TASK>
  3819. Apr 22 08:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3820. Apr 22 08:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3821. Apr 22 08:23:38 hp-epyc kernel: (detected by 53, t=32820912 jiffies, g=1051549, q=51060457)
  3822. Apr 22 08:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3823. Apr 22 08:23:38 hp-epyc kernel: Call Trace:
  3824. Apr 22 08:23:38 hp-epyc kernel: <TASK>
  3825. Apr 22 08:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3826. Apr 22 08:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3827. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3828. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3829. Apr 22 08:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3830. Apr 22 08:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3831. Apr 22 08:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3832. Apr 22 08:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3833. Apr 22 08:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3834. Apr 22 08:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3835. Apr 22 08:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3836. Apr 22 08:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3837. Apr 22 08:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3838. Apr 22 08:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3839. Apr 22 08:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3840. Apr 22 08:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3841. Apr 22 08:23:38 hp-epyc kernel: </TASK>
  3842. Apr 22 08:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3843. Apr 22 08:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3844. Apr 22 08:23:38 hp-epyc kernel: (detected by 0, t=33000917 jiffies, g=1051549, q=51131066)
  3845. Apr 22 08:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3846. Apr 22 08:23:38 hp-epyc kernel: Call Trace:
  3847. Apr 22 08:23:38 hp-epyc kernel: <TASK>
  3848. Apr 22 08:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3849. Apr 22 08:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3850. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3851. Apr 22 08:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3852. Apr 22 08:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3853. Apr 22 08:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3854. Apr 22 08:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3855. Apr 22 08:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3856. Apr 22 08:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3857. Apr 22 08:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3858. Apr 22 08:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3859. Apr 22 08:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3860. Apr 22 08:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  3861. Apr 22 08:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3862. Apr 22 08:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3863. Apr 22 08:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3864. Apr 22 08:23:38 hp-epyc kernel: </TASK>
  3865. Apr 22 08:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3866. Apr 22 08:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3867. Apr 22 08:26:38 hp-epyc kernel: (detected by 0, t=33180922 jiffies, g=1051549, q=51199838)
  3868. Apr 22 08:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3869. Apr 22 08:26:38 hp-epyc kernel: Call Trace:
  3870. Apr 22 08:26:38 hp-epyc kernel: <TASK>
  3871. Apr 22 08:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3872. Apr 22 08:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3873. Apr 22 08:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3874. Apr 22 08:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3875. Apr 22 08:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3876. Apr 22 08:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3877. Apr 22 08:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3878. Apr 22 08:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3879. Apr 22 08:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3880. Apr 22 08:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3881. Apr 22 08:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3882. Apr 22 08:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3883. Apr 22 08:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  3884. Apr 22 08:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3885. Apr 22 08:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3886. Apr 22 08:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3887. Apr 22 08:26:38 hp-epyc kernel: </TASK>
  3888. Apr 22 08:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3889. Apr 22 08:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3890. Apr 22 08:35:38 hp-epyc kernel: (detected by 53, t=33360927 jiffies, g=1051549, q=51267890)
  3891. Apr 22 08:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3892. Apr 22 08:35:38 hp-epyc kernel: Call Trace:
  3893. Apr 22 08:35:38 hp-epyc kernel: <TASK>
  3894. Apr 22 08:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3895. Apr 22 08:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3896. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3897. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3898. Apr 22 08:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3899. Apr 22 08:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3900. Apr 22 08:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3901. Apr 22 08:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3902. Apr 22 08:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3903. Apr 22 08:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3904. Apr 22 08:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3905. Apr 22 08:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3906. Apr 22 08:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3907. Apr 22 08:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3908. Apr 22 08:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3909. Apr 22 08:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3910. Apr 22 08:35:38 hp-epyc kernel: </TASK>
  3911. Apr 22 08:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3912. Apr 22 08:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3913. Apr 22 08:35:38 hp-epyc kernel: (detected by 53, t=33540932 jiffies, g=1051549, q=51339220)
  3914. Apr 22 08:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3915. Apr 22 08:35:38 hp-epyc kernel: Call Trace:
  3916. Apr 22 08:35:38 hp-epyc kernel: <TASK>
  3917. Apr 22 08:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3918. Apr 22 08:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3919. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3920. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3921. Apr 22 08:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3922. Apr 22 08:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3923. Apr 22 08:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3924. Apr 22 08:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3925. Apr 22 08:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3926. Apr 22 08:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3927. Apr 22 08:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3928. Apr 22 08:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3929. Apr 22 08:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3930. Apr 22 08:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3931. Apr 22 08:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3932. Apr 22 08:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3933. Apr 22 08:35:38 hp-epyc kernel: </TASK>
  3934. Apr 22 08:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3935. Apr 22 08:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3936. Apr 22 08:35:38 hp-epyc kernel: (detected by 0, t=33720937 jiffies, g=1051549, q=51409663)
  3937. Apr 22 08:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3938. Apr 22 08:35:38 hp-epyc kernel: Call Trace:
  3939. Apr 22 08:35:38 hp-epyc kernel: <TASK>
  3940. Apr 22 08:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3941. Apr 22 08:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3942. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3943. Apr 22 08:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3944. Apr 22 08:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3945. Apr 22 08:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3946. Apr 22 08:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3947. Apr 22 08:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3948. Apr 22 08:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3949. Apr 22 08:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3950. Apr 22 08:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3951. Apr 22 08:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3952. Apr 22 08:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  3953. Apr 22 08:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3954. Apr 22 08:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3955. Apr 22 08:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3956. Apr 22 08:35:38 hp-epyc kernel: </TASK>
  3957. Apr 22 08:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3958. Apr 22 08:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3959. Apr 22 08:41:38 hp-epyc kernel: (detected by 53, t=33900942 jiffies, g=1051549, q=51480169)
  3960. Apr 22 08:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3961. Apr 22 08:41:38 hp-epyc kernel: Call Trace:
  3962. Apr 22 08:41:38 hp-epyc kernel: <TASK>
  3963. Apr 22 08:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3964. Apr 22 08:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3965. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3966. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3967. Apr 22 08:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3968. Apr 22 08:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3969. Apr 22 08:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3970. Apr 22 08:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3971. Apr 22 08:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3972. Apr 22 08:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3973. Apr 22 08:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3974. Apr 22 08:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3975. Apr 22 08:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  3976. Apr 22 08:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  3977. Apr 22 08:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  3978. Apr 22 08:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  3979. Apr 22 08:41:38 hp-epyc kernel: </TASK>
  3980. Apr 22 08:41:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  3981. Apr 22 08:41:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  3982. Apr 22 08:41:38 hp-epyc kernel: (detected by 0, t=34080947 jiffies, g=1051549, q=51550821)
  3983. Apr 22 08:41:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  3984. Apr 22 08:41:38 hp-epyc kernel: Call Trace:
  3985. Apr 22 08:41:38 hp-epyc kernel: <TASK>
  3986. Apr 22 08:41:38 hp-epyc kernel: __schedule+0x238/0x5e0
  3987. Apr 22 08:41:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  3988. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  3989. Apr 22 08:41:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  3990. Apr 22 08:41:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  3991. Apr 22 08:41:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  3992. Apr 22 08:41:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  3993. Apr 22 08:41:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  3994. Apr 22 08:41:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  3995. Apr 22 08:41:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  3996. Apr 22 08:41:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  3997. Apr 22 08:41:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  3998. Apr 22 08:41:38 hp-epyc kernel: kthread+0x191/0x1b0
  3999. Apr 22 08:41:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4000. Apr 22 08:41:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4001. Apr 22 08:41:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4002. Apr 22 08:41:38 hp-epyc kernel: </TASK>
  4003. Apr 22 08:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4004. Apr 22 08:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4005. Apr 22 08:44:38 hp-epyc kernel: (detected by 0, t=34260952 jiffies, g=1051549, q=51623250)
  4006. Apr 22 08:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4007. Apr 22 08:44:38 hp-epyc kernel: Call Trace:
  4008. Apr 22 08:44:38 hp-epyc kernel: <TASK>
  4009. Apr 22 08:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4010. Apr 22 08:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4011. Apr 22 08:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4012. Apr 22 08:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4013. Apr 22 08:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4014. Apr 22 08:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4015. Apr 22 08:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4016. Apr 22 08:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4017. Apr 22 08:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4018. Apr 22 08:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4019. Apr 22 08:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4020. Apr 22 08:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4021. Apr 22 08:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  4022. Apr 22 08:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4023. Apr 22 08:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4024. Apr 22 08:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4025. Apr 22 08:44:38 hp-epyc kernel: </TASK>
  4026. Apr 22 08:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4027. Apr 22 08:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4028. Apr 22 08:47:38 hp-epyc kernel: (detected by 0, t=34440957 jiffies, g=1051549, q=51693919)
  4029. Apr 22 08:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4030. Apr 22 08:47:38 hp-epyc kernel: Call Trace:
  4031. Apr 22 08:47:38 hp-epyc kernel: <TASK>
  4032. Apr 22 08:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4033. Apr 22 08:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4034. Apr 22 08:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4035. Apr 22 08:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4036. Apr 22 08:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4037. Apr 22 08:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4038. Apr 22 08:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4039. Apr 22 08:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4040. Apr 22 08:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4041. Apr 22 08:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4042. Apr 22 08:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4043. Apr 22 08:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4044. Apr 22 08:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  4045. Apr 22 08:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4046. Apr 22 08:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4047. Apr 22 08:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4048. Apr 22 08:47:38 hp-epyc kernel: </TASK>
  4049. Apr 22 08:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4050. Apr 22 08:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4051. Apr 22 08:50:38 hp-epyc kernel: (detected by 0, t=34620962 jiffies, g=1051549, q=51766914)
  4052. Apr 22 08:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4053. Apr 22 08:50:38 hp-epyc kernel: Call Trace:
  4054. Apr 22 08:50:38 hp-epyc kernel: <TASK>
  4055. Apr 22 08:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4056. Apr 22 08:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4057. Apr 22 08:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4058. Apr 22 08:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4059. Apr 22 08:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4060. Apr 22 08:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4061. Apr 22 08:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4062. Apr 22 08:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4063. Apr 22 08:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4064. Apr 22 08:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4065. Apr 22 08:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4066. Apr 22 08:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4067. Apr 22 08:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  4068. Apr 22 08:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4069. Apr 22 08:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4070. Apr 22 08:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4071. Apr 22 08:50:38 hp-epyc kernel: </TASK>
  4072. Apr 22 08:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4073. Apr 22 08:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4074. Apr 22 08:56:38 hp-epyc kernel: (detected by 53, t=34800967 jiffies, g=1051549, q=51835158)
  4075. Apr 22 08:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4076. Apr 22 08:56:38 hp-epyc kernel: Call Trace:
  4077. Apr 22 08:56:38 hp-epyc kernel: <TASK>
  4078. Apr 22 08:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4079. Apr 22 08:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4080. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4081. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4082. Apr 22 08:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4083. Apr 22 08:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4084. Apr 22 08:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4085. Apr 22 08:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4086. Apr 22 08:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4087. Apr 22 08:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4088. Apr 22 08:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4089. Apr 22 08:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4090. Apr 22 08:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  4091. Apr 22 08:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4092. Apr 22 08:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4093. Apr 22 08:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4094. Apr 22 08:56:38 hp-epyc kernel: </TASK>
  4095. Apr 22 08:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4096. Apr 22 08:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4097. Apr 22 08:56:38 hp-epyc kernel: (detected by 0, t=34980972 jiffies, g=1051549, q=51907782)
  4098. Apr 22 08:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4099. Apr 22 08:56:38 hp-epyc kernel: Call Trace:
  4100. Apr 22 08:56:38 hp-epyc kernel: <TASK>
  4101. Apr 22 08:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4102. Apr 22 08:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4103. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4104. Apr 22 08:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4105. Apr 22 08:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4106. Apr 22 08:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4107. Apr 22 08:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4108. Apr 22 08:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4109. Apr 22 08:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4110. Apr 22 08:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4111. Apr 22 08:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4112. Apr 22 08:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4113. Apr 22 08:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  4114. Apr 22 08:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4115. Apr 22 08:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4116. Apr 22 08:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4117. Apr 22 08:56:38 hp-epyc kernel: </TASK>
  4118. Apr 22 08:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4119. Apr 22 08:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4120. Apr 22 08:59:38 hp-epyc kernel: (detected by 0, t=35160977 jiffies, g=1051549, q=51978604)
  4121. Apr 22 08:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4122. Apr 22 08:59:38 hp-epyc kernel: Call Trace:
  4123. Apr 22 08:59:38 hp-epyc kernel: <TASK>
  4124. Apr 22 08:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4125. Apr 22 08:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4126. Apr 22 08:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4127. Apr 22 08:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4128. Apr 22 08:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4129. Apr 22 08:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4130. Apr 22 08:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4131. Apr 22 08:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4132. Apr 22 08:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4133. Apr 22 08:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4134. Apr 22 08:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4135. Apr 22 08:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4136. Apr 22 08:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  4137. Apr 22 08:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4138. Apr 22 08:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4139. Apr 22 08:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4140. Apr 22 08:59:38 hp-epyc kernel: </TASK>
  4141. Apr 22 09:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4142. Apr 22 09:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4143. Apr 22 09:02:38 hp-epyc kernel: (detected by 0, t=35340982 jiffies, g=1051549, q=52049376)
  4144. Apr 22 09:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4145. Apr 22 09:02:38 hp-epyc kernel: Call Trace:
  4146. Apr 22 09:02:38 hp-epyc kernel: <TASK>
  4147. Apr 22 09:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4148. Apr 22 09:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4149. Apr 22 09:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4150. Apr 22 09:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4151. Apr 22 09:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4152. Apr 22 09:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4153. Apr 22 09:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4154. Apr 22 09:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4155. Apr 22 09:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4156. Apr 22 09:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4157. Apr 22 09:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4158. Apr 22 09:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4159. Apr 22 09:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  4160. Apr 22 09:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4161. Apr 22 09:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4162. Apr 22 09:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4163. Apr 22 09:02:38 hp-epyc kernel: </TASK>
  4164. Apr 22 09:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4165. Apr 22 09:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4166. Apr 22 09:05:38 hp-epyc kernel: (detected by 0, t=35520987 jiffies, g=1051549, q=52120707)
  4167. Apr 22 09:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4168. Apr 22 09:05:38 hp-epyc kernel: Call Trace:
  4169. Apr 22 09:05:38 hp-epyc kernel: <TASK>
  4170. Apr 22 09:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4171. Apr 22 09:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4172. Apr 22 09:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4173. Apr 22 09:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4174. Apr 22 09:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4175. Apr 22 09:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4176. Apr 22 09:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4177. Apr 22 09:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4178. Apr 22 09:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4179. Apr 22 09:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4180. Apr 22 09:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4181. Apr 22 09:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4182. Apr 22 09:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  4183. Apr 22 09:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4184. Apr 22 09:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4185. Apr 22 09:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4186. Apr 22 09:05:38 hp-epyc kernel: </TASK>
  4187. Apr 22 09:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4188. Apr 22 09:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4189. Apr 22 09:08:38 hp-epyc kernel: (detected by 0, t=35700992 jiffies, g=1051549, q=52190795)
  4190. Apr 22 09:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4191. Apr 22 09:08:38 hp-epyc kernel: Call Trace:
  4192. Apr 22 09:08:38 hp-epyc kernel: <TASK>
  4193. Apr 22 09:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4194. Apr 22 09:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4195. Apr 22 09:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4196. Apr 22 09:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4197. Apr 22 09:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4198. Apr 22 09:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4199. Apr 22 09:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4200. Apr 22 09:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4201. Apr 22 09:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4202. Apr 22 09:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4203. Apr 22 09:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4204. Apr 22 09:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4205. Apr 22 09:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  4206. Apr 22 09:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4207. Apr 22 09:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4208. Apr 22 09:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4209. Apr 22 09:08:38 hp-epyc kernel: </TASK>
  4210. Apr 22 09:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4211. Apr 22 09:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4212. Apr 22 09:11:38 hp-epyc kernel: (detected by 0, t=35880997 jiffies, g=1051549, q=52264071)
  4213. Apr 22 09:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4214. Apr 22 09:11:38 hp-epyc kernel: Call Trace:
  4215. Apr 22 09:11:38 hp-epyc kernel: <TASK>
  4216. Apr 22 09:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4217. Apr 22 09:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4218. Apr 22 09:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4219. Apr 22 09:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4220. Apr 22 09:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4221. Apr 22 09:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4222. Apr 22 09:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4223. Apr 22 09:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4224. Apr 22 09:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4225. Apr 22 09:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4226. Apr 22 09:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4227. Apr 22 09:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4228. Apr 22 09:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  4229. Apr 22 09:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4230. Apr 22 09:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4231. Apr 22 09:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4232. Apr 22 09:11:38 hp-epyc kernel: </TASK>
  4233. Apr 22 09:14:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4234. Apr 22 09:14:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4235. Apr 22 09:14:38 hp-epyc kernel: (detected by 0, t=36061002 jiffies, g=1051549, q=52337073)
  4236. Apr 22 09:14:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4237. Apr 22 09:14:38 hp-epyc kernel: Call Trace:
  4238. Apr 22 09:14:38 hp-epyc kernel: <TASK>
  4239. Apr 22 09:14:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4240. Apr 22 09:14:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4241. Apr 22 09:14:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4242. Apr 22 09:14:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4243. Apr 22 09:14:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4244. Apr 22 09:14:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4245. Apr 22 09:14:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4246. Apr 22 09:14:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4247. Apr 22 09:14:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4248. Apr 22 09:14:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4249. Apr 22 09:14:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4250. Apr 22 09:14:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4251. Apr 22 09:14:38 hp-epyc kernel: kthread+0x191/0x1b0
  4252. Apr 22 09:14:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4253. Apr 22 09:14:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4254. Apr 22 09:14:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4255. Apr 22 09:14:38 hp-epyc kernel: </TASK>
  4256. Apr 22 09:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4257. Apr 22 09:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4258. Apr 22 09:17:38 hp-epyc kernel: (detected by 0, t=36241007 jiffies, g=1051549, q=52407987)
  4259. Apr 22 09:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4260. Apr 22 09:17:38 hp-epyc kernel: Call Trace:
  4261. Apr 22 09:17:38 hp-epyc kernel: <TASK>
  4262. Apr 22 09:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4263. Apr 22 09:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4264. Apr 22 09:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4265. Apr 22 09:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4266. Apr 22 09:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4267. Apr 22 09:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4268. Apr 22 09:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4269. Apr 22 09:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4270. Apr 22 09:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4271. Apr 22 09:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4272. Apr 22 09:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4273. Apr 22 09:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4274. Apr 22 09:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  4275. Apr 22 09:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4276. Apr 22 09:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4277. Apr 22 09:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4278. Apr 22 09:17:38 hp-epyc kernel: </TASK>
  4279. Apr 22 09:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4280. Apr 22 09:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4281. Apr 22 09:20:38 hp-epyc kernel: (detected by 0, t=36421012 jiffies, g=1051549, q=52478136)
  4282. Apr 22 09:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4283. Apr 22 09:20:38 hp-epyc kernel: Call Trace:
  4284. Apr 22 09:20:38 hp-epyc kernel: <TASK>
  4285. Apr 22 09:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4286. Apr 22 09:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4287. Apr 22 09:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4288. Apr 22 09:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4289. Apr 22 09:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4290. Apr 22 09:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4291. Apr 22 09:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4292. Apr 22 09:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4293. Apr 22 09:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4294. Apr 22 09:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4295. Apr 22 09:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4296. Apr 22 09:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4297. Apr 22 09:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  4298. Apr 22 09:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4299. Apr 22 09:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4300. Apr 22 09:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4301. Apr 22 09:20:38 hp-epyc kernel: </TASK>
  4302. Apr 22 09:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4303. Apr 22 09:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4304. Apr 22 09:23:38 hp-epyc kernel: (detected by 0, t=36601017 jiffies, g=1051549, q=52549146)
  4305. Apr 22 09:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4306. Apr 22 09:23:38 hp-epyc kernel: Call Trace:
  4307. Apr 22 09:23:38 hp-epyc kernel: <TASK>
  4308. Apr 22 09:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4309. Apr 22 09:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4310. Apr 22 09:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4311. Apr 22 09:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4312. Apr 22 09:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4313. Apr 22 09:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4314. Apr 22 09:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4315. Apr 22 09:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4316. Apr 22 09:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4317. Apr 22 09:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4318. Apr 22 09:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4319. Apr 22 09:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4320. Apr 22 09:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  4321. Apr 22 09:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4322. Apr 22 09:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4323. Apr 22 09:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4324. Apr 22 09:23:38 hp-epyc kernel: </TASK>
  4325. Apr 22 09:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4326. Apr 22 09:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4327. Apr 22 09:26:38 hp-epyc kernel: (detected by 0, t=36781022 jiffies, g=1051549, q=52619486)
  4328. Apr 22 09:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4329. Apr 22 09:26:38 hp-epyc kernel: Call Trace:
  4330. Apr 22 09:26:38 hp-epyc kernel: <TASK>
  4331. Apr 22 09:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4332. Apr 22 09:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4333. Apr 22 09:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4334. Apr 22 09:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4335. Apr 22 09:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4336. Apr 22 09:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4337. Apr 22 09:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4338. Apr 22 09:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4339. Apr 22 09:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4340. Apr 22 09:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4341. Apr 22 09:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4342. Apr 22 09:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4343. Apr 22 09:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  4344. Apr 22 09:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4345. Apr 22 09:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4346. Apr 22 09:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4347. Apr 22 09:26:38 hp-epyc kernel: </TASK>
  4348. Apr 22 09:29:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4349. Apr 22 09:29:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4350. Apr 22 09:29:38 hp-epyc kernel: (detected by 0, t=36961027 jiffies, g=1051549, q=52690285)
  4351. Apr 22 09:29:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4352. Apr 22 09:29:38 hp-epyc kernel: Call Trace:
  4353. Apr 22 09:29:38 hp-epyc kernel: <TASK>
  4354. Apr 22 09:29:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4355. Apr 22 09:29:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4356. Apr 22 09:29:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4357. Apr 22 09:29:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4358. Apr 22 09:29:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4359. Apr 22 09:29:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4360. Apr 22 09:29:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4361. Apr 22 09:29:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4362. Apr 22 09:29:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4363. Apr 22 09:29:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4364. Apr 22 09:29:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4365. Apr 22 09:29:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4366. Apr 22 09:29:38 hp-epyc kernel: kthread+0x191/0x1b0
  4367. Apr 22 09:29:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4368. Apr 22 09:29:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4369. Apr 22 09:29:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4370. Apr 22 09:29:38 hp-epyc kernel: </TASK>
  4371. Apr 22 09:32:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4372. Apr 22 09:32:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4373. Apr 22 09:32:38 hp-epyc kernel: (detected by 0, t=37141032 jiffies, g=1051549, q=52763176)
  4374. Apr 22 09:32:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4375. Apr 22 09:32:38 hp-epyc kernel: Call Trace:
  4376. Apr 22 09:32:38 hp-epyc kernel: <TASK>
  4377. Apr 22 09:32:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4378. Apr 22 09:32:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4379. Apr 22 09:32:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4380. Apr 22 09:32:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4381. Apr 22 09:32:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4382. Apr 22 09:32:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4383. Apr 22 09:32:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4384. Apr 22 09:32:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4385. Apr 22 09:32:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4386. Apr 22 09:32:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4387. Apr 22 09:32:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4388. Apr 22 09:32:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4389. Apr 22 09:32:38 hp-epyc kernel: kthread+0x191/0x1b0
  4390. Apr 22 09:32:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4391. Apr 22 09:32:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4392. Apr 22 09:32:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4393. Apr 22 09:32:38 hp-epyc kernel: </TASK>
  4394. Apr 22 09:35:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4395. Apr 22 09:35:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4396. Apr 22 09:35:38 hp-epyc kernel: (detected by 0, t=37321037 jiffies, g=1051549, q=52833078)
  4397. Apr 22 09:35:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4398. Apr 22 09:35:38 hp-epyc kernel: Call Trace:
  4399. Apr 22 09:35:38 hp-epyc kernel: <TASK>
  4400. Apr 22 09:35:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4401. Apr 22 09:35:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4402. Apr 22 09:35:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4403. Apr 22 09:35:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4404. Apr 22 09:35:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4405. Apr 22 09:35:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4406. Apr 22 09:35:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4407. Apr 22 09:35:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4408. Apr 22 09:35:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4409. Apr 22 09:35:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4410. Apr 22 09:35:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4411. Apr 22 09:35:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4412. Apr 22 09:35:38 hp-epyc kernel: kthread+0x191/0x1b0
  4413. Apr 22 09:35:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4414. Apr 22 09:35:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4415. Apr 22 09:35:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4416. Apr 22 09:35:38 hp-epyc kernel: </TASK>
  4417. Apr 22 09:38:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4418. Apr 22 09:38:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4419. Apr 22 09:38:38 hp-epyc kernel: (detected by 0, t=37501042 jiffies, g=1051549, q=52904252)
  4420. Apr 22 09:38:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4421. Apr 22 09:38:38 hp-epyc kernel: Call Trace:
  4422. Apr 22 09:38:38 hp-epyc kernel: <TASK>
  4423. Apr 22 09:38:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4424. Apr 22 09:38:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4425. Apr 22 09:38:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4426. Apr 22 09:38:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4427. Apr 22 09:38:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4428. Apr 22 09:38:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4429. Apr 22 09:38:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4430. Apr 22 09:38:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4431. Apr 22 09:38:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4432. Apr 22 09:38:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4433. Apr 22 09:38:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4434. Apr 22 09:38:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4435. Apr 22 09:38:38 hp-epyc kernel: kthread+0x191/0x1b0
  4436. Apr 22 09:38:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4437. Apr 22 09:38:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4438. Apr 22 09:38:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4439. Apr 22 09:38:38 hp-epyc kernel: </TASK>
  4440. Apr 22 09:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4441. Apr 22 09:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4442. Apr 22 09:44:38 hp-epyc kernel: (detected by 53, t=37681047 jiffies, g=1051549, q=52977532)
  4443. Apr 22 09:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4444. Apr 22 09:44:38 hp-epyc kernel: Call Trace:
  4445. Apr 22 09:44:38 hp-epyc kernel: <TASK>
  4446. Apr 22 09:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4447. Apr 22 09:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4448. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4449. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4450. Apr 22 09:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4451. Apr 22 09:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4452. Apr 22 09:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4453. Apr 22 09:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4454. Apr 22 09:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4455. Apr 22 09:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4456. Apr 22 09:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4457. Apr 22 09:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4458. Apr 22 09:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  4459. Apr 22 09:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4460. Apr 22 09:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4461. Apr 22 09:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4462. Apr 22 09:44:38 hp-epyc kernel: </TASK>
  4463. Apr 22 09:44:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4464. Apr 22 09:44:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4465. Apr 22 09:44:38 hp-epyc kernel: (detected by 0, t=37861052 jiffies, g=1051549, q=53048735)
  4466. Apr 22 09:44:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4467. Apr 22 09:44:38 hp-epyc kernel: Call Trace:
  4468. Apr 22 09:44:38 hp-epyc kernel: <TASK>
  4469. Apr 22 09:44:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4470. Apr 22 09:44:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4471. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4472. Apr 22 09:44:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4473. Apr 22 09:44:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4474. Apr 22 09:44:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4475. Apr 22 09:44:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4476. Apr 22 09:44:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4477. Apr 22 09:44:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4478. Apr 22 09:44:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4479. Apr 22 09:44:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4480. Apr 22 09:44:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4481. Apr 22 09:44:38 hp-epyc kernel: kthread+0x191/0x1b0
  4482. Apr 22 09:44:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4483. Apr 22 09:44:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4484. Apr 22 09:44:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4485. Apr 22 09:44:38 hp-epyc kernel: </TASK>
  4486. Apr 22 09:47:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4487. Apr 22 09:47:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4488. Apr 22 09:47:38 hp-epyc kernel: (detected by 0, t=38041057 jiffies, g=1051549, q=53117116)
  4489. Apr 22 09:47:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4490. Apr 22 09:47:38 hp-epyc kernel: Call Trace:
  4491. Apr 22 09:47:38 hp-epyc kernel: <TASK>
  4492. Apr 22 09:47:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4493. Apr 22 09:47:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4494. Apr 22 09:47:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4495. Apr 22 09:47:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4496. Apr 22 09:47:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4497. Apr 22 09:47:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4498. Apr 22 09:47:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4499. Apr 22 09:47:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4500. Apr 22 09:47:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4501. Apr 22 09:47:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4502. Apr 22 09:47:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4503. Apr 22 09:47:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4504. Apr 22 09:47:38 hp-epyc kernel: kthread+0x191/0x1b0
  4505. Apr 22 09:47:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4506. Apr 22 09:47:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4507. Apr 22 09:47:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4508. Apr 22 09:47:38 hp-epyc kernel: </TASK>
  4509. Apr 22 09:49:06 hp-epyc kernel: node-cache invoked oom-killer: gfp_mask=0x1100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=999
  4510. Apr 22 09:49:06 hp-epyc kernel: CPU: 64 PID: 4325 Comm: node-cache Tainted: G OE 5.15.0-1032-realtime #35-Ubuntu
  4511. Apr 22 09:49:06 hp-epyc kernel: Hardware name: Supermicro Super Server/H13SVW-NT, BIOS 1.1b.V1 12/25/2023
  4512. Apr 22 09:49:06 hp-epyc kernel: Call Trace:
  4513. Apr 22 09:49:06 hp-epyc kernel: <TASK>
  4514. Apr 22 09:49:06 hp-epyc kernel: show_stack+0x52/0x5c
  4515. Apr 22 09:49:06 hp-epyc kernel: dump_stack_lvl+0x4a/0x63
  4516. Apr 22 09:49:06 hp-epyc kernel: dump_stack+0x10/0x16
  4517. Apr 22 09:49:06 hp-epyc kernel: dump_header+0x4f/0x207
  4518. Apr 22 09:49:06 hp-epyc kernel: oom_kill_process.cold+0xb/0x10
  4519. Apr 22 09:49:06 hp-epyc kernel: out_of_memory+0xf9/0x2e0
  4520. Apr 22 09:49:06 hp-epyc kernel: mem_cgroup_out_of_memory+0x13f/0x160
  4521. Apr 22 09:49:06 hp-epyc kernel: try_charge_memcg+0x72b/0x7f0
  4522. Apr 22 09:49:06 hp-epyc kernel: __mem_cgroup_charge+0x38/0x100
  4523. Apr 22 09:49:06 hp-epyc kernel: __add_to_page_cache_locked+0x2fe/0x370
  4524. Apr 22 09:49:06 hp-epyc kernel: ? scan_shadow_nodes+0x40/0x40
  4525. Apr 22 09:49:06 hp-epyc kernel: add_to_page_cache_lru+0x4d/0xd0
  4526. Apr 22 09:49:06 hp-epyc kernel: pagecache_get_page+0x1de/0x4d0
  4527. Apr 22 09:49:06 hp-epyc kernel: filemap_fault+0x491/0xad0
  4528. Apr 22 09:49:06 hp-epyc kernel: ? rt_spin_unlock+0x18/0x50
  4529. Apr 22 09:49:06 hp-epyc kernel: __do_fault+0x40/0x130
  4530. Apr 22 09:49:06 hp-epyc kernel: do_read_fault+0xeb/0x160
  4531. Apr 22 09:49:06 hp-epyc kernel: do_fault+0xa2/0x370
  4532. Apr 22 09:49:06 hp-epyc kernel: handle_pte_fault+0x130/0x170
  4533. Apr 22 09:49:06 hp-epyc kernel: __handle_mm_fault+0x17e/0x210
  4534. Apr 22 09:49:06 hp-epyc kernel: handle_mm_fault+0xdd/0x2c0
  4535. Apr 22 09:49:06 hp-epyc kernel: do_user_addr_fault+0x1e4/0x680
  4536. Apr 22 09:49:06 hp-epyc kernel: exc_page_fault+0x7a/0x1c0
  4537. Apr 22 09:49:06 hp-epyc kernel: asm_exc_page_fault+0x27/0x30
  4538. Apr 22 09:49:06 hp-epyc kernel: RIP: 0033:0x456290
  4539. Apr 22 09:49:06 hp-epyc kernel: Code: 89 de 48 89 cf 48 89 c1 48 89 d0 48 89 74 24 50 48 89 8c 24 90 00 00 00 48 89 7c 24 58 48 89 44 24 40 48 8b 94 24 b0 00 00 00 <8b> 1a 48 8b 84 24 b8 00 00 00 e8 01 f7 ff ff 48 39 44 24 48 41 0f
  4540. Apr 22 09:49:06 hp-epyc kernel: RSP: 002b:000000c000909128 EFLAGS: 00010202
  4541. Apr 22 09:49:06 hp-epyc kernel: RAX: 000000000040d904 RBX: 000000000030b24a RCX: 0000000001c73b46
  4542. Apr 22 09:49:06 hp-epyc kernel: RDX: 0000000001fdf208 RSI: 000000000030b24a RDI: 000000000030b24a
  4543. Apr 22 09:49:06 hp-epyc kernel: RBP: 000000c0009091e8 R08: 0000000000000004 R09: 0000000000000000
  4544. Apr 22 09:49:06 hp-epyc kernel: R10: 000000000030f690 R11: 0000000000004444 R12: 000000c0009091a8
  4545. Apr 22 09:49:06 hp-epyc kernel: R13: 0000000000000028 R14: 000000c0000ee000 R15: 00007f631ac2e610
  4546. Apr 22 09:49:06 hp-epyc kernel: </TASK>
  4547. Apr 22 09:49:06 hp-epyc kernel: memory: usage 204800kB, limit 204800kB, failcnt 12429139
  4548. Apr 22 09:49:06 hp-epyc kernel: swap: usage 0kB, limit 9007199254740988kB, failcnt 0
  4549. Apr 22 09:49:06 hp-epyc kernel: Memory cgroup stats for /kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393a51b_44d3_46c8_b7c9_8c7dc005d512.slice:
  4550. Apr 22 09:49:06 hp-epyc kernel: anon 14385152
  4551. file 499712
  4552. kernel_stack 573440
  4553. pagetables 237568
  4554. percpu 653312
  4555. sock 24576
  4556. shmem 0
  4557. file_mapped 176128
  4558. file_dirty 0
  4559. file_writeback 0
  4560. swapcached 0
  4561. inactive_anon 14376960
  4562. active_anon 8192
  4563. inactive_file 77824
  4564. active_file 0
  4565. unevictable 0
  4566. slab_reclaimable 134221656
  4567. slab_unreclaimable 59029112
  4568. slab 193250768
  4569. workingset_refault_anon 0
  4570. workingset_refault_file 21683701
  4571. workingset_activate_anon 0
  4572. workingset_activate_file 1219604
  4573. workingset_restore_anon 0
  4574. workingset_restore_file 520219
  4575. workingset_nodereclaim 0
  4576. pgfault 2237274
  4577. pgmajfault 902669
  4578. pgrefill 5830056
  4579. pgscan 109842130
  4580. pgsteal 21691144
  4581. pgactivate 3769869
  4582. pgdeactivate 4989506
  4583. pglazyfree 0
  4584. pglazyfreed 0
  4585. Apr 22 09:49:06 hp-epyc kernel: Tasks state (memory values in pages):
  4586. Apr 22 09:49:06 hp-epyc kernel: [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
  4587. Apr 22 09:49:06 hp-epyc kernel: [ 4242] 65535 4242 257 1 28672 0 -998 pause
  4588. Apr 22 09:49:06 hp-epyc kernel: [ 4273] 0 4273 185855 3345 200704 0 999 node-cache
  4589. Apr 22 09:49:06 hp-epyc kernel: [1295014] 0 1295014 857 40 45056 0 999 iptables
  4590. Apr 22 09:49:06 hp-epyc kernel: oom-kill:constraint=CONSTRAINT_MEMCG,nodemask=(null),cpuset=cri-containerd-9eb805372aad7952728a0696891c15407e557a984e4bcb6a1384af5921c674bb.scope,mems_allowed=0,oom_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393a51b_44d3_46c8_b7c9_8c7dc005d512.slice,task_memcg=/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5393a51b_44d3_46c8_b7c9_8c7dc005d512.slice/cri-containerd-9eb805372aad7952728a0696891c15407e557a984e4bcb6a1384af5921c674bb.scope,task=node-cache,pid=4273,uid=0
  4591. Apr 22 09:49:06 hp-epyc kernel: Memory cgroup out of memory: Killed process 4273 (node-cache) total-vm:743420kB, anon-rss:13380kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:196kB oom_score_adj:999
  4592. Apr 22 09:50:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4593. Apr 22 09:50:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4594. Apr 22 09:50:38 hp-epyc kernel: (detected by 0, t=38221062 jiffies, g=1051549, q=53187805)
  4595. Apr 22 09:50:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4596. Apr 22 09:50:38 hp-epyc kernel: Call Trace:
  4597. Apr 22 09:50:38 hp-epyc kernel: <TASK>
  4598. Apr 22 09:50:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4599. Apr 22 09:50:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4600. Apr 22 09:50:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4601. Apr 22 09:50:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4602. Apr 22 09:50:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4603. Apr 22 09:50:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4604. Apr 22 09:50:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4605. Apr 22 09:50:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4606. Apr 22 09:50:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4607. Apr 22 09:50:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4608. Apr 22 09:50:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4609. Apr 22 09:50:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4610. Apr 22 09:50:38 hp-epyc kernel: kthread+0x191/0x1b0
  4611. Apr 22 09:50:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4612. Apr 22 09:50:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4613. Apr 22 09:50:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4614. Apr 22 09:50:38 hp-epyc kernel: </TASK>
  4615. Apr 22 09:53:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4616. Apr 22 09:53:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4617. Apr 22 09:53:38 hp-epyc kernel: (detected by 0, t=38401067 jiffies, g=1051549, q=53253656)
  4618. Apr 22 09:53:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4619. Apr 22 09:53:38 hp-epyc kernel: Call Trace:
  4620. Apr 22 09:53:38 hp-epyc kernel: <TASK>
  4621. Apr 22 09:53:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4622. Apr 22 09:53:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4623. Apr 22 09:53:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4624. Apr 22 09:53:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4625. Apr 22 09:53:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4626. Apr 22 09:53:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4627. Apr 22 09:53:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4628. Apr 22 09:53:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4629. Apr 22 09:53:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4630. Apr 22 09:53:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4631. Apr 22 09:53:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4632. Apr 22 09:53:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4633. Apr 22 09:53:38 hp-epyc kernel: kthread+0x191/0x1b0
  4634. Apr 22 09:53:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4635. Apr 22 09:53:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4636. Apr 22 09:53:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4637. Apr 22 09:53:38 hp-epyc kernel: </TASK>
  4638. Apr 22 09:56:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4639. Apr 22 09:56:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4640. Apr 22 09:56:38 hp-epyc kernel: (detected by 0, t=38581072 jiffies, g=1051549, q=53320628)
  4641. Apr 22 09:56:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4642. Apr 22 09:56:38 hp-epyc kernel: Call Trace:
  4643. Apr 22 09:56:38 hp-epyc kernel: <TASK>
  4644. Apr 22 09:56:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4645. Apr 22 09:56:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4646. Apr 22 09:56:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4647. Apr 22 09:56:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4648. Apr 22 09:56:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4649. Apr 22 09:56:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4650. Apr 22 09:56:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4651. Apr 22 09:56:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4652. Apr 22 09:56:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4653. Apr 22 09:56:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4654. Apr 22 09:56:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4655. Apr 22 09:56:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4656. Apr 22 09:56:38 hp-epyc kernel: kthread+0x191/0x1b0
  4657. Apr 22 09:56:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4658. Apr 22 09:56:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4659. Apr 22 09:56:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4660. Apr 22 09:56:38 hp-epyc kernel: </TASK>
  4661. Apr 22 09:59:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4662. Apr 22 09:59:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4663. Apr 22 09:59:38 hp-epyc kernel: (detected by 0, t=38761077 jiffies, g=1051549, q=53388556)
  4664. Apr 22 09:59:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4665. Apr 22 09:59:38 hp-epyc kernel: Call Trace:
  4666. Apr 22 09:59:38 hp-epyc kernel: <TASK>
  4667. Apr 22 09:59:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4668. Apr 22 09:59:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4669. Apr 22 09:59:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4670. Apr 22 09:59:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4671. Apr 22 09:59:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4672. Apr 22 09:59:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4673. Apr 22 09:59:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4674. Apr 22 09:59:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4675. Apr 22 09:59:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4676. Apr 22 09:59:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4677. Apr 22 09:59:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4678. Apr 22 09:59:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4679. Apr 22 09:59:38 hp-epyc kernel: kthread+0x191/0x1b0
  4680. Apr 22 09:59:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4681. Apr 22 09:59:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4682. Apr 22 09:59:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4683. Apr 22 09:59:38 hp-epyc kernel: </TASK>
  4684. Apr 22 10:02:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4685. Apr 22 10:02:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4686. Apr 22 10:02:38 hp-epyc kernel: (detected by 0, t=38941082 jiffies, g=1051549, q=53458277)
  4687. Apr 22 10:02:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4688. Apr 22 10:02:38 hp-epyc kernel: Call Trace:
  4689. Apr 22 10:02:38 hp-epyc kernel: <TASK>
  4690. Apr 22 10:02:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4691. Apr 22 10:02:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4692. Apr 22 10:02:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4693. Apr 22 10:02:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4694. Apr 22 10:02:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4695. Apr 22 10:02:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4696. Apr 22 10:02:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4697. Apr 22 10:02:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4698. Apr 22 10:02:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4699. Apr 22 10:02:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4700. Apr 22 10:02:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4701. Apr 22 10:02:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4702. Apr 22 10:02:38 hp-epyc kernel: kthread+0x191/0x1b0
  4703. Apr 22 10:02:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4704. Apr 22 10:02:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4705. Apr 22 10:02:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4706. Apr 22 10:02:38 hp-epyc kernel: </TASK>
  4707. Apr 22 10:05:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4708. Apr 22 10:05:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4709. Apr 22 10:05:38 hp-epyc kernel: (detected by 0, t=39121087 jiffies, g=1051549, q=53523485)
  4710. Apr 22 10:05:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4711. Apr 22 10:05:38 hp-epyc kernel: Call Trace:
  4712. Apr 22 10:05:38 hp-epyc kernel: <TASK>
  4713. Apr 22 10:05:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4714. Apr 22 10:05:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4715. Apr 22 10:05:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4716. Apr 22 10:05:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4717. Apr 22 10:05:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4718. Apr 22 10:05:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4719. Apr 22 10:05:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4720. Apr 22 10:05:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4721. Apr 22 10:05:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4722. Apr 22 10:05:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4723. Apr 22 10:05:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4724. Apr 22 10:05:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4725. Apr 22 10:05:38 hp-epyc kernel: kthread+0x191/0x1b0
  4726. Apr 22 10:05:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4727. Apr 22 10:05:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4728. Apr 22 10:05:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4729. Apr 22 10:05:38 hp-epyc kernel: </TASK>
  4730. Apr 22 10:08:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4731. Apr 22 10:08:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4732. Apr 22 10:08:38 hp-epyc kernel: (detected by 0, t=39301092 jiffies, g=1051549, q=53588607)
  4733. Apr 22 10:08:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4734. Apr 22 10:08:38 hp-epyc kernel: Call Trace:
  4735. Apr 22 10:08:38 hp-epyc kernel: <TASK>
  4736. Apr 22 10:08:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4737. Apr 22 10:08:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4738. Apr 22 10:08:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4739. Apr 22 10:08:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4740. Apr 22 10:08:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4741. Apr 22 10:08:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4742. Apr 22 10:08:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4743. Apr 22 10:08:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4744. Apr 22 10:08:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4745. Apr 22 10:08:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4746. Apr 22 10:08:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4747. Apr 22 10:08:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4748. Apr 22 10:08:38 hp-epyc kernel: kthread+0x191/0x1b0
  4749. Apr 22 10:08:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4750. Apr 22 10:08:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4751. Apr 22 10:08:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4752. Apr 22 10:08:38 hp-epyc kernel: </TASK>
  4753. Apr 22 10:11:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4754. Apr 22 10:11:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4755. Apr 22 10:11:38 hp-epyc kernel: (detected by 0, t=39481097 jiffies, g=1051549, q=53657187)
  4756. Apr 22 10:11:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4757. Apr 22 10:11:38 hp-epyc kernel: Call Trace:
  4758. Apr 22 10:11:38 hp-epyc kernel: <TASK>
  4759. Apr 22 10:11:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4760. Apr 22 10:11:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4761. Apr 22 10:11:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4762. Apr 22 10:11:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4763. Apr 22 10:11:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4764. Apr 22 10:11:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4765. Apr 22 10:11:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4766. Apr 22 10:11:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4767. Apr 22 10:11:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4768. Apr 22 10:11:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4769. Apr 22 10:11:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4770. Apr 22 10:11:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4771. Apr 22 10:11:38 hp-epyc kernel: kthread+0x191/0x1b0
  4772. Apr 22 10:11:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4773. Apr 22 10:11:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4774. Apr 22 10:11:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4775. Apr 22 10:11:38 hp-epyc kernel: </TASK>
  4776. Apr 22 10:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4777. Apr 22 10:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4778. Apr 22 10:17:38 hp-epyc kernel: (detected by 53, t=39661102 jiffies, g=1051549, q=53724327)
  4779. Apr 22 10:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4780. Apr 22 10:17:38 hp-epyc kernel: Call Trace:
  4781. Apr 22 10:17:38 hp-epyc kernel: <TASK>
  4782. Apr 22 10:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4783. Apr 22 10:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4784. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4785. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4786. Apr 22 10:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4787. Apr 22 10:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4788. Apr 22 10:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4789. Apr 22 10:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4790. Apr 22 10:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4791. Apr 22 10:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4792. Apr 22 10:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4793. Apr 22 10:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4794. Apr 22 10:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  4795. Apr 22 10:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4796. Apr 22 10:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4797. Apr 22 10:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4798. Apr 22 10:17:38 hp-epyc kernel: </TASK>
  4799. Apr 22 10:17:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4800. Apr 22 10:17:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4801. Apr 22 10:17:38 hp-epyc kernel: (detected by 0, t=39841107 jiffies, g=1051549, q=53794654)
  4802. Apr 22 10:17:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4803. Apr 22 10:17:38 hp-epyc kernel: Call Trace:
  4804. Apr 22 10:17:38 hp-epyc kernel: <TASK>
  4805. Apr 22 10:17:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4806. Apr 22 10:17:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4807. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4808. Apr 22 10:17:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4809. Apr 22 10:17:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4810. Apr 22 10:17:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4811. Apr 22 10:17:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4812. Apr 22 10:17:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4813. Apr 22 10:17:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4814. Apr 22 10:17:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4815. Apr 22 10:17:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4816. Apr 22 10:17:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4817. Apr 22 10:17:38 hp-epyc kernel: kthread+0x191/0x1b0
  4818. Apr 22 10:17:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4819. Apr 22 10:17:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4820. Apr 22 10:17:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4821. Apr 22 10:17:38 hp-epyc kernel: </TASK>
  4822. Apr 22 10:20:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4823. Apr 22 10:20:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4824. Apr 22 10:20:38 hp-epyc kernel: (detected by 0, t=40021112 jiffies, g=1051549, q=53861410)
  4825. Apr 22 10:20:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4826. Apr 22 10:20:38 hp-epyc kernel: Call Trace:
  4827. Apr 22 10:20:38 hp-epyc kernel: <TASK>
  4828. Apr 22 10:20:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4829. Apr 22 10:20:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4830. Apr 22 10:20:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4831. Apr 22 10:20:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4832. Apr 22 10:20:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4833. Apr 22 10:20:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4834. Apr 22 10:20:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4835. Apr 22 10:20:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4836. Apr 22 10:20:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4837. Apr 22 10:20:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4838. Apr 22 10:20:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4839. Apr 22 10:20:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4840. Apr 22 10:20:38 hp-epyc kernel: kthread+0x191/0x1b0
  4841. Apr 22 10:20:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4842. Apr 22 10:20:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4843. Apr 22 10:20:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4844. Apr 22 10:20:38 hp-epyc kernel: </TASK>
  4845. Apr 22 10:23:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4846. Apr 22 10:23:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4847. Apr 22 10:23:38 hp-epyc kernel: (detected by 0, t=40201117 jiffies, g=1051549, q=53929005)
  4848. Apr 22 10:23:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4849. Apr 22 10:23:38 hp-epyc kernel: Call Trace:
  4850. Apr 22 10:23:38 hp-epyc kernel: <TASK>
  4851. Apr 22 10:23:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4852. Apr 22 10:23:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4853. Apr 22 10:23:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4854. Apr 22 10:23:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4855. Apr 22 10:23:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4856. Apr 22 10:23:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4857. Apr 22 10:23:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4858. Apr 22 10:23:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4859. Apr 22 10:23:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4860. Apr 22 10:23:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4861. Apr 22 10:23:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4862. Apr 22 10:23:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4863. Apr 22 10:23:38 hp-epyc kernel: kthread+0x191/0x1b0
  4864. Apr 22 10:23:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4865. Apr 22 10:23:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4866. Apr 22 10:23:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4867. Apr 22 10:23:38 hp-epyc kernel: </TASK>
  4868. Apr 22 10:26:38 hp-epyc kernel: rcu: INFO: rcu_preempt detected stalls on CPUs/tasks:
  4869. Apr 22 10:26:38 hp-epyc kernel: rcu: Tasks blocked on level-1 rcu_node (CPUs 48-63): P497/2:b..l
  4870. Apr 22 10:26:38 hp-epyc kernel: (detected by 0, t=40381122 jiffies, g=1051549, q=53995897)
  4871. Apr 22 10:26:38 hp-epyc kernel: task:ksoftirqd/53 state:R running task stack: 0 pid: 497 ppid: 2 flags:0x00004000
  4872. Apr 22 10:26:38 hp-epyc kernel: Call Trace:
  4873. Apr 22 10:26:38 hp-epyc kernel: <TASK>
  4874. Apr 22 10:26:38 hp-epyc kernel: __schedule+0x238/0x5e0
  4875. Apr 22 10:26:38 hp-epyc kernel: ? asm_sysvec_reschedule_ipi+0x1b/0x20
  4876. Apr 22 10:26:38 hp-epyc kernel: preempt_schedule+0x60/0x80
  4877. Apr 22 10:26:38 hp-epyc kernel: preempt_schedule_thunk+0x16/0x18
  4878. Apr 22 10:26:38 hp-epyc kernel: rt_mutex_slowunlock+0x280/0x2f0
  4879. Apr 22 10:26:38 hp-epyc kernel: ? try_to_wake_up+0x307/0x670
  4880. Apr 22 10:26:38 hp-epyc kernel: rt_spin_unlock+0x3e/0x50
  4881. Apr 22 10:26:38 hp-epyc kernel: __hrtimer_run_queues+0x3a0/0x3c0
  4882. Apr 22 10:26:38 hp-epyc kernel: hrtimer_run_softirq+0xa6/0x110
  4883. Apr 22 10:26:38 hp-epyc kernel: __do_softirq+0xc9/0x2cc
  4884. Apr 22 10:26:38 hp-epyc kernel: run_ksoftirqd+0x30/0x80
  4885. Apr 22 10:26:38 hp-epyc kernel: smpboot_thread_fn+0x1d3/0x2d0
  4886. Apr 22 10:26:38 hp-epyc kernel: kthread+0x191/0x1b0
  4887. Apr 22 10:26:38 hp-epyc kernel: ? smpboot_register_percpu_thread+0xe0/0xe0
  4888. Apr 22 10:26:38 hp-epyc kernel: ? set_kthread_struct+0x50/0x50
  4889. Apr 22 10:26:38 hp-epyc kernel: ret_from_fork+0x22/0x30
  4890. Apr 22 10:26:38 hp-epyc kernel: </TASK>
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement