API tools faq
paste
Advertisement
Yi_Zhang

Untitled

Yi_Zhang
Mar 3rd, 2017
187
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 64.87 KB | None | 0 0
raw download clone embed print report
  1. [ 326.411481] nvmet: creating controller 1061 for NQN nqn.2014-08.org.nvmexpress:NVMf:uuid:32413b2b-89cc-4939-b816-399ff293800d.
  2. [ 326.516226] nvmet: adding queue 1 to ctrl 1061.
  3. [ 326.516428] nvmet: adding queue 2 to ctrl 1061.
  4. [ 326.516616] nvmet: adding queue 3 to ctrl 1061.
  5. [ 326.5361ing queue 4 to ctrl 1061.
  6. [ 326.556148] nvmet: adding queue 5 to ctrl 1061.
  7. [ 326.556499] nvmet: adding queue 6 to ctrl 1061.
  8. [ 326.556779] nvmet: adding queue 7 to ctrl 1061.
  9. [ 326.557093] nvmet: adding queue 8 to ctrl 1061.
  10. [ 326.576166] nvmet: adding queue 9 to ctrl 1061.
  11. [ 326.576420] nvmet: adding queue 10 to ctrl 1061.
  12. [ 326.576674] nvmet: adding queue 11 to ctrl 1061.
  13. [ 326.576922] nvmet: adding queue 12 to ctrl 1061.
  14. [ 326.577274] nvmet: adding queue 13 to ctrl 1061.
  15. [ 326.577595] nvmet: adding queue 14 to ctrl 1061.
  16. [ 326.596656] nvmet: adding queue 15 to ctrl 1061.
  17. [ 326.596936] nvmet: adding queue 16 to ctrl 1061.
  18. [ 326.662587] nvmet: creating controller 1062 for NQN nqn.2014-08.org.nvmexpress:NVMf:uuid:32413b2b-89cc-4939-b816-399ff293800d.
  19. [ 326.686765] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  20. [ 326.686766] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  21. [ 326.686768] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  22. [ 326.686768] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  23. [ 326.686775] Workqueue: ib_cm cm_work_handler [ib_cm]
  24. [ 326.686776] Call Trace:
  25. [ 326.686781] dump_stack+0x63/0x87
  26. [ 326.686783]herent+0x14a/0x160
  27. [ 326.686786] x86_swiotlb_alloc_coherent+0x43/0x50
  28. [ 326.686795] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  29. [ 326.686798] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  30. [ 326.686802] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  31. [ 326.686805] ? mlx4_ib_create_qp+0xf7/0x450 [mlx4_ib]
  32. [ 326.686807] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  33. [ 326.686816] ib_create_qp+0x70/0x2b0 [ib_core]
  34. [ 326.686819] rdma_create_qp+0x34/0xa0 [rdma_cm]
  35. [ 326.686823] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  36. [ 326.686824] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  37. [ 326.686826] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  38. [ 326.686827] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  39. [ 326.686829] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  40. [ 326.686830] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  41. [ 326.686832] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  42. [ 326.686834] cm_process_work+0x25/0x120 [ib_cm]
  43. [ 326.686835] cm_req_handler+0x994/0xcd0 [ib_cm]
  44. [ 326.686837] cm_work_handler+0x1ce/0x1753 [ib_cm]
  45. [ 326.686839] process_one_work+0x165/0x410
  46. [ 326.686840] worker_thread+0x137/0x4c0
  47. [ 326.686841] kthread+0x101/0x140
  48. [ 326.686842] ? rescuer_thread+0x3b0/0x3b0
  49. [ 326.686843] ? kthread_park+0x90/0x90
  50. [ 326.686845] ret_from_fork+0x2c/0x40
  51. [ 326.691158] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  52. [ 326.691158] swiotlb: coherent allocevice 0000:07:00.0 size=532480
  53. [ 326.691160] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  54. [ 326.691160] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  55. [ 326.691163] Workqueue: ib_cm cm_work_handler [ib_cm]
  56. [ 326.691163] Call Trace:
  57. [ 326.691165] dump_stack+0x63/0x87
  58. [ 326.691167] swiotlb_alloc_coherent+0x14a/0x160
  59. [ 326.691168] x86_swiotlb_alloc_coherent+0x43/0x50
  60. [ 326.691173] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  61. [ 326.691176] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  62. [ 326.691179] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  63. [ 326.691181] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  64. [ 326.691186] ib_create_qp+0x70/0x2b0 [ib_core]
  65. [ 326.691188] rdma_create_qp+0x34/0xa0 [rdma_cm]
  66. [ 326.691190] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  67. [ 326.691191] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  68. [ 326.691193] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  69. [ 326.691194] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  70. [ 326.691196] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  71. [ 326.691197] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  72. [ 326.691199] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  73. [ 326.691201] cm_process_work+0x25/0x120 [ib_cm]
  74. [ 326.691202] cm_req_handler+0x994/0xcd0 [ib_cm]
  75. [ 326.691204] cm_work_handler+0x1ce/0x1753 [ib_cm]
  76. [ 326.691205] process_one_work+0x165/0x410
  77. [ 326.691206] worker_thread+0x137/0x4c0
  78. [ 326.691207] kthread+0x101/0x140
  79. [ 326.691209] ? rescuer_thread+0x3b0/0x3b0
  80. [ 326.691209] ? kthread_park+0x90/0x90
  81. [ 326.691211] ret_from_fork+0x2c/0x40
  82. [ 326.695215] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  83. [ 326.695216] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  84. [ 326.695217] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  85. [ 326.695217] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  86. [ 326.695219] Workqueue: ib_cm cm_work_handler [ib_cm]
  87. [ 326.695220] Call Trace:
  88. [ 326.695222] dump_stack+0x63/0x87
  89. [ .695223] swiotlb_alloc_coherent+0x14a/0x160
  90. [ 326.695224] x86_swiotlb_alloc_coherent+0x43/0x50
  91. [ 326.695228] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  92. [ 326.695232] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  93. [ 326.695234] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  94. [ 326.695237] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  95. [ 326.695241] ib_create_qp+0x70/0x2b0 [ib_core]
  96. [ 326.695243] rdma_create_qp+0x34/0xa0 [rdma_cm]
  97. [ 326.695245] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  98. [ 326.695246] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  99. [ 326.695247] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  100. [ 326.695249] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  101. [ 326.695251] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  102. [ 326.695252] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  103. [ 326.695254] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  104. [ 326.695256] cm_process_work+0x25/0x120 [ib_cm]
  105. [ 326.695257] cm_req_handler+0x994/0xcd0 [ib_cm]
  106. [ 326.695259] cm_work_handler+0x1ce/0x1753 [ib_cm]
  107. [ 326.695260] process_one_work+0x165/0x410
  108. [ 326.695261] worker_thread+0x137/0x4c0
  109. [ 326.695262] kthread+0x101/0x140
  110. [ 326.695263] ? rescuer_thread+0x3b0/0x3b0
  111. [ 326.695264] ? kthread_park+0x90/0x90
  112. [ 3t_from_fork+0x2c/0x40
  113. [ 326.699081] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  114. [ 326.699082] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  115. [ 326.699083] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  116. [ 326.699083] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  117. [ 326.699086] Workqueue: ib_cm cm_work_handler [ib_cm]
  118. [ 326.699086] Call Trace:
  119. [ 326.699088] dump_stack+0x63/0x87
  120. [ 326.699089] swiotlb_alloc_coherent+0x14a/0x160
  121. [ 326.699090] x86_swiotlb_alloc_coherent+0x43/0x50
  122. [ 326.699094] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  123. [ 326.699098] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  124. [ 326.699100] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  125. [ 326.699103] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  126. [ 326.699107] ib_create_qp+0x70/0x2b0 [ib_core]
  127. [ 326.699109] rdma_create_qp+0x34/0xa0 [rdma_cm]
  128. [ 326.699111] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  129. [ 326.699112] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  130. [ 326.699113] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  131. [ 326.699115] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  132. [ 326.699116] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  133. [ 326.699118] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  134. [ 326.699120] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  135. [ 326.699121] cm_process_work+0x25/0x120 [ib_cm]
  136. [ 326.699123] cm_req_handler+0x994/0xcd0 [ib_cm]
  137. [ 326.699124] cm_work_handler+0x1c
  138. [ 326.699126] process_one_work+0x165/0x410
  139. [ 326.699127] worker_thread+0x137/0x4c0
  140. [ 326.699128] kthread+0x101/0x140
  141. [ 326.699129] ? rescuer_thread+0x3b0/0x3b0
  142. [ 326.699129] ? kthread_park+0x90/0x90
  143. [ 326.699131] ret_from_fork+0x2c/0x40
  144. [ 326.702488] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  145. [ 326.702489] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  146. [ 326.702490] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  147. [ 326.702490] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  148. [ 326.702492] Workqueue: ib_cm cm_work_handler [ib_cm]
  149. [ 326.702493] Call Trace:
  150. [ 326.702495] dump_stack+0x63/0x87
  151. [ 326.702496] swiotlb_alloc_coherent+0x14a/0x160
  152. [ 326.702497] x86_swiotlb_alloc_coherent+0x43/0x50
  153. [ 326.702501] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  154. [ 326.702504] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  155. [ 326.702507] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  156. [ 326.702509] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  157. [ 326.702513] ib_create_qp+0x70/0x2b0 [ib_core]
  158. [ 326.702515] rdma_create_qp+0x34/0xa0 [rdma_cm]
  159. [ 326.702517] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  160. [ 326.702518] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  161. [ 326.702519] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  162. [ 326.702521] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  163. [ 326.702522] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  164. [ 326.702524] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  165. [ 326.702525] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  166. [ 326.702527] cm_process_work+0x25/0x120 [ib_cm]
  167. [ 326.702529] cm_req_handler+0x994/0xcd0 [ib_cm]
  168. [ 326.702530] cm_work_handler+0x1ce/0x1753 [ib_cm]
  169. [ 326.702532] process_one_work+0x165/0x410
  170. [ 326.702533] worker_thread+0x137/0x4c0
  171. [ 326.702534] kthread+0x101/0x140
  172. [ 326.702535] ? rescu3b0
  173. [ 326.702535] ? kthread_park+0x90/0x90
  174. [ 326.702537] ret_from_fork+0x2c/0x40
  175. [ 326.706305] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  176. [ 326.706306] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  177. [ 326.706307] CPU: 7 PID: 4911 Comm: kworker/7:92 Not tainted 4.10.0 #2
  178. [ 326.706308] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  179. [ 326.706311] Workqueue: ib_cm cm_work_handler [ib_cm]
  180. [ 326.706312] Call Trace:
  181. [ 326.706315] dump_stack+0x63/0x87
  182. [ 326.706316] swiotlb_alloc_coherent+0x14a/0x160
  183. [ 326.706318] x86_swiotlb_alloc_coherent+0x43/0x50
  184. [ 326.706323] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  185. [ 326.706326] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  186. [ 326.706330] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  187. [ 326.706332] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  188. [ 326.706338] ib_create_qp+0x70/0x2b0 [ib_core]
  189. [ 326.706340] rdma_create_qp+0x34/0xa0 [rdma_cm]
  190. [ 326.706342] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  191. [ 326.706343] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  192. [ 326.706345] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  193. [ 326.706346] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  194. [ 326.706348] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  195. [ 326.706350] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  196. [ 326.706351] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  197. [ 326.706353] cm_process_0 [ib_cm]
  198. [ 326.706355] cm_req_handler+0x994/0xcd0 [ib_cm]
  199. [ 326.706356] cm_work_handler+0x1ce/0x1753 [ib_cm]
  200. [ 326.706358] process_one_work+0x165/0x410
  201. [ 326.706359] worker_thread+0x137/0x4c0
  202. [ 326.706360] kthread+0x101/0x140
  203. [ 326.706361] ? rescuer_thread+0x3b0/0x3b0
  204. [ 326.706362] ? kthread_park+0x90/0x90
  205. [ 326.706364] ret_from_fork+0x2c/0x40
  206. [ 326.710054] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  207. [ 326.710055] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  208. [ 326.710056] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  209. [ 326.710056] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  210. [ 326.710058] Workqueue: ib_cm cm_work_handler [ib_cm]
  211. [ 326.710059] Call Trace:
  212. [ 326.710061] dump_stack+0x63/0x87
  213. [ 326.710062] swiotlb_alloc_coherent+0x14a/0x160
  214. [ 326.710063] x86_swiotlb_alloc_coherent+0x43/0x50
  215. [ 326.710067] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  216. [ 326.710071] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  217. [ 326.710073] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  218. [ 326.710076] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  219. [ 326.710080] ib_create_qp+0x70/0x2b0 [ib_core]
  220. [ 326.710082] rdma_create_qp+0x34/0xa0 [rdma_cm]
  221. [ 326.710084] nvmet_rdma_alloc_queue+0x692/0x900 [nvme10085] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  222. [ 326.710087] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  223. [ 326.710088] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  224. [ 326.710090] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  225. [ 326.710091] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  226. [ 326.710093] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  227. [ 326.710094] cm_process_work+0x25/0x120 [ib_cm]
  228. [ 326.710096] cm_req_handler+0x994/0xcd0 [ib_cm]
  229. [ 326.710097] cm_work_handler+0x1ce/0x1753 [ib_cm]
  230. [ 326.710099] process_one_work+0x165/0x410
  231. [ 326.710100] worker_thread+0x137/0x4c0
  232. [ 326.710101] kthread+0x101/0x140
  233. [ 326.710102] ? rescuer_thread+0x3b0/0x3b0
  234. [ 326.710103] ? kthread_park+0x90/0x90
  235. [ 326.710104] ret_from_fork+0x2c/0x40
  236. [ 326.713810] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  237. [ 326.713811] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  238. [ 326.713812] CPU: 7 PID: 4911 Comm: kworker/7:92 Not tainted 4.10.0 #2
  239. [ 326.713813] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  240. [ 326.713816] Workqueue: ib_cm cm_work_handler [ib_cm]
  241. [ 326.713816] Call Trace:
  242. [ 326.713819] dump_stack+0x63/0x87
  243. [ 326.713821] swiotlb_alloc_coherent+0x14a/0x160
  244. [ 326.713823] x86_swiotlb_alloc_coherent+0x43/0x50
  245. [ 326.713828] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  246. [ 326.713832] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  247. [ 326.713835] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  248. [ 326.713838] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  249. [ 326.7qp+0x70/0x2b0 [ib_core]
  250. [ 326.713845] rdma_create_qp+0x34/0xa0 [rdma_cm]
  251. [ 326.713847] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  252. [ 326.713849] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  253. [ 326.713850] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  254. [ 326.713852] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  255. [ 326.713853] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  256. [ 326.713855] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  257. [ 326.713857] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  258. [ 326.713858] cm_process_work+0x25/0x120 [ib_cm]
  259. [ 326.713860] cm_req_handler+0x994/0xcd0 [ib_cm]
  260. [ 326.713862] cm_work_handler+0x1ce/0x1753 [ib_cm]
  261. [ 326.713863] process_one_work+0x165/0x410
  262. [ 326.713864] worker_thread+0x137/0x4c0
  263. [ 326.713865] kthread+0x101/0x140
  264. [ 326.713867] ? rescuer_thread+0x3b0/0x3b0
  265. [ 326.713867] ? kthread_park+0x90/0x90
  266. [ 326.713869] ret_from_fork+0x2c/0x40
  267. [ 326.717518] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  268. [ 326.717519] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  269. [ 326.717520] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  270. [ 326.717520] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  271. [ 326.717523] Workqueue: ib_cm cm_work_handler [ib_cm]
  272. [ 326.717523] Call Trace:
  273. [ 326.717525] dump_stack+0x63/0x87
  274. [ 326.717526] swiotlb_alloc_coherent+0x14a/0x160
  275. [ 326.717527] x86_swiotlb_alloc_coherent+0x43/0x50
  276. [ 326.717532] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  277. [ 326.717535] mlx4_buf_alloc+0x1e]
  278. [ 326.717538] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  279. [ 326.717540] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  280. [ 326.717544] ib_create_qp+0x70/0x2b0 [ib_core]
  281. [ 326.717546] rdma_create_qp+0x34/0xa0 [rdma_cm]
  282. [ 326.717548] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  283. [ 326.717549] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  284. [ 326.717551] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  285. [ 326.717552] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  286. [ 326.717554] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  287. [ 326.717555] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  288. [ 326.717557] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  289. [ 326.717558] cm_process_work+0x25/0x120 [ib_cm]
  290. [ 326.717560] cm_req_handler+0x994/0xcd0 [ib_cm]
  291. [ 326.717561] cm_work_handler+0x1ce/0x1753 [ib_cm]
  292. [ 326.717563] process_one_work+0x165/0x410
  293. [ 326.717564] worker_thread+0x137/0x4c0
  294. [ 326.717565] kthread+0x101/0x140
  295. [ 326.717566] ? rescuer_thread+0x3b0/0x3b0
  296. [ 326.717567] ? kthread_park+0x90/0x90
  297. [ 326.717568] ret_from_fork+0x2c/0x40
  298. [ 326.721428] nvmet: adding queue 1 to ctrl 1062.
  299. [ 326.721596] nvmet: adding queue 2 to ctrl 1062.
  300. [ 326.739810] nvmet: adding queue 3 to ctrl 1062.
  301. [ 326.740051] nvmet: adding queue 4 to ctrl 1062.
  302. [ 326.740253] nvmet: adding queue 5 to ctrl 1062.
  303. [ 326.758162] nvmet: adding queue 6 to ctrl 1062.
  304. [ 326.776645] nvmet: adding queue 7 to ctrl 1062.
  305. [ 326.776944] nvmet: adding queue 8 to ctrl 1062.
  306. [ 326.777142] nvmet: adding queue 9 to ctrl 1062.
  307. [ 326.777450] nvmet: adding queue 10 to ctrl 1062.
  308. [ 326.777786] nvmet: adding queue 11 to ctrl 1062.
  309. [ 326.778168] nvmet: adding queue 12 to ctrl 1062.
  310. [ 326.778457] nvmet: adding queue 13 to ctrl 1062.
  311. [ 326.82861ng queue 14 to ctrl 1062.
  312. [ 326.828989] nvmet: adding queue 15 to ctrl 1062.
  313. [ 326.829281] nvmet: adding queue 16 to ctrl 1062.
  314. [ 326.903379] nvmet: creating controller 1063 for NQN nqn.2014-08.org.nvmexpress:NVMf:uuid:32413b2b-89cc-4939-b816-399ff293800d.
  315. [ 326.905900] mlx4_core 0000:07:00.0: swiotlb buffer is full (sz: 532480 bytes)
  316. [ 326.905901] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  317. [ 326.905903] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  318. [ 326.905903] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  319. [ 326.905906] Workqueuib_cm cm_work_handler [ib_cm]
  320. [ 326.905907] Call Trace:
  321. [ 326.905909] dump_stack+0x63/0x87
  322. [ 326.905911] swiotlb_alloc_coherent+0x14a/0x160
  323. [ 326.905912] x86_swiotlb_alloc_coherent+0x43/0x50
  324. [ 326.905916] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  325. [ 326.905920] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  326. [ 326.905923] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  327. [ 326.905926] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  328. [ 326.905931] ib_create_qp+0x70/0x2b0 [ib_core]
  329. [ 326.905933] rdma_create_qp+0x34/0xa0 [rdma_cm]
  330. [ 326.905934] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  331. [ 326.905936] ? nvme_command+0x100/0x100 [nvmet_rdma]
  332. [ 326.905937] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  333. [ 326.905939] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  334. [ 326.905940] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  335. [ 326.905942] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  336. [ 326.905943] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  337. [ 326.905945] cm_process_work+0x25/0x120 [ib_cm]
  338. [ 326.905947] cm_req_handler+0x994/0xcd0 [ib_cm]
  339. [ 326.905948] cm_work_handler+0x1ce/0x1753 [ib_cm]
  340. [ 326.905950] process_one_work+0x165/0x410
  341. [ 326.905951] worker_thread+0x137/0x4c0
  342. [ 326.905952] kthread+0x101/0x140
  343. [ 326.905953] ? rescuer_thread+0x3b0/0x3b0
  344. [ 326.905954] ? kthread_park+0x90/0x90
  345. [ 326.905955] ret_from_fork+0x2c/0x40
  346. [ 327.004514] swiotlb: coherent allocation failed for device 0000:07:00.0 size=532480
  347. [ 327.004516] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  348. [ 327.004516] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  349. [ 327.004519] Workqueue: ib_cm cm_work_handler [ib_cm]
  350. [ 327.004520] Call Trace:
  351. [ 327.004522] dump_stack+0x63/0x87
  352. [ 327.004524] swiotlb_alloc_coherent+0x14a/0x160
  353. [ 327.004525] x86_swiotlb_alloc_coherent+0x43/0x50
  354. [ 327.004529] mlx4_buf_direct_alloc.isra.4+0xb1/0x150 [mlx4_core]
  355. [ 327.004533] mlx4_buf_alloc+0x172/0x1c0 [mlx4_core]
  356. [ 327.004536] create_qp_common.isra.33+0x633/0x1010 [mlx4_ib]
  357. [ 327.004538]_qp+0xf7/0x450 [mlx4_ib]
  358. [ 327.004540] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  359. [ 327.004545] ib_create_qp+0x70/0x2b0 [ib_core]
  360. [ 327.004547] rdma_create_qp+0x34/0xa0 [rdma_cm]
  361. [ 327.004548] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  362. [ 327.004550] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  363. [ 327.004551] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  364. [ 327.004553] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  365. [ 327.004554] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  366. [ 327.004556] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  367. [ 327.004557] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  368. [ 327.004559] cm_process_work+0x25/0x120 [ib_cm]
  369. [ 327.004561] cm_req_handler+0x994/0xcd0 [ib_cm]
  370. [ 327.004562] cm_work_handler+0x1ce/0x1753 [ib_cm]
  371. [ 327.004564] process_one_work+0x165/0x410
  372. [ 327.004565] worker_thread+0x137/0x4c0
  373. [ 327.004566] kthread+0x101/0x140
  374. [ 327.004567] ? rescuer_thread+0x3b0/0x3b0
  375. [ 327.004568] ? kthread_park+0x90/0x90
  376. [ 327.004569] ret_from_fork+0x2c/0x40
  377. [ 327.324516] kworker/6:256 invoked oom-killer: gfp_mask=0x14002c0(GFP_KERNEL|__GFP_NOWARN), nodemask=0-1, order=0, oom_score_adj=0
  378. [ 327.324516] kworker/6:256 cpuset=/ mems_allowed=0-1
  379. [ 327.324519] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  380. [ 327.324519] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  381. [ 327.324522] Workqueue: ib_cm cm_work_handler [ib_cm]
  382. [ 327.324523] Call Trace:
  383. [ 327.324525] dump_stack+0x63/0x87
  384. [ 327.324527] dump_header+0x82/0x212
  385. [ 327.324529] ? selinux_capable+0x20/02] ? security_capable_noaudit+0x45/0x60
  386. [ 327.324535] oom_kill_process+0x21c/0x3f0
  387. [ 327.324536] out_of_memory+0x117/0x4a0
  388. [ 327.324537] __alloc_pages_slowpath+0x913/0xaf0
  389. [ 327.324539] __alloc_pages_nodemask+0x223/0x2a0
  390. [ 327.324541] dma_generic_alloc_coherent+0x8e/0x130
  391. [ 327.324542] x86_swiotlb_alloc_coherent+0x25/0x50
  392. [ 327.324547] mlx4_buf_alloc+0xde/0x1c0 [mlx4_core]
  393. [ 327.324550] create_qp_common.isra.33+0xa5f/0x1010 [mlx4_ib]
  394. [ 327.324552] ? mlx4_ib_create_qp+0xf7/0x450 [mlx4_ib]
  395. [ 327.324555] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  396. [ 327.324559] ib_create_qp+0x70/0x2b0 [ib_core]
  397. [ 327.324561] rdma_create_qp+0x34/0xa0 [rdma_cm]
  398. [ 327.324563] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  399. [ 327.324564] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  400. [ 327.324566] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  401. [ 327.324568] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  402. [ 327.324569] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  403. [ 327.324571] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  404. [ 327.324572] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  405. [ 327.324574] cm_process_work+0x25/0x120 [ib_cm]
  406. [ 327.324575] cm_req_handler+0x994/0xcd0 [ib_cm]
  407. [ 327.324577] cm_work_handler+0x1ce/0x1753 [ib_cm]
  408. [ 327.324578] process_one_work+0x165/0x410
  409. [ 327.324580] worker_thread+0x137/0x4c0
  410. [ 327.324580] kthread+0x101/0x140
  411. [ 327.324582] ? rescuer_thread+0x3b0/0x3b0
  412. [ 327.324582] ? kthread_park+0x90/0x90
  413. [ 327.324584] ret_from_fork+0x2c/0x40
  414. [ 327.324584] Mem-Info:
  415. [ 327.324589] active_anon:0 inactive_anon:30 isolate27.324589] active_file:33 inactive_file:0 isolated_file:0
  416. [ 327.324589] unevictable:0 dirty:0 writeback:0 unstable:0
  417. [ 327.324589] slab_reclaimable:9956 slab_unreclaimable:137081
  418. [ 327.324589] mapped:52 shmem:0 pagetables:1417 bounce:0
  419. [ 327.324589] free:39396 free_pcp:90 free_cma:0
  420. [ 327.324594] Node 0 active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:128kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
  421. [ 327.324598] Node 1 active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:80kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:6324 all_unreclaimable? yes
  422. [ 327.324599] Node 0 DMA free:15880kB min:40kB low:52kB high:64kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pc
  423. [ 327.324601] lowmem_reserve[]: 0 2884 15935 15935 15935
  424. [ 327.324603] Node 0 DMA32 free:60220kB min:8104kB low:11056kB high:14008kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:3094192kB managed:3013324kB mlocked:0kB slab_reclaimable:32kB slab_unreclaimable:38808kB kernel_stack:2576kB pagetables:0kB bounce:0kB free_pcp:120kB local_pcp:120kB free_cma:0kB
  425. [ 327.324606] lowmem_reserve[]: 0 0 13051 13051 13051
  426. [ 327.324607] Node 0 Normal free:36396kB min:36664kB low:50028kB high:63392kB active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB writepending:0kB present:13631488kB managed:13364548kB mlocked:0kB slab_reclaimable:20088kB slab_unreclaimable:245952kB kernel_stack:16792kB pagetables:3348kB bounce:0kB free_pcp:120kB local_pcp:120kB free_cma:0kB
  427. [ 327.324610] lowmem_reserve[]: 0 0 0 0 0
  428. [ 327.324611] Node 1 Normal free:45088kB min:45296kB low:61804kB high:78312kB active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB writepending:0kB present:16777212kB managed:16509840kB mlocked:0kB slab_reclaimable:19704kB slab_unreclaimable:263548kB kernel_stack:13976kB pagetables:2320kB bounce:0kB free_p:120kB free_cma:0kB
  429. [ 327.324614] lowmem_reserve[]: 0 0 0 0 0
  430. [ 327.324615] Node 0 DMA: 0*4kB 1*8kB (U) 0*16kB 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15880kB
  431. [ 327.324620] Node 0 DMA32: 3*4kB (M) 4*8kB (M) 9*16kB (UM) 12*32kB (UME) 10*64kB (UME) 5*128kB (UME) 4*256kB (UME) 6*512kB (ME) 5*1024kB (UME) 2*2048kB (UE) 11*4096kB (M) = 60220kB
  432. [ 327.324626] Node 0 Normal: 232*4kB (UME) 267*8kB (ME) 166*16kB (MEH) 97*32kB (UME) 63*64kB (UME) 53*128kB (UMH) 22*256kB (UM) 14*512kB (M) 4*1024kB (M) 0*2048kB 0*4096kB = 36536kB
  433. [ 327.324631] Node 1 Normal: 28*4kB (UME) 29*8kB (ME) 30*16kB (UME) 32*32kB (ME) 156*64kB (UM) 113*128kB (UME) 18*256kB (UME) 28*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 45240kB
  434. [ 327.324637] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  435. [ 327.324638] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  436. [ 327.324639] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  437. [ 327.324639] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  438. [ 327.324639] 79 total pagecache pages
  439. [ 327.324640] 67 pages in swap cache
  440. [ 327.324641] Swap cache stats: add 29397, delete 29330, find 343/580
  441. [ 327.324641] Free swap = 16401068kB
  442. [ 327.324642] Total swap = 16516092kB
  443. [ 327.324642] 8379718 pages RAM
  444. [ 327.324643] 0 pages HighMem/MovableOnly
  445. [ 327.324643] 153816 pages reserved
  446. [ 327.324643] 0 pages cma reserved
  447. [ 327.324643] 0 pages hwpoisoned
  448. [ 327.324644] [ pid ]_vm rss nr_ptes nr_pmds swapents oom_score_adj name
  449. [ 327.324662] [ 782] 0 782 9206 1 22 3 82 0 systemd-journal
  450. [ 327.324664] [ 802] 0 802 30349 0 27 3 374 0 lvmetad
  451. [ 327.324666] [ 824] 0 824 11841 1 25 3 698 -1000 systemd-udevd
  452. [ 327.324669] [ 1067] 0 1067 13856 0 28 3 111 -1000 auditd
  453. [ 327.324671] [ 1115] 0 1115 4889 0 15 3 144 0 irqbalance
  454. [ 327.324672] [ 1117] 0 1117 31969 1 20 4 132 0 smartd
  455. [ 327.324673] [ 1118] 998 1118 132401 1 57 4 1363 0 polkitd
  456. [ 327.324674] [ 1125] 997 1125 5672 6 17 3 62 0 chronyd
  457. [ 327.324676] [ 1128] 0 1128 6050 1 18 3 75 0 systemd-logind
  458. [ 327.324677] [ 1129] 994 1129 2133 1 9 3 37 0 lsmd
  459. [ 327.324678] [ 1130] 81 1130 8714 1 18 3 123 -daemon
  460. [ 327.324680] [ 1163] 0 1163 53176 0 56 3 441 0 abrtd
  461. [ 327.324681] [ 1165] 0 1165 52551 1 56 3 337 0 abrt-watch-log
  462. [ 327.324683] [ 1185] 0 1185 28814 0 11 3 63 0 ksmtuned
  463. [ 327.324684] [ 1251] 0 1251 50305 0 41 3 125 0 gssproxy
  464. [ 327.324685] [ 1290] 0 1290 28813 0 11 3 52 0 opensm-launch
  465. [ 327.324686] [ 1291] 0 1291 637907 0 86 6 396 0 opensm
  466. [ 327.324688] [ 1896] 0 1896 28209 0 53 3 3122 0 dhclient
  467. [ 327.324689] [ 1969] 0 1969 138293 0 91 3 2707 0 tuned
  468. [ 327.324690] [ 1974] 0 1974 55479 0 41 3 309 0 rsyslogd
  469. [ 327.324691] [ 1984] 0 1984 28337 1 12 3 38 0 rhsmcertd
  470. [ 327.324693] [ 1988] 0 1988 154722 1 149 3 2116 0 libvirtd
  471. [ 327.324694] [ 1991] 0 1991 6463 0 17 0 atd
  472. [ 327.324695] [ 2002] 0 2002 20619 1 41 3 215 -1000 sshd
  473. [ 327.324696] [ 2412] 0 2412 27511 1 11 3 31 0 agetty
  474. [ 327.324697] [ 2416] 0 2416 27511 1 10 3 30 0 agetty
  475. [ 327.324699] [ 3034] 0 3034 22767 1 42 3 258 0 master
  476. [ 327.324700] [ 3086] 89 3086 22793 1 45 3 253 0 pickup
  477. [ 327.324701] [ 3087] 89 3087 22810 1 45 3 254 0 qmgr
  478. [ 327.324703] [ 3338] 99 3338 3888 0 11 3 52 0 dnsmasq
  479. [ 327.324704] [ 3339] 0 3339 3881 0 11 3 45 0 dnsmasq
  480. [ 327.324705] [ 3373] 0 3373 64648 1 80 4 3407 0 beah-srv
  481. [ 327.324707] [ 3374] 0 3374 31558 1 20 3 161 0 crond
  482. [ 327.324708] [ 3375] 0 3375 60778 1 75 4 3092 0 beah-fwd-backen
  483. [ 327.324709] [ 3376] 0 3376 90264 4 4722 0 beah-beaker-bac
  484. [ 327.324710] [ 3380] 0 3380 26973 1 8 3 24 0 rhnsd
  485. [ 327.324781] [ 4625] 0 4625 26976 0 11 3 18 0 sleep
  486. [ 327.324827] Out of memory: Kill process 3376 (beah-beaker-bac) score 0 or sacrifice child
  487. [ 327.324835] Killed process 3376 (beah-beaker-bac) total-vm:361056kB, anon-rss:0kB, file-rss:4kB, shmem-rss:0kB
  488. [ 327.343532] oom_reaper: reaped process 3376 (beah-beaker-bac), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
  489. [ 327.347901] beah-beaker-bac invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=0-1, order=0, oom_score_adj=0
  490. [ 327.347902] beah-beaker-bac cpuset=/ mems_allowed=0-1
  491. [ 327.347905] CPU: 14 PID: 3400 Comm: beah-beaker-bac Not tainted 4.10.0 #2
  492. [ 327.347906] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  493. [ 327.347907] Call Trace:
  494. [ 327.347913] dump_stack+0x63/0x87
  495. [ 327.347915] dump_header+0x82/0x212
  496. [ 327.347917] ? selinux_capable+0x20/0x30
  497. [ 327.347920] ? security_capable_noaudit+0x45/0x60
  498. [ 327.347923] oom_kill_process+0x21c/0x3f0
  499. [ 327.347924] out_of_memory+0x117/0x4a0
  500. [ 327.347925] __alloc_pages_slowpath+0x9137.347927] __alloc_pages_nodemask+0x223/0x2a0
  501. [ 327.347930] alloc_pages_vma+0xa5/0x220
  502. [ 327.347932] __read_swap_cache_async+0x129/0x1d0
  503. [ 327.347933] read_swap_cache_async+0x26/0x60
  504. [ 327.347934] swapin_readahead+0x16b/0x200
  505. [ 327.347936] ? find_get_entry+0x20/0x140
  506. [ 327.347937] ? pagecache_get_page+0x2c/0x250
  507. [ 327.347939] do_swap_page+0x2aa/0x780
  508. [ 327.347940] handle_mm_fault+0x7bb/0x1350
  509. [ 327.347944] __do_page_fault+0x22a/0x4a0
  510. [ 327.347945] do_page_fault+0x30/0x80
  511. [ 327.347948] page_fault+0x28/0x30
  512. [ 327.347951] RIP: 0010:__get_user_8+0x1b/0x25
  513. [ 327.347952] RSP: 0018:ffffc9000798fc28 EFLAGS: 00010287
  514. [ 327.347953] RAX: 00007f8eb01189e7 RBX: ffff88042920be00 RCX: 00000000000002b0
  515. [ 327.347953] RDX: ffff880824b8da00 RSI: ffff88042920be00 RDI: ffff880824b8da00
  516. [ 327.347954] RBP: ffffc9000798fc78 R08: ffff88081cadf400 R09: 0000000180200016
  517. [ 327.347954] R10: 000000001cad9001 R11: ffff88081cadf400 R12: ffff880824b8da00
  518. [ 327.347955] R13: 00007f8eb01189e0 R14: ffff880824b8da00 R15: ffff88082870d380
  519. [ 327.347958] ? exit_robust_list+0x37/0x120
  520. [ 327.347961] mm_release+0x123/0x140
  521. [ 327.347963] do_exit+0x149/0xb60
  522. [ 327.347964] ? futex_wait+0x11b/0x260
  523. [ 327.347965] do_group_exit+0x3f/0xb0
  524. [ 327.347967] get_signal+0x1cc/0x600
  525. [ 327.347972] do_signal+0x37/0x6a0
  526. [ 327.347973] ? do_futex+0xfd/0x570
  527. [ 327.347976] exit_to_usermode_loop+0x4c/0x92
  528. [syscall_64+0x165/0x180
  529. [ 327.347979] entry_SYSCALL64_slow_path+0x25/0x25
  530. [ 327.347980] RIP: 0033:0x7f8ec02ff79b
  531. [ 327.347981] RSP: 002b:00007f8eb0116e90 EFLAGS: 00000282 ORIG_RAX: 00000000000000ca
  532. [ 327.347982] RAX: fffffffffffffe00 RBX: 00000000000000ca RCX: 00007f8ec02ff79b
  533. [ 327.347982] RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f8ea80028a0
  534. [ 327.347983] RBP: 00007f8ea80028a0 R08: 0000000000000000 R09: 0000000000f9d620
  535. [ 327.347983] R10: 0000000000000000 R11: 0000000000000282 R12: fffffffeffffffff
  536. [ 327.347984] R13: 0000000000000000 R14: 000000000186e560 R15: 00000000017f26c8
  537. [ 327.347985] Mem-Info:
  538. [ 327.347990] active_anon:0 inactive_anon:30 isolated_anon:0
  539. [ 327.347990] active_file:33 inactive_file:0 isolated_file:0
  540. [ 327.347990] unevictable:0 dirty:0 writeback:0 unstable:0
  541. [ 327.347990] slab_reclaimable:9956 slab_unreclaimable:137081
  542. [ 327.347990] mapped:52 shmem:0 pagetables:1417 bounce:0
  543. [ 327.347990] free:39396 free_pcp:121 free_cma:0
  544. [ 327.347994] Node 0 active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:128kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
  545. [ 327.34e_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:80kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:16820 all_unreclaimable? yes
  546. [ 327.347999] Node 0 DMA free:15880kB min:40kB low:52kB high:64kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
  547. [ 327.348002] lowmem_reserve[]: 0 2884 15935 15935 15935
  548. [ 327.348004] Node 0 DMA32 free:60220kB min:8104kB low:11056kB high:14008kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:3094192kB managed:3013324kB mlocked:0kB slab_reclaimable:32kB slab_unreclaimable:38808kB kernel_stack:2576kB pagetables:0kB bounce:0kB free_pcp:120kB local_pcp:0kB free_cma:0kB
  549. [ 327.348006] lowmem_reserve[]: 0 0 13051 13051 13051
  550. [ 327.348008] Node 0 Normal free:36396kB min:36664kB low:50028kB high:63392kB active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB writepending:0kB present:13631488kB managed:13364548kB mlocked:0kB slab_reclaimable:20088kB slab_unreclaimable:245952kB kernel_stack:16792kB pagetables:3348kB bounce:0kB free_pcp:244kB local_pcp:0kB free_cma:0kB
  551. [ 327.348011] lowmem_reserve[]: 0 0 0 0 0
  552. [ 327.348012] Node 1 Normal free:45088kB min:45296kB low:61804kB high:78312kB active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB writepending:0kB present:16777212kB managed:16509840kB mlocked:0kB slab_reclaimable:19704kB slab_unreclaimable:263548kB kernel_stack:13976kB pagetables:2320kB bounce:0kB free_pcp:120kB local_pcp:0kB free_cma:0kB
  553. [ 327.348015] lowmem_reserve[]: 0 0 0 0 0
  554. [ 327.348016] Node 0 DMA: 0*4kB 1*8kB (U) 0*16kB 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U)512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15880kB
  555. [ 327.348021] Node 0 DMA32: 3*4kB (M) 4*8kB (M) 9*16kB (UM) 12*32kB (UME) 10*64kB (UME) 5*128kB (UME) 4*256kB (UME) 6*512kB (ME) 5*1024kB (UME) 2*2048kB (UE) 11*4096kB (M) = 60220kB
  556. [ 327.348027] Node 0 Normal: 201*4kB (UME) 267*8kB (ME) 166*16kB (MEH) 97*32kB (UME) 63*64kB (UME) 53*128kB (UMH) 22*256kB (UM) 14*512kB (M) 4*1024kB (M) 0*2048kB 0*4096kB = 36412kB
  557. [ 327.348033] Node 1 Normal: 28*4kB (UME) 29*8kB (ME) 30*16kB (UME) 32*32kB (ME) 156*64kB (UM) 113*128kB (UME) 18*256kB (UME) 28*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 45240kB
  558. [ 327.348039] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  559. [ 327.348039] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  560. [ 327.348040] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  561. [ 327.348040] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  562. [ 327.348041] 79 total pagecache pages
  563. [ 327.348042] 67 pages in swap cache
  564. [ 327.348042tats: add 29398, delete 29331, find 344/584
  565. [ 327.348043] Free swap = 16419956kB
  566. [ 327.348043] Total swap = 16516092kB
  567. [ 327.348044] 8379718 pages RAM
  568. [ 327.348044] 0 pages HighMem/MovableOnly
  569. [ 327.348044] 153816 pages reserved
  570. [ 327.348044] 0 pages cma reserved
  571. [ 327.348045] 0 pages hwpoisoned
  572. [ 327.348045] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
  573. [ 327.348060] [ 782] 0 782 9206 1 22 3 82 0 systemd-journal
  574. [ 327.348061] [ 802] 0 802 30349 0 27 3 374 0 lvmetad
  575. [ 327.348063] [ 824] 0 824 11841 1 25 3 698 -1000 systemd-udevd
  576. [ 327.348066] [ 1067] 0 1067 13856 0 28 3 111 -1000 auditd
  577. [ 327.348067] [ 1115] 0 1115 4889 0 15 3 144 0 irqbalance
  578. [ 327.348068] [ 1117] 0 1117 31969 1 20 4 132 0 smartd
  579. [ 327.348069] [ 1118] 998 1118 132401 1 57 4 1363 0 polkitd
  580. [ 327.348070] [ 1125] 997 1125 5672 6 17 3 62 0 chronyd
  581. [ 327.348071] [ 1128] 0 1128 6050 3 75 0 systemd-logind
  582. [ 327.348072] [ 1129] 994 1129 2133 1 9 3 37 0 lsmd
  583. [ 327.348074] [ 1130] 81 1130 8714 1 18 3 123 -900 dbus-daemon
  584. [ 327.348075] [ 1163] 0 1163 53176 0 56 3 441 0 abrtd
  585. [ 327.348077] [ 1165] 0 1165 52551 1 56 3 337 0 abrt-watch-log
  586. [ 327.348078] [ 1185] 0 1185 28814 0 11 3 63 0 ksmtuned
  587. [ 327.348079] [ 1251] 0 1251 50305 0 41 3 125 0 gssproxy
  588. [ 327.348080] [ 1290] 0 1290 28813 0 11 3 52 0 opensm-launch
  589. [ 327.348081] [ 1291] 0 1291 637907 0 86 6 396 0 opensm
  590. [ 327.348083] [ 1896] 0 1896 28209 0 53 3 3122 0 dhclient
  591. [ 327.348084] [ 1969] 0 1969 138293 0 91 3 2707 0 tuned
  592. [ 327.348085] [ 1974] 0 1974 55479 0 41 3 309 0 rsyslogd
  593. [ 327.348086] [ 1984] 0 1984 28337 1 12 3 38 0 rhsmcertd
  594. [ 327.348087] [ 1988] 0 1988 154722 1 149 3 2116 0 libvirtd
  595. [ 327.348088] [ 1991] 0 1991 17 3 52 0 atd
  596. [ 327.348089] [ 2002] 0 2002 20619 1 41 3 215 -1000 sshd
  597. [ 327.348091] [ 2412] 0 2412 27511 1 11 3 31 0 agetty
  598. [ 327.348092] [ 2416] 0 2416 27511 1 10 3 30 0 agetty
  599. [ 327.348093] [ 3034] 0 3034 22767 1 42 3 258 0 master
  600. [ 327.348094] [ 3086] 89 3086 22793 1 45 3 253 0 pickup
  601. [ 327.348095] [ 3087] 89 3087 22810 1 45 3 254 0 qmgr
  602. [ 327.348097] [ 3338] 99 3338 3888 0 11 3 52 0 dnsmasq
  603. [ 327.348098] [ 3339] 0 3339 3881 0 11 3 45 0 dnsmasq
  604. [ 327.348099] [ 3373] 0 3373 64648 1 80 4 3407 0 beah-srv
  605. [ 327.348100] [ 3374] 0 3374 31558 1 20 3 161 0 crond
  606. [ 327.348101] [ 3375] 0 3375 60778 1 75 4 3092 0 beah-fwd-backen
  607. [ 327.348103] [ 3400] 0 3376 90264 0 98 4 0 0 beah-beaker-bac
  608. [ 327.348104] 3380 26973 1 8 3 24 0 rhnsd
  609. [ 327.348162] [ 4625] 0 4625 26976 0 11 3 18 0 sleep
  610. [ 327.348191] Out of memory: Kill process 3373 (beah-srv) score 0 or sacrifice child
  611. [ 327.348197] Killed process 3373 (beah-srv) total-vm:258592kB, anon-rss:0kB, file-rss:4kB, shmem-rss:0kB
  612. [ 327.363552] kworker/6:256 invoked oom-killer: gfp_mask=0x14002c0(GFP_KERNEL|__GFP_NOWARN), nodemask=0-1, order=0, oom_score_adj=0
  613. [ 327.363552] kworker/6:256 cpuset=/ mems_allowed=0-1
  614. [ 327.363555] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  615. [ 327.363555] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  616. [ 327.363558] Workqueue: ib_cm cm_work_handler [ib_cm]
  617. [ 327.363559] Call Trace:
  618. [ 327.363562] dump_stack+0x63/0x87
  619. [ 327.363563] dump_header+0x82/0x212
  620. [ 327.363564] ? selinux_capable+0x20/0x30
  621. [ 327.363567] ? security_capable_noaudit+0x45/0x60
  622. [ 327.363568] oom_kill_process+0x21c/0x3f0
  623. [ 327.363569] out_of_memory+0x117/0x4a0
  624. [ 327.363570] __alloc_pages_slowpath+0x913/0xaf0
  625. [ 327.363572] __alloc_pages_nodemask+0x223/0x2a0
  626. [ 327.3635lloc_coherent+0x8e/0x130
  627. [ 327.363575] x86_swiotlb_alloc_coherent+0x25/0x50
  628. [ 327.363579] mlx4_buf_alloc+0xde/0x1c0 [mlx4_core]
  629. [ 327.363582] create_qp_common.isra.33+0xa5f/0x1010 [mlx4_ib]
  630. [ 327.363585] ? mlx4_ib_create_qp+0xf7/0x450 [mlx4_ib]
  631. [ 327.363587] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  632. [ 327.363592] ib_create_qp+0x70/0x2b0 [ib_core]
  633. [ 327.363594] rdma_create_qp+0x34/0xa0 [rdma_cm]
  634. [ 327.363596] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  635. [ 327.363597] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  636. [ 327.363598] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  637. [ 327.363600] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  638. [ 327.363602] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  639. [ 327.363603] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  640. [ 327.363605] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  641. [ 327.363607] cm_process_work+0x25/0x120 [ib_cm]
  642. [ 327.363608] cm_req_handler+0x994/0xcd0 [ib_cm]
  643. [ 327.363610] cm_work_handler+0x1ce/0x1753 [ib_cm]
  644. [ 327.363611] process_one_work+0x165/0x410
  645. [ 327.363612] worker_thread+0x137/0x4c0
  646. [ 327.363613] kthread+0x101/0x140
  647. [ 327.363614] ? rescuer_thread+0x3b0/0x3b0
  648. [ 327.363615] ? kthread_park+0x90/0x90
  649. [ 327.363616] ret_from_fork+0x2c617] Mem-Info:
  650. [ 327.363622] active_anon:0 inactive_anon:30 isolated_anon:0
  651. [ 327.363622] active_file:33 inactive_file:0 isolated_file:0
  652. [ 327.363622] unevictable:0 dirty:0 writeback:0 unstable:0
  653. [ 327.363622] slab_reclaimable:9956 slab_unreclaimable:137081
  654. [ 327.363622] mapped:52 shmem:0 pagetables:1417 bounce:0
  655. [ 327.363622] free:39396 free_pcp:274 free_cma:0
  656. [ 327.363626] Node 0 active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:128kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
  657. [ 327.363630] Node 1 active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:80kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:18868 all_unreclaimable? yes
  658. [ 327.363631] Node 0 DMA free:15880kB min:40kB low:52kB high:64kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
  659. [ 327.363633] lowmem_reserve[]: 0 2884 15935 15935 15935
  660. [ 327.363635] Node 0 DMA32 free:60220kB min:8104kB low:11056kB high:14008kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:3094192kB managed:3013324kB mlocked:0kB slab_reclaimable:32kB slab_unreclaimable:38808kB kernel_stack:2576kB pagetables:0kB bounce:0kB free_pcp:120kB local_pcp:120kB free_cma:0kB
  661. [ 327.363638] lowmem_reserve1 13051
  662. [ 327.363639] Node 0 Normal free:36396kB min:36664kB low:50028kB high:63392kB active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB writepending:0kB present:13631488kB managed:13364548kB mlocked:0kB slab_reclaimable:20088kB slab_unreclaimable:245952kB kernel_stack:16792kB pagetables:3348kB bounce:0kB free_pcp:424kB local_pcp:120kB free_cma:0kB
  663. [ 327.363642] lowmem_reserve[]: 0 0 0 0 0
  664. [ 327.363643] Node 1 Normal free:45088kB min:45296kB low:61804kB high:78312kB active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB writepending:0kB present:16777212kB managed:16509840kB mlocked:0kB slab_reclaimable:19704kB slab_unreclaimable:263548kB kernel_stack:13976kB pagetables:2320kB bounce:0kB free_pcp:552kB local_pcp:120kB free_cma:0kB
  665. [ 327.363646] lowmem_reserve[]: 0 0 0 0 0
  666. [ 327.363647] Node 0 DMA: 0*4kB 1*8kB (U) 0*16kB 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15880kB
  667. [ 327.363652] Node 0 DMA32: 3*4kB (M) 4*8kB (M) 9*16kB (UM) 12*32kB (UME) 10*64kB (UME) 5*128kB (UME) 4*256kB (UME) 6*512kB (ME) 5*1024kB (UME) 2*2048kB (UE) 11*4096kB (M) = 60220kB
  668. [ 327.363658] Node 0 Normal: 201*4kB (UME) 268*8kB (UME) 166*16kB (MEH) 97*32kB (UME) 63*64kB (UME) 53*128kB (UMH) 22*256kB (UM) 14*512kB (M) 4*1024kB (M) 0*2048kB 0*kB
  669. [ 327.363664] Node 1 Normal: 12*4kB (E) 22*8kB (UME) 30*16kB (UME) 32*32kB (ME) 154*64kB (UM) 113*128kB (UME) 18*256kB (UME) 28*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 44992kB
  670. [ 327.363670] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  671. [ 327.363670] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  672. [ 327.363671] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  673. [ 327.363671] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  674. [ 327.363672] 79 total pagecache pages
  675. [ 327.363672] 67 pages in swap cache
  676. [ 327.363673] Swap cache stats: add 29403, delete 29336, find 345/589
  677. [ 327.363673] Free swap = 16433568kB
  678. [ 327.363674] Total swap = 16516092kB
  679. [ 327.363675] 8379718 pages RAM
  680. [ 327.363675] 0 pages HighMem/MovableOnly
  681. [ 327.363675] 153816 pages reserved
  682. [ 327.363675] 0 pages cma reserved
  683. [ 327.363676] 0 pages hwpoisoned
  684. [ 327.363676] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
  685. [ 327.363689] [ 782] 0 782 9206 1 22 3 82 0 systemd-journal
  686. [ 327.363691] [ 802] 0 802 30349 0 27 3 374 0 lvmetad
  687. [ 327.363692] [ 824] 0 824 11841 1 25 3 698 -1000 systemd-udevd
  688. [ 327.363695] [ 1067] 0 1067 13856 0 28 3 111 td
  689. [ 327.363696] [ 1115] 0 1115 4889 0 15 3 144 0 irqbalance
  690. [ 327.363697] [ 1117] 0 1117 31969 1 20 4 132 0 smartd
  691. [ 327.363699] [ 1118] 998 1118 132401 1 57 4 1363 0 polkitd
  692. [ 327.363700] [ 1125] 997 1125 5672 6 17 3 62 0 chronyd
  693. [ 327.363701] [ 1128] 0 1128 6050 1 18 3 75 0 systemd-logind
  694. [ 327.363702] [ 1129] 994 1129 2133 1 9 3 37 0 lsmd
  695. [ 327.363703] [ 1130] 81 1130 8714 1 18 3 123 -900 dbus-daemon
  696. [ 327.363705] [ 1163] 0 1163 53176 0 56 3 441 0 abrtd
  697. [ 327.363706] [ 1165] 0 1165 52551 1 56 3 337 0 abrt-watch-log
  698. [ 327.363707] [ 1185] 0 1185 28814 0 11 3 63 0 ksmtuned
  699. [ 327.363708] [ 1251] 0 1251 50305 0 41 3 125 0 gssproxy
  700. [ 327.363709] [ 1290] 0 1290 28813 0 11 3 52 0 opensm-launch
  701. [ 327.360 1291 637907 0 86 6 396 0 opensm
  702. [ 327.363711] [ 1896] 0 1896 28209 0 53 3 3122 0 dhclient
  703. [ 327.363712] [ 1969] 0 1969 138293 0 91 3 2707 0 tuned
  704. [ 327.363714] [ 1974] 0 1974 55479 0 41 3 309 0 rsyslogd
  705. [ 327.363715] [ 1984] 0 1984 28337 1 12 3 38 0 rhsmcertd
  706. [ 327.363716] [ 1988] 0 1988 154722 1 149 3 2116 0 libvirtd
  707. [ 327.363717] [ 1991] 0 1991 6463 0 17 3 52 0 atd
  708. [ 327.363718] [ 2002] 0 2002 20619 1 41 3 215 -1000 sshd
  709. [ 327.363719] [ 2412] 0 2412 27511 1 11 3 31 0 agetty
  710. [ 327.363720] [ 2416] 0 2416 27511 1 10 3 30 0 agetty
  711. [ 327.363721] [ 3034] 0 3034 22767 1 42 3 258 0 master
  712. [ 327.363722] [ 3086] 89 3086 22793 1 45 3 253 0 pickup
  713. [ 327.363723] [ 3087] 89 3087 22810 1 45 3 254 0 qmgr
  714. [ 327.363725] [ 3338] 99 3338 3888 0 11 3 52 0 dnsmasq
  715. [ 327.363726] [ 3339] 0 3339 3881 0 11 3 45 0 dnsmasq
  716. [ 327.363727] [ 3374] 0 3374 31558 20 3 161 0 crond
  717. [ 327.363728] [ 3375] 0 3375 60778 1 75 4 3092 0 beah-fwd-backen
  718. [ 327.363730] [ 3400] 0 3376 90264 0 98 4 0 beah-beaker-bac
  719. [ 327.363731] [ 3380] 0 3380 26973 1 8 3 24 0 rhnsd
  720. [ 327.363797] [ 4625] 0 4625 26976 0 11 3 18 0 sleep
  721. [ 327.363840] Out of memory: Kill process 1896 (dhclient) score 0 or sacrifice child
  722. [ 327.363846] Killed process 1896 (dhclient) total-vm:112836kB, anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
  723. [ 327.383569] beah-beaker-bac invoked oom-killer: gfp_mask=0x14200ca(GFP_HIGHUSER_MOVABLE), nodemask=0-1, order=0, oom_score_adj=0
  724. [ 327.383570] beah-beaker-bac cpuset=/ mems_allowed=0-1
  725. [ 327.383573] CPU: 14 PID: 3400 Comm: beah-beaker-bac Not tainted 4.10.0 #2
  726. [ 327.383573] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  727. [ 327.383574] Call Trace:
  728. [ 327.383577] dump_stack+0x63/0x87
  729. [ 327.383578] dump_header+0x82/0x212
  730. [ 327.383579] ? selinux_capable+0x20/0x30
  731. [ 327.383581] ? security_capable_noaudit+0x45/0x60
  732. [ 327.383582] oom_kill_process+0x21c/0x3f0
  733. [ 327.383584] out_of_memory+0x117/0x4a0
  734. [ 327.383585] __alloc_pages_slowpath+0x913/0xaf0
  735. [ 327.383587] __alloc_pages_nodemask+0x223/0x2a0
  736. [ 327.383588] alloc_pages_vma+0xa5/0x220
  737. 0] read_swap_cache_async+0x26/0x60sync+0x129/0x1d0
  738. [ 327.383592] swapin_readahead+0x16b/0x200
  739. [ 327.383592] ? find_get_entry+0x20/0x140
  740. [ 327.383593] ? pagecache_get_page+0x2c/0x250
  741. [ 327.383594] do_swap_page+0x2aa/0x780
  742. [ 327.383596] handle_mm_fault+0x7bb/0x1350
  743. [ 327.383597] __do_page_fault+0x22a/0x4a0
  744. [ 327.383598] do_page_fault+0x30/0x80
  745. [ 327.383600] page_fault+0x28/0x30
  746. [ 327.383601] RIP: 0010:__get_user_8+0x1b/0x25
  747. [ 327.383602] RSP: 0018:ffffc9000798fc28 EFLAGS: 00010287
  748. [ 327.383603] RAX: 00007f8eb01189e7 RBX: ffff88042920be00 RCX: 00000000000002b0
  749. [ 327.383603] RDX: ffff880824b8da00 RSI: ffff88042920be00 RDI: ffff880824b8da00
  750. [ 327.383604] RBP: ffffc9000798fc78 R08: ffff88081cadf400 R09: 0000000180200016
  751. [ 327.383604] R10: 000000001cad9001 R11: ffff88081cadf400 R12: ffff880824b8da00
  752. [ 327.383605] R13: 00007f8eb01189e0 R14: ffff880824b8da00 R15: ffff88082870d380
  753. [ 327.383607] ? exit_robust_list+0x37/0x120
  754. [ 327.383608] mm_release+0x123/0x140
  755. [ 327.383609] do_exit+0x149/0xb60
  756. [ 327.383610] ? futex_wait+0x11b/0x260
  757. [ 327.383611] do_group_exit+0x3f/0xb0
  758. [ 327.383613] get_signal+0x1cc/0x600
  759. [ 327.383615] do_signal+0x37/0x6a0
  760. [ 327.383615] ? do_futex+0xfd/0x570
  761. [ 327.383617] exit_to_usermode_loop+0x4c/0x92
  762. [ 327.383618] do_syscall_64+0x165/0x180
  763. [ 3SYSCALL64_slow_path+0x25/0x25
  764. [ 327.383621] RIP: 0033:0x7f8ec02ff79b
  765. [ 327.383621] RSP: 002b:00007f8eb0116e90 EFLAGS: 00000282 ORIG_RAX: 00000000000000ca
  766. [ 327.383622] RAX: fffffffffffffe00 RBX: 00000000000000ca RCX: 00007f8ec02ff79b
  767. [ 327.383622] RDX: 0000000000000000 RSI: 0000000000000080 RDI: 00007f8ea80028a0
  768. [ 327.383623] RBP: 00007f8ea80028a0 R08: 0000000000000000 R09: 0000000000f9d620
  769. [ 327.383624] R10: 0000000000000000 R11: 0000000000000282 R12: fffffffeffffffff
  770. [ 327.383624] R13: 0000000000000000 R14: 000000000186e560 R15: 00000000017f26c8
  771. [ 327.383625] Mem-Info:
  772. [ 327.383629] active_anon:0 inactive_anon:30 isolated_anon:0
  773. [ 327.383629] active_file:33 inactive_file:0 isolated_file:0
  774. [ 327.383629] unevictable:0 dirty:0 writeback:0 unstable:0
  775. [ 327.383629] slab_reclaimable:9956 slab_unreclaimable:137081
  776. [ 327.383629] mapped:52 shmem:0 pagetables:1417 bounce:0
  777. [ 327.383629] free:39407 free_pcp:363 free_cma:0
  778. [ 327.383633] Node 0 active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:128kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
  779. [ 327.383637] Node 1 active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:80kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:20399 all_unreclaimable? yes
  780. [ 327.383638] Node 0 DMA free:15880kB min:40kB low:52kB high:64kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15896kB mlocked:0kB slab_reclaimable:0kB slab_unreclaimable:16kB kernel_stack:0kB pagetables:0kB bounce:ocal_pcp:0kB free_cma:0kB
  781. [ 327.383641] lowmem_reserve[]: 0 2884 15935 15935 15935
  782. [ 327.383642] Node 0 DMA32 free:60220kB min:8104kB low:11056kB high:14008kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:3094192kB managed:3013324kB mlocked:0kB slab_reclaimable:32kB slab_unreclaimable:38808kB kernel_stack:2576kB pagetables:0kB bounce:0kB free_pcp:120kB local_pcp:0kB free_cma:0kB
  783. [ 327.383645] lowmem_reserve[]: 0 0 13051 13051 13051
  784. [ 327.383647] Node 0 Normal free:36440kB min:36664kB low:50028kB high:63392kB active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB writepending:0kB present:13631488kB managed:13364548kB mlocked:0kB slab_reclaimable:20088kB slab_unreclaimable:245952kB kernel_stack:16792kB pagetables:3348kB bounce:0kB free_pcp:548kB local_pcp:0kB free_cma:0kB
  785. [ 327.383649] lowmem_reserve[]: 0 0 0 0 0
  786. [ 327.383651] Node 1 Normal free:45088kB min:45296kB low:61804kB high:78312kB active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB writepending:0kB present:16777212kB managed:16509840kB mlocked:0kB slab_reclaimable:19704kB slab_unreclaimable:263548kB kernel_stack:13976kB pagetables:2320kB bounce:0kB free_pcp:784kB local_pcp:0kB free_cma:0kB
  787. [ 327.383654] lowmem_reserve[]: 0 0 0 0 0
  788. [ 327.383655] Node 0 DMA: 0*4kB 1*8kB (U) 0*16kB 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15880kB
  789. [ 327.383660] Node 0 DMA32: 3*4kB (M) 4*8kB (M) 9*16kB (UM) 12*32kB (UME) 10*64kB (UME) 5*128kB (UME) 4*256kB (UME) 6*512kB (ME) 5*1024kB (UME) 2*2048kB (UE) 11*4096kB (M) = 60266] Node 0 Normal: 200*4kB (ME) 267*8kB (ME) 167*16kB (UMEH) 97*32kB (UME) 63*64kB (UME) 52*128kB (UMH) 22*256kB (UM) 14*512kB (M) 4*1024kB (M) 0*2048kB 0*4096kB = 36296kB
  790. [ 327.383672] Node 1 Normal: 12*4kB (E) 22*8kB (UME) 30*16kB (UME) 32*32kB (ME) 154*64kB (UM) 113*128kB (UME) 18*256kB (UME) 28*512kB (UM) 0*1024kB 0*2048kB 0*4096kB = 44992kB
  791. [ 327.383677] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  792. [ 327.383678] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  793. [ 327.383678] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
  794. [ 327.383679] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
  795. [ 327.383679] 79 total pagecache pages
  796. [ 327.383680] 62 pages in swap cache
  797. [ 327.383680] Swap cache stats: add 29413, delete 29351, find 347/592
  798. [ 327.383681] Free swap = 16446020kB
  799. [ 327.383681] Total swap = 16516092kB
  800. [ 327.383682] 8379718 pages RAM
  801. [ 327.383682] 0 pages HighMem/MovableOnly
  802. [ 327.383682] 153816 pages reserved
  803. [ 327.383683] 0 pages cma reserved
  804. [ 327.383683] 0 pages hwpoisoned
  805. [ 327.383683] [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
  806. [ 327.383696] [ 782] 0 782 9206 1 22 3 82 0 systemd-journal
  807. [ 327.383697] [ 802] 0 802 0 27 3 374 0 lvmetad
  808. [ 327.383699] [ 824] 0 824 11841 1 25 3 698 -1000 systemd-udevd
  809. [ 327.383701] [ 1067] 0 1067 13856 0 28 3 111 -1000 auditd
  810. [ 327.383702] [ 1115] 0 1115 4889 0 15 3 144 0 irqbalance
  811. [ 327.383703] [ 1117] 0 1117 31969 1 20 4 132 0 smartd
  812. [ 327.383704] [ 1118] 998 1118 132401 1 57 4 1363 0 polkitd
  813. [ 327.383705] [ 1125] 997 1125 5672 6 17 3 62 0 chronyd
  814. [ 327.383706] [ 1128] 0 1128 6050 1 18 3 75 0 systemd-logind
  815. [ 327.383708] [ 1129] 994 1129 2133 1 9 3 37 0 lsmd
  816. [ 327.383709] [ 1130] 81 1130 8714 1 18 3 123 -900 dbus-daemon
  817. [ 327.383711] [ 1163] 0 1163 53176 0 56 3 441 0 abrtd
  818. [ 327.383712] [ 1165] 0 1165 52551 1 56 3 337 0 abrt-watch-log
  819. [ 327.383713] [ 1185] 0 1185 28814 0 11 0 ksmtuned
  820. [ 327.383714] [ 1251] 0 1251 50305 0 41 3 125 0 gssproxy
  821. [ 327.383715] [ 1290] 0 1290 28813 0 11 3 52 0 opensm-launch
  822. [ 327.383716] [ 1291] 0 1291 637907 0 86 6 396 0 opensm
  823. [ 327.383717] [ 1969] 0 1969 138293 0 91 3 2707 0 tuned
  824. [ 327.383718] [ 1974] 0 1974 55479 0 41 3 309 0 rsyslogd
  825. [ 327.383719] [ 1984] 0 1984 28337 1 12 3 38 0 rhsmcertd
  826. [ 327.383720] [ 1988] 0 1988 154722 1 149 3 2116 0 libvirtd
  827. [ 327.383722] [ 1991] 0 1991 6463 0 17 3 52 0 atd
  828. [ 327.383723] [ 2002] 0 2002 20619 1 41 3 215 -1000 sshd
  829. [ 327.383724] [ 2412] 0 2412 27511 1 11 3 31 0 agetty
  830. [ 327.383725] [ 2416] 0 2416 27511 1 10 3 30 0 agetty
  831. [ 327.383726] [ 3034] 0 3034 22767 1 42 3 258 0 master
  832. [ 327.383727] [ 3086] 89 3086 22793 1 45 3 253 0 pickup
  833. [ 327.383728] [ 3087] 89 3087 22810 1 45 3 254 0 qmgr
  834. [ 327.383730338 3888 0 11 3 52 0 dnsmasq
  835. [ 327.383731] [ 3339] 0 3339 3881 0 11 3 45 0 dnsmasq
  836. [ 327.383732] [ 3374] 0 3374 31558 1 20 3 161 0 crond
  837. [ 327.383733] [ 3375] 0 3375 60778 1 75 4 3092 0 beah-fwd-backen
  838. [ 327.383735] [ 3400] 0 3376 90264 0 98 4 0 0 beah-beaker-bac
  839. [ 327.383735] [ 3380] 0 3380 26973 1 8 3 24 0 rhnsd
  840. [ 327.383793] [ 4625] 0 4625 26976 0 11 3 18 0 sleep
  841. [ 327.383821] Out of memory: Kill process 3375 (beah-fwd-backen) score 0 or sacrifice child
  842. [ 327.383823] Killed process 3375 (beah-fwd-backen) total-vm:243112kB, anon-rss:0kB, file-rss:4kB, shmem-rss:0kB
  843. [ 327.403433] oom_reaper: reaped process 3375 (beah-fwd-backen), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
  844. [ 327.403625] kworker/6:256 invoked oom-killer: gfp_mask=0x14002c0(GFP_KERNEL|__GFP_NOWARN), nodemask=0-1, order=0, oom_score_adj=0
  845. [ 327.403625] kworker/6:256 cpuset=/ mems_allowed=0-1
  846. [ 327.403628] CPU: 6 PID: 3931 Comm: kworker/6:256 Not tainted 4.10.0 #2
  847. [ 327.403628] Hardware name: HP ProLiant DL388p Gen8, BIOS P70 12/20/2013
  848. [ 327.403631] Workqueue: ib_cm cm_work_handler [ib_cm]
  849. [ 327.403632] Call Trace:
  850. [ 327.403634] dump_stack+0x63/0x87
  851. [ 327.403635] dump_header+0x82/0x212
  852. [ 327.403637] ? selinux_capable+0x20/0x30
  853. [ 327.403638] ? security_capable_noaudit+0x45/0x60
  854. [ 327.403640] oom_kill_process+0x21c/0x3f0
  855. [ 327.403641] out_of_memory+0x117/0x4a0
  856. [ 327.403642] __alloc_pages_slowpath+0x913/0xaf0
  857. [ 327.403644] __alloc_pages_nodemask+0x223/0x2a0
  858. [ 327.403645] dma_generic_alloc_coherent+0x8e/0x130
  859. [ 327.403646] x86_swiotlb_alloc_coherent+0x25/0x50
  860. [ 327.403651] mlx4_buf_alloc+0xde/0x1c0 [mlx4_core]
  861. [ 327.403654] create_qp_common.isra.33+0xa5f/0x1010 [mlx4_ib]
  862. [ 327.403656] mlx4_ib_create_qp+0xf7/0x450 [mlx4_ib]
  863. [ 327.403659] mlx4_ib_create_qp+0x149/0x450 [mlx4_ib]
  864. [ 327.403663] ib_create_qp+0x70/0x2b0 [ib_core]
  865. [ 327.403665] rdma_create_qp+0x34/0xa0 [rdma_cm]
  866. [ 327.403667] nvmet_rdma_alloc_queue+0x692/0x900 [nvmet_rdma]
  867. [ 327.403668] ? nvmet_rdma_execute_command+0x100/0x100 [nvmet_rdma]
  868. [ 327.403670] nvmet_rdma_cm_handler+0x1e6/0x708 [nvmet_rdma]
  869. [ 327.403671] ? cma_acquire_dev+0x1e7/0x4b0 [rdma_cm]
  870. [ 327.403673] ? cma_new_conn_id+0xb2/0x4b0 [rdma_cm]
  871. [ 327.403675] ? cma_new_conn_id+0x153/0x4b0 [rdma_cm]
  872. [ 327.403676] cma_req_handler+0x1f5/0x4c0 [rdma_cm]
  873. [ 327.403678] cm_process_work+0x25/0x120 [ib_cm]
  874. [ 327.403680] cm_req_handler+0x994/0xcd0 [ib_cm]
  875. [ 327.403681] cm_work_handler+0x1ce/0x1753 [ib_cm]
  876. [ 327.403683] process_one_work+0x165/0x410
  877. [ 327.403684] worker_thread+0x137/0x4c0
  878. [ 327.403685] kthread+0x101/0x140
  879. [ 327.403686] ? rescuer_thread+0x3b0/0x3b0
  880. [ 327.403687] ? kthread_park+0x90/0x90
  881. [ 327.403688] ret_from_fork+0x2c/0x40
  882. [ 327.403689] Mem-Info:
  883. [ 327.403693] active_anon:0 inactive_anon:30 isolated_anon:0
  884. [ 327.403693] active_file:33 inactive_file:0 isolated_file:0
  885. [ 327.403693] unevictable:0 dirty:0 writeback:0 unstable:93] slab_reclaimable:9956 slab_unreclaimable:137081
  886. [ 327.403693] mapped:52 shmem:0 pagetables:1417 bounce:0
  887. [ 327.403693] free:39407 free_pcp:480 free_cma:0
  888. [ 327.403698] Node 0 active_anon:0kB inactive_anon:0kB active_file:76kB inactive_file:16kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:128kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
  889. [ 327.403702] Node 1 active_anon:0kB inactive_anon:176kB active_file:56kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB mapped:80kB dirty:0kB writeback:0kB shmem:0kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 0kB writeback_tmp:0kB unstable:0kB pages_scanned:0 all_unreclaimable? no
  890. [ 327.403702] Node 0 DMA free:15880kB min:40kB low:52kB high:64kB active_anon:0kB inactive_anon:0kB active_file:0kB
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!