API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Aug 10th, 2016
197
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 260.74 KB | None | 0 0
raw download clone embed print report
  1. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  2. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  3. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  4. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  5. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  6. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  7. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  8. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  9. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  10. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  11. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  12. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  13. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  14. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  15. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  16. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  17. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  18. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  19. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  20. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  21. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  22. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  23. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  24. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  25. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  26. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  27. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  28. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  29. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  30. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  31. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  32. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  33. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  34. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  35. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  36. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  37. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  38. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  39. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  40. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  41. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  42. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  43. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  44. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  45. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  46. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  47. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  48. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  49. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  50. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  51. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  52. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  53. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  54. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  55. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  56. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  57. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  58. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  59. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  60. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  61. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  62. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  63. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  64. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  65. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  66. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  67. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  68. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  69. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  70. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  71. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  72. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  73. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:458
  74. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:459
  75. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  76. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  77. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  78. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  79. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  80. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  81. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  82. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  83. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  84. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  85. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  86. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  87. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  88. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  89. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  90. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:328
  91. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:329
  92. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  93. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  94. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  95. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  96. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  97. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  98. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  99. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  100. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  101. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  102. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  103. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  104. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  105. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  106. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  107. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:225
  108. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:226
  109. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  110. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  111. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  112. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  113. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  114. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  115. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  116. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  117. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  118. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  119. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  120. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  121. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  122. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  123. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  124. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  125. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  126. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  127. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  128. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  129. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  130. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  131. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  132. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  133. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  134. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  135. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  136. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  137. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  138. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  139. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  140. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  141. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  142. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  143. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  144. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  145. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  146. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  147. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  148. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  149. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  150. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  151. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  152. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  153. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  154. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  155. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  156. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  157. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  158. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  159. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  160. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  161. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  162. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  163. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  164. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  165. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  166. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  167. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  168. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  169. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  170. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  171. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  172. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  173. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  174. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  175. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  176. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  177. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  178. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  179. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  180. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  181. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  182. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  183. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  184. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  185. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  186. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  187. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  188. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  189. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  190. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  191. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  192. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  193. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  194. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  195. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  196. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  197. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  198. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  199. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  200. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  201. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  202. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  203. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  204. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  205. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  206. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  207. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  208. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  209. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  210. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  211. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  212. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  213. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  214. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  215. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  216. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  217. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  218. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  219. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  220. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  221. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  222. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  223. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  224. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  225. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  226. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  227. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  228. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  229. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  230. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  231. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  232. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  233. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  234. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  235. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  236. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  237. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  238. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  239. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  240. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  241. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  242. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  243. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  244. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  245. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  246. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  247. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  248. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  249. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  250. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  251. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  252. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  253. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  254. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  255. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  256. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  257. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  258. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  259. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  260. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  261. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  262. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  263. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  264. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  265. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  266. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  267. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  268. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  269. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  270. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  271. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  272. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  273. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  274. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  275. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  276. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  277. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  278. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  279. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  280. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  281. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  282. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  283. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  284. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  285. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  286. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  287. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  288. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  289. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  290. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  291. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  292. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  293. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  294. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  295. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  296. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  297. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  298. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  299. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  300. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  301. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  302. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  303. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  304. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  305. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  306. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  307. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  308. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  309. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  310. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  311. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  312. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  313. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  314. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  315. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  316. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  317. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  318. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  319. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  320. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  321. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  322. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  323. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  324. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  325. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  326. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  327. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  328. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  329. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  330. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  331. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  332. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  333. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  334. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  335. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  336. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  337. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  338. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  339. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  340. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  341. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  342. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  343. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  344. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  345. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  346. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  347. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  348. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  349. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:302
  350. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:303
  351. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:181
  352. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  353. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  354. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  355. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  356. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  357. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  358. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  359. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  360. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  361. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  362. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  363. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  364. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  365. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  366. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  367. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  368. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  369. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  370. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  371. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  372. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  373. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  374. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  375. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  376. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  377. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  378. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  379. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  380. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  381. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  382. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  383. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  384. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  385. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  386. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  387. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  388. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  389. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  390. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  391. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  392. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  393. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  394. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  395. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  396. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  397. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  398. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  399. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  400. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  401. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  402. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  403. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  404. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  405. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  406. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  407. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  408. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  409. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  410. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  411. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  412. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  413. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  414. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  415. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  416. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  417. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  418. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  419. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  420. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  421. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  422. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  423. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  424. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  425. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  426. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:458
  427. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:459
  428. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  429. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  430. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  431. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  432. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  433. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  434. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  435. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  436. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  437. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  438. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  439. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  440. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  441. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  442. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  443. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:328
  444. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:329
  445. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  446. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  447. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  448. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  449. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  450. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  451. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  452. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  453. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  454. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  455. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  456. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  457. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  458. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  459. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  460. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:225
  461. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:226
  462. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  463. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  464. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  465. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  466. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  467. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  468. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  469. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  470. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  471. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  472. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  473. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  474. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  475. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  476. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  477. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  478. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  479. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  480. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  481. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  482. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  483. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  484. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  485. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  486. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  487. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  488. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  489. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  490. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  491. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  492. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  493. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  494. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  495. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  496. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  497. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  498. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  499. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  500. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  501. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  502. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  503. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  504. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  505. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  506. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  507. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  508. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  509. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  510. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  511. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  512. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  513. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  514. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  515. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  516. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  517. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  518. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  519. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  520. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  521. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  522. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  523. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  524. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  525. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  526. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  527. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  528. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  529. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  530. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  531. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  532. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  533. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  534. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  535. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  536. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  537. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  538. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  539. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  540. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  541. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  542. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  543. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  544. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  545. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  546. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  547. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  548. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  549. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  550. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  551. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  552. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  553. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  554. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  555. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  556. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  557. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  558. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  559. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  560. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  561. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  562. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  563. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  564. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  565. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  566. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  567. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  568. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  569. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  570. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  571. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  572. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  573. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  574. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  575. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  576. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  577. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  578. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  579. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  580. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  581. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  582. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  583. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  584. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  585. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  586. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  587. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  588. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  589. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  590. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  591. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  592. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  593. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  594. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  595. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  596. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  597. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  598. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  599. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  600. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  601. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  602. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  603. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  604. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  605. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  606. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  607. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  608. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  609. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  610. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  611. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  612. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  613. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  614. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  615. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  616. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  617. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  618. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  619. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  620. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  621. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  622. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  623. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  624. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  625. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  626. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  627. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  628. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  629. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  630. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  631. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  632. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  633. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  634. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  635. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  636. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  637. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  638. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  639. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  640. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  641. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  642. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  643. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  644. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  645. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  646. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  647. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  648. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  649. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  650. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  651. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  652. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  653. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  654. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  655. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  656. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  657. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  658. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  659. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  660. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  661. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  662. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  663. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  664. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  665. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  666. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  667. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  668. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  669. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  670. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  671. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  672. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  673. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  674. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  675. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  676. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  677. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  678. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  679. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  680. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  681. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  682. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  683. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  684. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  685. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  686. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  687. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  688. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  689. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  690. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  691. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  692. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  693. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  694. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  695. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  696. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  697. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  698. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  699. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  700. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  701. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  702. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  703. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  704. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  705. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  706. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  707. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  708. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  709. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  710. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  711. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  712. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  713. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  714. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  715. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  716. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  717. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  718. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  719. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  720. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  721. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  722. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  723. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  724. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  725. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  726. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  727. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  728. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  729. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  730. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  731. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  732. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  733. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  734. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  735. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  736. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  737. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  738. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  739. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  740. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  741. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  742. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  743. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  744. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  745. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  746. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  747. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  748. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  749. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  750. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  751. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  752. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  753. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  754. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  755. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  756. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  757. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  758. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  759. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  760. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  761. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  762. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:302
  763. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:303
  764. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:181
  765. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  766. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  767. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  768. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  769. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  770. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  771. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  772. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  773. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  774. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  775. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  776. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  777. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  778. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  779. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  780. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  781. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  782. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  783. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  784. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  785. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  786. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  787. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  788. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  789. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  790. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  791. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  792. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  793. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  794. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  795. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  796. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  797. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  798. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  799. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  800. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  801. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  802. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  803. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  804. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  805. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  806. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  807. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  808. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  809. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  810. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  811. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  812. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  813. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  814. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  815. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  816. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  817. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  818. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  819. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  820. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  821. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  822. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  823. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  824. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  825. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  826. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  827. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  828. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  829. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  830. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  831. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  832. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  833. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  834. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  835. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  836. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  837. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  838. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  839. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:458
  840. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:459
  841. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  842. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  843. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  844. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  845. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  846. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  847. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  848. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  849. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  850. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  851. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  852. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  853. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  854. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  855. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  856. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:328
  857. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:329
  858. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  859. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  860. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  861. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  862. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  863. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  864. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  865. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  866. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  867. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  868. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  869. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  870. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  871. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  872. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  873. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:225
  874. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:226
  875. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  876. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  877. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  878. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  879. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  880. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  881. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  882. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  883. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  884. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  885. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  886. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  887. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  888. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  889. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  890. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  891. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  892. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  893. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  894. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  895. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  896. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  897. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  898. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  899. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  900. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  901. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  902. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  903. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  904. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  905. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  906. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  907. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  908. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  909. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  910. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  911. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  912. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  913. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  914. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  915. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  916. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  917. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  918. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  919. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  920. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  921. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  922. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  923. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  924. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  925. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  926. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  927. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  928. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  929. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  930. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  931. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  932. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  933. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  934. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  935. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  936. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  937. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  938. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  939. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  940. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  941. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  942. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  943. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  944. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  945. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  946. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  947. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  948. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  949. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  950. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  951. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  952. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  953. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  954. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  955. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  956. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  957. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  958. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  959. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  960. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  961. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  962. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  963. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  964. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  965. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  966. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  967. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  968. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  969. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  970. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  971. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  972. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  973. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  974. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  975. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  976. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  977. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  978. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  979. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  980. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  981. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  982. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  983. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  984. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  985. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  986. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  987. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  988. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  989. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  990. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  991. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  992. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  993. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  994. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  995. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  996. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  997. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  998. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  999. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1000. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1001. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1002. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1003. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1004. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1005. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1006. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1007. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1008. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1009. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1010. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1011. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1012. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1013. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1014. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1015. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1016. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1017. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1018. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1019. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1020. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1021. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1022. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1023. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1024. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1025. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1026. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1027. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1028. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1029. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1030. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1031. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1032. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1033. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1034. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1035. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1036. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1037. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1038. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1039. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1040. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1041. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1042. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1043. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1044. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1045. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1046. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1047. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1048. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1049. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1050. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1051. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1052. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1053. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1054. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1055. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1056. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1057. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1058. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1059. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1060. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1061. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1062. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1063. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1064. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1065. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1066. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1067. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1068. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1069. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1070. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1071. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1072. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1073. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1074. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1075. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1076. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1077. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1078. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1079. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1080. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1081. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1082. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1083. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1084. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1085. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1086. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1087. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1088. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1089. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1090. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1091. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1092. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1093. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1094. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1095. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1096. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1097. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1098. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1099. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1100. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1101. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1102. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1103. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1104. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1105. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1106. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1107. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1108. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1109. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1110. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1111. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1112. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1113. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1114. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1115. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1116. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1117. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1118. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1119. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1120. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1121. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1122. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1123. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1124. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1125. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1126. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1127. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1128. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1129. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1130. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1131. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1132. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1133. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1134. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1135. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1136. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1137. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1138. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1139. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1140. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1141. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1142. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1143. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1144. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1145. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1146. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1147. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1148. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1149. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1150. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1151. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1152. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1153. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1154. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1155. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1156. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1157. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1158. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1159. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1160. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1161. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1162. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1163. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1164. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1165. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1166. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1167. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1168. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1169. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1170. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1171. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1172. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1173. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1174. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1175. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1176. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1177. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1178. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1179. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1180. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1181. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1182. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1183. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1184. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1185. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1186. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1187. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1188. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1189. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1190. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1191. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1192. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1193. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1194. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1195. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1196. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1197. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1198. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1199. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1200. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1201. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1202. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1203. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1204. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1205. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1206. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1207. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1208. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1209. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1210. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1211. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1212. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1213. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1214. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1215. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1216. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1217. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1218. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1219. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1220. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1221. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1222. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1223. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1224. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1225. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1226. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1227. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1228. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1229. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1230. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1231. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1232. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1233. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1234. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1235. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:302
  1236. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:303
  1237. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:181
  1238. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1239. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1240. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1241. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1242. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1243. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1244. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1245. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1246. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1247. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1248. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1249. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1250. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1251. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1252. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1253. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1254. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1255. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1256. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1257. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1258. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1259. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1260. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1261. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1262. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1263. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1264. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1265. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1266. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1267. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1268. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1269. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1270. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1271. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1272. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1273. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1274. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1275. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1276. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1277. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1278. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1279. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1280. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1281. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1282. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1283. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1284. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1285. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1286. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1287. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1288. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1289. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1290. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1291. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1292. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1293. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1294. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1295. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1296. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1297. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1298. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1299. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1300. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1301. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1302. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1303. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1304. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1305. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1306. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1307. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1308. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1309. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1310. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1311. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1312. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:458
  1313. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:459
  1314. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1315. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1316. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1317. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1318. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1319. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1320. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1321. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1322. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1323. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1324. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1325. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1326. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1327. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1328. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1329. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:328
  1330. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:329
  1331. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1332. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1333. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1334. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1335. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1336. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1337. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1338. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1339. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1340. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1341. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1342. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1343. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1344. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1345. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1346. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:225
  1347. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:226
  1348. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1349. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1350. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1351. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1352. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1353. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1354. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1355. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1356. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1357. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1358. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1359. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1360. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1361. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1362. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1363. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1364. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1365. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1366. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1367. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1368. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1369. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1370. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1371. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1372. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1373. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1374. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1375. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1376. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1377. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1378. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1379. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1380. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1381. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1382. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1383. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1384. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1385. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1386. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1387. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1388. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1389. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1390. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1391. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1392. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1393. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1394. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1395. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1396. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1397. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1398. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1399. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1400. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1401. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1402. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1403. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1404. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1405. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1406. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1407. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1408. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1409. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1410. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1411. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1412. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1413. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1414. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1415. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1416. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1417. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1418. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1419. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1420. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1421. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1422. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1423. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1424. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1425. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1426. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1427. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1428. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1429. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1430. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1431. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1432. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1433. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1434. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1435. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1436. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1437. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1438. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1439. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1440. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1441. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1442. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1443. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1444. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1445. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1446. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1447. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1448. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1449. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1450. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1451. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1452. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1453. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1454. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1455. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1456. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1457. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1458. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1459. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1460. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1461. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1462. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1463. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1464. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1465. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1466. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1467. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1468. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1469. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1470. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1471. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1472. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1473. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1474. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1475. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1476. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1477. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1478. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1479. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1480. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1481. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1482. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1483. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1484. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1485. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1486. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1487. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1488. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1489. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1490. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1491. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1492. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1493. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1494. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1495. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1496. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1497. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1498. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1499. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1500. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1501. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1502. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1503. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1504. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1505. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1506. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1507. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1508. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1509. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1510. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1511. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1512. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1513. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1514. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1515. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1516. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1517. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1518. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1519. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1520. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1521. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1522. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1523. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1524. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1525. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1526. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1527. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1528. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1529. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1530. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1531. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1532. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1533. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1534. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1535. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1536. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1537. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1538. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1539. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1540. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1541. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1542. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1543. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1544. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1545. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1546. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1547. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1548. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1549. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1550. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1551. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1552. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1553. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1554. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1555. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1556. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1557. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1558. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1559. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1560. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1561. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1562. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1563. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1564. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1565. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1566. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1567. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1568. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1569. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1570. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1571. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1572. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1573. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1574. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1575. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1576. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1577. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1578. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1579. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1580. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1581. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1582. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1583. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1584. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1585. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1586. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1587. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1588. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1589. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1590. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1591. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1592. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1593. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1594. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1595. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1596. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1597. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1598. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1599. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1600. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1601. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1602. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1603. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1604. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1605. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1606. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1607. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1608. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1609. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1610. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1611. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1612. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1613. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1614. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1615. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1616. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1617. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1618. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1619. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1620. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1621. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1622. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1623. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1624. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1625. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1626. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1627. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1628. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1629. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1630. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1631. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1632. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1633. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1634. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1635. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1636. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1637. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1638. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1639. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1640. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1641. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1642. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1643. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1644. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1645. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1646. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1647. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1648. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1649. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1650. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1651. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1652. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1653. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1654. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1655. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1656. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1657. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1658. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1659. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1660. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1661. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1662. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1663. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1664. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1665. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1666. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1667. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1668. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1669. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1670. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1671. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1672. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1673. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1674. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1675. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1676. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1677. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1678. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1679. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1680. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1681. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1682. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1683. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1684. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1685. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1686. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1687. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1688. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1689. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1690. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1691. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1692. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1693. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1694. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1695. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1696. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1697. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1698. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1699. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1700. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1701. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1702. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1703. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1704. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1705. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1706. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1707. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1708. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1709. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1710. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1711. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1712. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1713. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1714. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1715. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1716. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1717. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1718. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1719. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1720. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1721. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1722. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1723. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1724. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1725. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1726. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1727. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1728. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1729. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1730. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1731. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1732. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1733. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1734. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1735. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1736. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1737. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1738. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1739. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1740. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1741. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1742. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1743. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1744. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1745. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1746. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1747. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1748. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1749. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1750. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1751. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1752. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1753. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1754. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1755. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1756. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1757. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1758. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1759. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1760. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1761. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1762. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1763. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1764. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1765. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1766. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1767. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1768. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:302
  1769. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:303
  1770. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:181
  1771. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1772. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1773. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1774. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1775. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1776. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1777. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1778. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1779. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1780. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1781. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1782. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1783. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1784. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1785. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1786. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1787. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1788. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1789. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1790. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1791. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1792. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1793. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1794. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1795. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1796. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1797. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1798. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1799. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1800. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1801. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1802. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1803. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1804. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1805. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1806. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1807. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1808. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1809. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1810. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1811. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1812. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1813. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1814. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1815. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1816. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1817. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1818. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1819. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1820. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1821. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1822. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1823. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1824. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1825. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1826. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1827. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1828. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1829. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1830. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1831. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1832. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1833. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1834. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1835. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1836. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1837. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1838. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1839. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1840. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  1841. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  1842. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  1843. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  1844. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  1845. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:458
  1846. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:459
  1847. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1848. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1849. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1850. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1851. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1852. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1853. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1854. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1855. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1856. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1857. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1858. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1859. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1860. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1861. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  1862. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:328
  1863. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:329
  1864. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1865. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1866. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1867. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1868. CUBLAS error: memory mapping error (11) in magmablas_dsetmatrix_transpose_mgpu at magmablas/dsetmatrix_transpose_mgpu.cpp:56
  1869. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:225
  1870. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:226
  1871. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1872. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1873. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1874. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1875. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1876. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1877. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1878. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1879. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1880. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1881. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1882. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1883. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1884. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1885. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1886. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1887. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1888. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1889. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1890. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1891. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1892. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1893. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1894. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1895. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1896. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1897. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1898. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1899. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1900. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1901. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1902. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1903. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1904. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1905. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1906. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1907. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1908. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1909. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1910. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1911. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1912. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1913. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1914. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1915. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1916. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1917. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1918. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1919. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1920. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1921. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1922. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1923. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1924. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1925. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1926. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1927. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1928. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1929. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1930. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1931. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1932. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1933. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1934. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1935. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1936. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1937. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1938. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1939. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1940. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1941. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1942. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1943. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1944. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1945. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1946. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1947. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1948. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1949. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1950. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1951. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1952. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1953. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1954. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1955. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1956. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1957. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1958. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1959. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1960. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1961. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1962. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1963. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1964. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1965. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1966. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1967. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1968. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1969. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1970. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1971. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1972. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1973. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1974. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1975. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1976. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1977. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1978. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1979. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1980. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1981. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1982. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1983. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1984. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1985. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1986. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1987. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1988. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1989. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1990. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1991. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  1992. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1993. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1994. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1995. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  1996. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  1997. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  1998. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  1999. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2000. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2001. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2002. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2003. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2004. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2005. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2006. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2007. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2008. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2009. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2010. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2011. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2012. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2013. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2014. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2015. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2016. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2017. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2018. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2019. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2020. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2021. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2022. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2023. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2024. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2025. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2026. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2027. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2028. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2029. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2030. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2031. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2032. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2033. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2034. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2035. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2036. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2037. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2038. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2039. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2040. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2041. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2042. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2043. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2044. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2045. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2046. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2047. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2048. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2049. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2050. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2051. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  2052. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2053. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2054. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2055. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2056. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2057. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2058. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2059. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2060. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2061. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2062. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2063. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2064. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2065. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2066. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2067. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2068. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2069. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2070. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2071. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2072. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2073. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2074. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2075. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2076. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2077. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2078. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2079. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2080. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2081. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2082. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2083. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2084. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2085. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2086. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2087. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2088. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2089. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2090. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2091. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2092. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2093. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2094. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2095. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2096. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2097. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2098. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2099. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2100. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2101. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2102. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2103. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2104. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2105. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2106. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2107. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2108. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2109. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2110. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2111. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  2112. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2113. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2114. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2115. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2116. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2117. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2118. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2119. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2120. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2121. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2122. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2123. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2124. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2125. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2126. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2127. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2128. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2129. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2130. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2131. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2132. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2133. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2134. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2135. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2136. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2137. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2138. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2139. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2140. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2141. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2142. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2143. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2144. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2145. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2146. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2147. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2148. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2149. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2150. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2151. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2152. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2153. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2154. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2155. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2156. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2157. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2158. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2159. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2160. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2161. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2162. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2163. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2164. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2165. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2166. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2167. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2168. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2169. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2170. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2171. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  2172. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2173. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2174. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2175. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2176. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2177. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2178. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2179. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2180. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2181. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2182. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2183. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2184. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2185. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2186. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2187. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2188. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2189. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2190. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2191. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2192. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2193. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2194. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2195. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2196. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2197. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2198. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2199. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2200. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2201. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2202. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2203. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2204. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2205. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2206. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2207. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2208. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2209. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2210. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2211. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2212. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2213. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2214. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2215. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2216. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2217. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2218. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2219. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2220. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2221. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2222. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2223. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2224. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2225. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2226. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2227. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2228. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2229. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2230. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2231. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  2232. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2233. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2234. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2235. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2236. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2237. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2238. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2239. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2240. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2241. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2242. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2243. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2244. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2245. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2246. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2247. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2248. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2249. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2250. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2251. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2252. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2253. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2254. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2255. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2256. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2257. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2258. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2259. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2260. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2261. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2262. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2263. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2264. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2265. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2266. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2267. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2268. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2269. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2270. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2271. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2272. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2273. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2274. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2275. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2276. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2277. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2278. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2279. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2280. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2281. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2282. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2283. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2284. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2285. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2286. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2287. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2288. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2289. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2290. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2291. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:241
  2292. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2293. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2294. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2295. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2296. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2297. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2298. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2299. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2300. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2301. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2302. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2303. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2304. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2305. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2306. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2307. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2308. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2309. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2310. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2311. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2312. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2313. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2314. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2315. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2316. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2317. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2318. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2319. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2320. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2321. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2322. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2323. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2324. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2325. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2326. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2327. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2328. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2329. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2330. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2331. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2332. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2333. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2334. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2335. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2336. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2337. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2338. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2339. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2340. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2341. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2342. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2343. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2344. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2345. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2346. CUBLAS error: memory mapping error (11) in magma_dgetrf_m at src/dgetrf_m.cpp:275
  2347. CUDA runtime error: an illegal memory access was encountered (77) in magma_queue_wait_event at interface_cuda/interface.cpp:768
  2348. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2349. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:268
  2350. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_record at interface_cuda/interface.cpp:748
  2351. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:302
  2352. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:303
  2353. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:181
  2354. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  2355. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  2356. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  2357. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  2358. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  2359. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  2360. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  2361. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  2362. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  2363. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  2364. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  2365. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  2366. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  2367. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  2368. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  2369. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  2370. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  2371. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  2372. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  2373. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:328
  2374. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:200
  2375. CUBLAS error: memory mapping error (11) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:218
  2376. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:275
  2377. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:281
  2378. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:458
  2379. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf2_mgpu at src/dgetrf2_mgpu.cpp:459
  2380. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  2381. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  2382. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  2383. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  2384. CUBLAS error: memory mapping error (11) in magmablas_dgetmatrix_transpose_mgpu at magmablas/dgetmatrix_transpose_mgpu.cpp:57
  2385. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:328
  2386. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:329
  2387. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:347
  2388. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_destroy at interface_cuda/interface.cpp:738
  2389. CUDA runtime error: an illegal memory access was encountered (77) in magma_event_destroy at interface_cuda/interface.cpp:738
  2390. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:350
  2391. CUDA runtime error: an illegal memory access was encountered (77) in magma_dgetrf_m at src/dgetrf_m.cpp:351
  2392. *** Error in `/home/tjb3/.CLion2016.2/system/cmake/generated/HTGS-Tutorials-b28450c/b28450c/Release/tutorial7/lud-openblas-cuda-v2/lud-in-memory-openblas-cuda-v2': munmap_chunk(): invalid pointer: 0x00007fd3800d2010 ***
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!