API tools faq
paste
Guest User

Untitled

a guest
Aug 13th, 2026
103
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Apache Log 22.20 KB | None | 0 0
raw download clone embed print report
  1. # llama-server --host 0.0.0.0 --port 8000 -m ./Qwen3-Coder-30B-A3B-Instruct-IQ4_NL.gguf --jinja --temp 0.7 --min-p 0.0 --top-p 0.80 --top-k 20 --repeat-penalty 1.05 -fa off -lm mlock --n-cpu-moe 99 -c 110000
  2. 0.00.101.076 I cmn  common_param: common_params_print_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
  3. 0.00.371.101 W srv  llama_server: -----------------
  4. 0.00.371.104 W srv  llama_server: CORS is set to allow all origins ('*') and no API key is set
  5. 0.00.371.104 W srv  llama_server: this can be a security risk (cross-origin attacks)
  6. 0.00.371.104 W srv  llama_server: more info: https://github.com/ggml-org/llama.cpp/pull/25655
  7. 0.00.371.104 W srv  llama_server: -----------------
  8. 0.00.372.441 I srv    load_model: loading model './Qwen3-Coder-30B-A3B-Instruct-IQ4_NL.gguf'
  9. 0.00.721.566 W load: control-looking token: 128247 '</s>' was not control-type; this is probably a bug in the model. its type will be overridden
  10. 0.10.385.734 I srv    load_model: initializing, n_slots = 4, n_ctx_slot = 110080, kv_unified = 'true'
  11. 0.10.387.614 I srv  llama_server: model loaded
  12. 0.10.387.618 I srv  llama_server: listening on http://0.0.0.0:8000
  13. 1.09.903.524 I slot get_availabl: id  3 | task -1 | selected slot by LRU, t_last = -1
  14. 1.09.903.832 I slot launch_slot_: id  3 | task 0 | processing task, is_child = 0
  15. 1.39.901.086 I slot print_timing: id  3 | task 0 | n_decoded =    100, tg =  23.21 t/s, tg_3s =  23.21 t/s
  16. 1.41.564.693 I slot print_timing: id  3 | task 0 | prompt eval time =   25687.57 ms /  1888 tokens (   13.61 ms per token,    73.50 tokens per second)
  17. 1.41.564.696 I slot print_timing: id  3 | task 0 |        eval time =    5972.98 ms /   146 tokens (   40.91 ms per token,    24.44 tokens per second)
  18. 1.41.564.696 I slot print_timing: id  3 | task 0 |       total time =   31660.55 ms /  2034 tokens
  19. 1.41.564.697 I slot print_timing: id  3 | task 0 |    graphs reused =        145
  20. 1.41.564.824 I slot      release: id  3 | task 0 | stop processing: n_tokens = 2033, truncated = 0
  21. 1.41.691.650 I slot get_availabl: id  2 | task -1 | selected slot by LRU, t_last = -1
  22. 1.41.691.894 I slot launch_slot_: id  2 | task 147 | processing task, is_child = 0
  23. 2.07.103.523 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =   2048, progress = 0.09, t =  25.18 s / 81.33 tokens per second
  24. 2.37.763.151 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =   4096, progress = 0.17, t =  55.84 s / 73.35 tokens per second
  25. 3.13.932.683 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =   6144, progress = 0.26, t =  92.01 s / 66.77 tokens per second
  26. 3.54.239.484 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =   8192, progress = 0.35, t = 132.32 s / 61.91 tokens per second
  27. 4.39.937.681 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  10240, progress = 0.43, t = 178.02 s / 57.52 tokens per second
  28. 5.30.534.311 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  12288, progress = 0.52, t = 228.61 s / 53.75 tokens per second
  29. 6.25.842.074 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  14336, progress = 0.61, t = 283.92 s / 50.49 tokens per second
  30. 7.26.294.981 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  16384, progress = 0.69, t = 344.37 s / 47.58 tokens per second
  31. 8.32.418.488 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  18432, progress = 0.78, t = 410.50 s / 44.90 tokens per second
  32. 9.43.964.244 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  20480, progress = 0.87, t = 482.04 s / 42.49 tokens per second
  33. 11.00.873.422 I slot print_timing: id  2 | task 147 | prompt processing, n_tokens =  22528, progress = 0.95, t = 558.95 s / 40.30 tokens per second
  34. 11.55.591.666 I slot print_timing: id  2 | task 147 | n_decoded =    100, tg =  14.21 t/s, tg_3s =  14.21 t/s
  35. 11.58.652.881 I slot print_timing: id  2 | task 147 | n_decoded =    143, tg =  14.16 t/s, tg_3s =  14.05 t/s
  36. 12.01.661.130 I slot print_timing: id  2 | task 147 | n_decoded =    185, tg =  14.12 t/s, tg_3s =  13.96 t/s
  37. 12.04.683.241 I slot print_timing: id  2 | task 147 | n_decoded =    227, tg =  14.08 t/s, tg_3s =  13.90 t/s
  38. 12.07.706.987 I slot print_timing: id  2 | task 147 | n_decoded =    269, tg =  14.05 t/s, tg_3s =  13.89 t/s
  39. 12.10.734.227 I slot print_timing: id  2 | task 147 | n_decoded =    311, tg =  14.02 t/s, tg_3s =  13.87 t/s
  40. 12.13.762.951 I slot print_timing: id  2 | task 147 | n_decoded =    353, tg =  14.00 t/s, tg_3s =  13.87 t/s
  41. 12.16.793.347 I slot print_timing: id  2 | task 147 | n_decoded =    395, tg =  13.99 t/s, tg_3s =  13.86 t/s
  42. 12.19.825.247 I slot print_timing: id  2 | task 147 | n_decoded =    437, tg =  13.98 t/s, tg_3s =  13.85 t/s
  43. 12.22.885.227 I slot print_timing: id  2 | task 147 | n_decoded =    479, tg =  13.95 t/s, tg_3s =  13.73 t/s
  44. 12.25.942.631 I slot print_timing: id  2 | task 147 | n_decoded =    521, tg =  13.94 t/s, tg_3s =  13.74 t/s
  45. 12.29.002.759 I slot print_timing: id  2 | task 147 | n_decoded =    563, tg =  13.92 t/s, tg_3s =  13.72 t/s
  46. 12.32.062.978 I slot print_timing: id  2 | task 147 | n_decoded =    605, tg =  13.91 t/s, tg_3s =  13.72 t/s
  47. 12.35.124.698 I slot print_timing: id  2 | task 147 | n_decoded =    647, tg =  13.89 t/s, tg_3s =  13.72 t/s
  48. 12.38.189.647 I slot print_timing: id  2 | task 147 | n_decoded =    689, tg =  13.88 t/s, tg_3s =  13.70 t/s
  49. 12.38.924.609 I slot print_timing: id  2 | task 147 | prompt eval time =  606635.66 ms / 23628 tokens (   25.67 ms per token,    38.95 tokens per second)
  50. 12.38.924.612 I slot print_timing: id  2 | task 147 |        eval time =   50368.26 ms /   699 tokens (   72.06 ms per token,    13.88 tokens per second)
  51. 12.38.924.612 I slot print_timing: id  2 | task 147 |       total time =  657003.92 ms / 24327 tokens
  52. 12.38.924.613 I slot print_timing: id  2 | task 147 |    graphs reused =        839
  53. 12.38.925.257 I slot      release: id  2 | task 147 | stop processing: n_tokens = 24326, truncated = 0
  54. 14.22.218.257 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, f_sim_best = 0.999 (> 0.100 thold), f_keep = 1.000
  55. 14.22.218.608 I slot launch_slot_: id  2 | task 858 | processing task, is_child = 0
  56. 14.34.295.150 I slot print_timing: id  2 | task 858 | n_decoded =    100, tg =  14.01 t/s, tg_3s =  14.01 t/s
  57. 14.37.314.225 I slot print_timing: id  2 | task 858 | n_decoded =    142, tg =  13.98 t/s, tg_3s =  13.91 t/s
  58. 14.37.745.248 I slot print_timing: id  2 | task 858 | prompt eval time =    4940.36 ms /    36 tokens (  137.23 ms per token,     7.29 tokens per second)
  59. 14.37.745.250 I slot print_timing: id  2 | task 858 |        eval time =   10585.93 ms /   148 tokens (   71.53 ms per token,    13.98 tokens per second)
  60. 14.37.745.251 I slot print_timing: id  2 | task 858 |       total time =   15526.29 ms /   184 tokens
  61. 14.37.745.251 I slot print_timing: id  2 | task 858 |    graphs reused =        985
  62. 14.37.745.897 I slot      release: id  2 | task 858 | stop processing: n_tokens = 24509, truncated = 0
  63. 14.38.053.734 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, f_sim_best = 0.648 (> 0.100 thold), f_keep = 1.000
  64. 14.38.054.100 I slot launch_slot_: id  2 | task 1007 | processing task, is_child = 0
  65. 16.04.660.544 I slot print_timing: id  2 | task 1007 | prompt processing, n_tokens =   2048, progress = 0.70, t =  86.61 s / 23.65 tokens per second
  66. 17.36.310.680 I slot print_timing: id  2 | task 1007 | prompt processing, n_tokens =   4096, progress = 0.76, t = 178.26 s / 22.98 tokens per second
  67. 19.13.049.360 I slot print_timing: id  2 | task 1007 | prompt processing, n_tokens =   6144, progress = 0.81, t = 274.99 s / 22.34 tokens per second
  68. 20.54.582.185 I slot print_timing: id  2 | task 1007 | prompt processing, n_tokens =   8192, progress = 0.86, t = 376.53 s / 21.76 tokens per second
  69. 22.41.184.966 I slot print_timing: id  2 | task 1007 | prompt processing, n_tokens =  10240, progress = 0.92, t = 483.13 s / 21.20 tokens per second
  70. 24.33.093.224 I slot print_timing: id  2 | task 1007 | prompt processing, n_tokens =  12288, progress = 0.97, t = 595.04 s / 20.65 tokens per second
  71. 25.40.863.989 I slot print_timing: id  2 | task 1007 | n_decoded =    100, tg =  10.39 t/s, tg_3s =  10.39 t/s
  72. 25.43.883.531 I slot print_timing: id  2 | task 1007 | n_decoded =    131, tg =  10.36 t/s, tg_3s =  10.27 t/s
  73. 25.46.905.772 I slot print_timing: id  2 | task 1007 | n_decoded =    162, tg =  10.34 t/s, tg_3s =  10.26 t/s
  74. 25.49.928.843 I slot print_timing: id  2 | task 1007 | n_decoded =    193, tg =  10.33 t/s, tg_3s =  10.25 t/s
  75. 25.52.952.722 I slot print_timing: id  2 | task 1007 | n_decoded =    224, tg =  10.32 t/s, tg_3s =  10.25 t/s
  76. 25.55.978.383 I slot print_timing: id  2 | task 1007 | n_decoded =    255, tg =  10.31 t/s, tg_3s =  10.25 t/s
  77. 25.59.003.386 I slot print_timing: id  2 | task 1007 | n_decoded =    286, tg =  10.30 t/s, tg_3s =  10.25 t/s
  78. 26.02.035.692 I slot print_timing: id  2 | task 1007 | n_decoded =    317, tg =  10.29 t/s, tg_3s =  10.22 t/s
  79. 26.05.077.897 I slot print_timing: id  2 | task 1007 | n_decoded =    348, tg =  10.29 t/s, tg_3s =  10.19 t/s
  80. 26.08.119.005 I slot print_timing: id  2 | task 1007 | n_decoded =    379, tg =  10.28 t/s, tg_3s =  10.19 t/s
  81. 26.11.159.604 I slot print_timing: id  2 | task 1007 | n_decoded =    410, tg =  10.27 t/s, tg_3s =  10.20 t/s
  82. 26.14.201.567 I slot print_timing: id  2 | task 1007 | n_decoded =    441, tg =  10.27 t/s, tg_3s =  10.19 t/s
  83. 26.17.245.458 I slot print_timing: id  2 | task 1007 | n_decoded =    472, tg =  10.26 t/s, tg_3s =  10.18 t/s
  84. 26.20.289.697 I slot print_timing: id  2 | task 1007 | n_decoded =    503, tg =  10.26 t/s, tg_3s =  10.18 t/s
  85. 26.23.334.970 I slot print_timing: id  2 | task 1007 | n_decoded =    534, tg =  10.25 t/s, tg_3s =  10.18 t/s
  86. 26.26.381.875 I slot print_timing: id  2 | task 1007 | n_decoded =    565, tg =  10.25 t/s, tg_3s =  10.17 t/s
  87. 26.29.438.796 I slot print_timing: id  2 | task 1007 | n_decoded =    596, tg =  10.24 t/s, tg_3s =  10.14 t/s
  88. 26.32.493.490 I slot print_timing: id  2 | task 1007 | n_decoded =    627, tg =  10.24 t/s, tg_3s =  10.15 t/s
  89. 26.35.549.382 I slot print_timing: id  2 | task 1007 | n_decoded =    658, tg =  10.23 t/s, tg_3s =  10.14 t/s
  90. 26.38.605.928 I slot print_timing: id  2 | task 1007 | n_decoded =    689, tg =  10.23 t/s, tg_3s =  10.14 t/s
  91. 26.41.662.569 I slot print_timing: id  2 | task 1007 | n_decoded =    720, tg =  10.22 t/s, tg_3s =  10.14 t/s
  92. 26.44.721.503 I slot print_timing: id  2 | task 1007 | n_decoded =    751, tg =  10.22 t/s, tg_3s =  10.13 t/s
  93. 26.47.782.452 I slot print_timing: id  2 | task 1007 | n_decoded =    782, tg =  10.22 t/s, tg_3s =  10.13 t/s
  94. 26.50.843.938 I slot print_timing: id  2 | task 1007 | n_decoded =    813, tg =  10.21 t/s, tg_3s =  10.13 t/s
  95. 26.53.911.772 I slot print_timing: id  2 | task 1007 | n_decoded =    844, tg =  10.21 t/s, tg_3s =  10.10 t/s
  96. 26.56.976.637 I slot print_timing: id  2 | task 1007 | n_decoded =    875, tg =  10.21 t/s, tg_3s =  10.11 t/s
  97. 27.00.039.770 I slot print_timing: id  2 | task 1007 | n_decoded =    906, tg =  10.20 t/s, tg_3s =  10.12 t/s
  98. 27.03.102.864 I slot print_timing: id  2 | task 1007 | n_decoded =    937, tg =  10.20 t/s, tg_3s =  10.12 t/s
  99. 27.06.167.982 I slot print_timing: id  2 | task 1007 | n_decoded =    968, tg =  10.20 t/s, tg_3s =  10.11 t/s
  100. 27.09.242.921 I slot print_timing: id  2 | task 1007 | n_decoded =    999, tg =  10.19 t/s, tg_3s =  10.08 t/s
  101. 27.12.321.292 I slot print_timing: id  2 | task 1007 | n_decoded =   1030, tg =  10.19 t/s, tg_3s =  10.07 t/s
  102. 27.15.400.753 I slot print_timing: id  2 | task 1007 | n_decoded =   1061, tg =  10.19 t/s, tg_3s =  10.07 t/s
  103. 27.18.497.436 I slot print_timing: id  2 | task 1007 | n_decoded =   1092, tg =  10.18 t/s, tg_3s =  10.01 t/s
  104. 27.21.511.517 I slot print_timing: id  2 | task 1007 | n_decoded =   1122, tg =  10.18 t/s, tg_3s =   9.95 t/s
  105. 27.24.527.737 I slot print_timing: id  2 | task 1007 | n_decoded =   1152, tg =  10.17 t/s, tg_3s =   9.95 t/s
  106. 27.27.543.912 I slot print_timing: id  2 | task 1007 | n_decoded =   1182, tg =  10.16 t/s, tg_3s =   9.95 t/s
  107. 27.30.561.688 I slot print_timing: id  2 | task 1007 | n_decoded =   1212, tg =  10.16 t/s, tg_3s =   9.94 t/s
  108. 27.33.581.626 I slot print_timing: id  2 | task 1007 | n_decoded =   1242, tg =  10.15 t/s, tg_3s =   9.93 t/s
  109. 27.36.602.586 I slot print_timing: id  2 | task 1007 | n_decoded =   1272, tg =  10.15 t/s, tg_3s =   9.93 t/s
  110. 27.39.624.763 I slot print_timing: id  2 | task 1007 | n_decoded =   1302, tg =  10.14 t/s, tg_3s =   9.93 t/s
  111. 27.42.648.386 I slot print_timing: id  2 | task 1007 | n_decoded =   1332, tg =  10.14 t/s, tg_3s =   9.92 t/s
  112. 27.45.697.912 I slot print_timing: id  2 | task 1007 | n_decoded =   1362, tg =  10.13 t/s, tg_3s =   9.84 t/s
  113. 27.48.747.944 I slot print_timing: id  2 | task 1007 | n_decoded =   1392, tg =  10.12 t/s, tg_3s =   9.84 t/s
  114. 27.51.793.951 I slot print_timing: id  2 | task 1007 | n_decoded =   1422, tg =  10.12 t/s, tg_3s =   9.85 t/s
  115. 27.54.841.624 I slot print_timing: id  2 | task 1007 | n_decoded =   1452, tg =  10.11 t/s, tg_3s =   9.84 t/s
  116. 27.57.889.957 I slot print_timing: id  2 | task 1007 | n_decoded =   1482, tg =  10.11 t/s, tg_3s =   9.84 t/s
  117. 28.00.940.849 I slot print_timing: id  2 | task 1007 | n_decoded =   1512, tg =  10.10 t/s, tg_3s =   9.83 t/s
  118. 28.03.991.373 I slot print_timing: id  2 | task 1007 | n_decoded =   1542, tg =  10.10 t/s, tg_3s =   9.83 t/s
  119. 28.07.040.227 I slot print_timing: id  2 | task 1007 | n_decoded =   1572, tg =  10.09 t/s, tg_3s =   9.84 t/s
  120. 28.10.100.505 I slot print_timing: id  2 | task 1007 | n_decoded =   1602, tg =  10.08 t/s, tg_3s =   9.80 t/s
  121. 28.13.165.956 I slot print_timing: id  2 | task 1007 | n_decoded =   1632, tg =  10.08 t/s, tg_3s =   9.79 t/s
  122. 28.16.237.055 I slot print_timing: id  2 | task 1007 | n_decoded =   1662, tg =  10.07 t/s, tg_3s =   9.77 t/s
  123. 28.19.310.685 I slot print_timing: id  2 | task 1007 | n_decoded =   1692, tg =  10.07 t/s, tg_3s =   9.76 t/s
  124. 28.22.383.390 I slot print_timing: id  2 | task 1007 | n_decoded =   1722, tg =  10.06 t/s, tg_3s =   9.76 t/s
  125. 28.25.456.716 I slot print_timing: id  2 | task 1007 | n_decoded =   1752, tg =  10.06 t/s, tg_3s =   9.76 t/s
  126. 28.28.531.515 I slot print_timing: id  2 | task 1007 | n_decoded =   1782, tg =  10.05 t/s, tg_3s =   9.76 t/s
  127. 28.31.607.061 I slot print_timing: id  2 | task 1007 | n_decoded =   1812, tg =  10.05 t/s, tg_3s =   9.75 t/s
  128. 28.34.684.823 I slot print_timing: id  2 | task 1007 | n_decoded =   1842, tg =  10.04 t/s, tg_3s =   9.75 t/s
  129. 28.35.095.928 I slot print_timing: id  2 | task 1007 | prompt eval time =  653189.06 ms / 13323 tokens (   49.03 ms per token,    20.40 tokens per second)
  130. 28.35.095.931 I slot print_timing: id  2 | task 1007 |        eval time =  183852.41 ms /  1846 tokens (   99.60 ms per token,    10.04 tokens per second)
  131. 28.35.095.932 I slot print_timing: id  2 | task 1007 |       total time =  837041.46 ms / 15169 tokens
  132. 28.35.095.933 I slot print_timing: id  2 | task 1007 |    graphs reused =       2822
  133. 28.35.096.930 I slot      release: id  2 | task 1007 | stop processing: n_tokens = 39677, truncated = 0
  134. 30.06.856.933 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, f_sim_best = 0.966 (> 0.100 thold), f_keep = 0.967
  135. 30.06.857.304 I slot launch_slot_: id  2 | task 2860 | processing task, is_child = 0
  136. 31.37.468.258 I slot print_timing: id  2 | task 2860 | n_decoded =    100, tg =  10.02 t/s, tg_3s =  10.02 t/s
  137. 31.40.490.366 I slot print_timing: id  2 | task 2860 | n_decoded =    130, tg =  10.00 t/s, tg_3s =   9.93 t/s
  138. 31.42.000.077 I slot print_timing: id  2 | task 2860 | prompt eval time =   80630.85 ms /  1357 tokens (   59.42 ms per token,    16.83 tokens per second)
  139. 31.42.000.080 I slot print_timing: id  2 | task 2860 |        eval time =   14511.52 ms /   145 tokens (  100.08 ms per token,     9.99 tokens per second)
  140. 31.42.000.080 I slot print_timing: id  2 | task 2860 |       total time =   95142.37 ms /  1502 tokens
  141. 31.42.000.081 I slot print_timing: id  2 | task 2860 |    graphs reused =       2965
  142. 31.42.001.077 I slot      release: id  2 | task 2860 | stop processing: n_tokens = 39854, truncated = 0
  143. 31.42.214.000 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, f_sim_best = 0.726 (> 0.100 thold), f_keep = 1.000
  144. 31.42.214.276 I slot launch_slot_: id  2 | task 3006 | processing task, is_child = 0
  145. 33.47.913.622 I slot print_timing: id  2 | task 3006 | prompt processing, n_tokens =   2048, progress = 0.76, t = 125.70 s / 16.29 tokens per second
  146. 35.58.680.299 I slot print_timing: id  2 | task 3006 | prompt processing, n_tokens =   4096, progress = 0.80, t = 256.47 s / 15.97 tokens per second
  147. 38.13.935.715 I slot print_timing: id  2 | task 3006 | prompt processing, n_tokens =   6144, progress = 0.84, t = 391.72 s / 15.68 tokens per second
  148. /home/yay/.cache/yay/ggml-cuda-git/src/llama.cpp/ggml/src/ggml-cuda/ggml-cuda.cu:106: CUDA error
  149. 39.58.970.675 E CUDA error: out of memory
  150. 39.58.970.678 E   current device: 0, in function alloc at /home/yay/.cache/yay/ggml-cuda-git/src/llama.cpp/ggml/src/ggml-cuda/ggml-cuda.cu:589
  151. 39.58.970.678 E   cuMemCreate(&handle, reserve_size, &prop, 0)
  152. [New LWP 2117]
  153. [New LWP 2116]
  154. [New LWP 2115]
  155. [New LWP 2114]
  156. [New LWP 2113]
  157. [New LWP 2112]
  158. [New LWP 2111]
  159. [New LWP 2085]
  160. [New LWP 2084]
  161. [New LWP 2083]
  162. [New LWP 2082]
  163. [New LWP 2081]
  164. [New LWP 2080]
  165. [New LWP 2079]
  166. [New LWP 2078]
  167. [New LWP 2077]
  168. [New LWP 2076]
  169. [New LWP 2075]
  170. [New LWP 2074]
  171. [New LWP 2073]
  172. [New LWP 2072]
  173. [New LWP 2071]
  174. [New LWP 2070]
  175. [New LWP 2064]
  176. [New LWP 2063]
  177. [New LWP 2059]
  178. [New LWP 2058]
  179. [New LWP 2057]
  180.  
  181. This GDB supports auto-downloading debuginfo from the following URLs:
  182.   <https://debuginfod.archlinux.org>
  183. Enable debuginfod for this session? (y or [n]) [answered N; input not from terminal]
  184. Debuginfod has been disabled.
  185. To make this setting permanent, add 'set debuginfod enabled off' to .gdbinit.
  186. [Thread debugging using libthread_db enabled]
  187. Using host libthread_db library "/usr/lib/libthread_db.so.1".
  188. 0x00007f349dca0952 in ?? () from /usr/lib/libc.so.6
  189. #0  0x00007f349dca0952 in ?? () from /usr/lib/libc.so.6
  190. #1  0x00007f349dd0550b in wait4 () from /usr/lib/libc.so.6
  191. #2  0x00007f349db370ed in ggml_print_backtrace () at /usr/src/debug/ggml-cuda-git/llama.cpp/ggml/src/ggml.c:234
  192. 234        waitpid(child_pid, NULL, 0);
  193. #3  0x00007f349db372c1 in ggml_abort (file=0x7f34932f80a8 "/home/yay/.cache/yay/ggml-cuda-git/src/llama.cpp/ggml/src/ggml-cuda/ggml-cuda.cu", line=106, fmt=0x7f34933920ff "CUDA error") at /usr/src/debug/ggml-cuda-git/llama.cpp/ggml/src/ggml.c:268
  194. 268        ggml_print_backtrace();
  195. #4  0x00007f34924a1291 in ggml_cuda_error(char const*, char const*, char const*, int, char const*) () from /usr/lib/libggml-cuda.so.0
  196. #5  0x00007f34924b9411 in ggml_cuda_pool_vmm::alloc(unsigned long, unsigned long*) () from /usr/lib/libggml-cuda.so.0
  197. #6  0x00007f34924ac837 in ggml_cuda_mul_mat_cublas(ggml_backend_cuda_context&, ggml_tensor const*, ggml_tensor const*, ggml_tensor*) () from /usr/lib/libggml-cuda.so.0
  198. #7  0x00007f34924b629b in ggml_cuda_graph_evaluate_and_capture(ggml_backend_cuda_context*, ggml_cgraph*, bool, bool, void const*) () from /usr/lib/libggml-cuda.so.0
  199. #8  0x00007f34924b6cf2 in ggml_backend_cuda_graph_compute(ggml_backend*, ggml_cgraph*) () from /usr/lib/libggml-cuda.so.0
  200. #9  0x00007f349db593a2 in ggml_backend_sched_compute_splits (sched=<optimized out>) at /usr/src/debug/ggml-cuda-git/llama.cpp/ggml/src/ggml-backend.cpp:1731
  201. 1731               enum ggml_status ec = ggml_backend_graph_compute_async(split_backend, &split->graph);
  202. #10 ggml_backend_sched_graph_compute_async (sched=<optimized out>, graph=<optimized out>) at /usr/src/debug/ggml-cuda-git/llama.cpp/ggml/src/ggml-backend.cpp:1961
  203. 1961       return ggml_backend_sched_compute_splits(sched);
  204. #11 0x00007f349d2d5c32 in llama_context::graph_compute (this=0x55ee80724200, gf=0x55ee83055eb0, batched=<optimized out>) at /usr/include/c++/16/bits/unique_ptr.h:192
  205. 192      pointer    _M_ptr() const noexcept { return std::get<0>(_M_t); }
  206. #12 0x00007f349d2cb05e in llama_context::process_ubatch (this=this@entry=0x55ee80724200, ubatch=..., gtype=<optimized out>, mctx=mctx@entry=0x7f2b780a4f70, ret=@0x7fff211d8af0: GGML_STATUS_SUCCESS) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/src/llama-graph.h:872
  207. 872    ggml_cgraph  * get_gf()  const { return gf; }
  208. #13 0x00007f349d2cfd9d in llama_context::decode (this=<optimized out>, batch_inp=...) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/src/llama-context.cpp:1816
  209. 1816           const auto * res = process_ubatch(ubatch, ctx_type_to_graph_type(cparams.ctx_type), mctx.get(), status);
  210. #14 0x00007f349d2da056 in llama_decode (ctx=<optimized out>, batch=...) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/src/llama-context.cpp:4131
  211. 4131       const int ret = ctx->decode(batch);
  212. #15 0x00007f349e18fbbe in server_context_impl::decode (this=<optimized out>, n_batch=<synthetic pointer>: <optimized out>, off=<optimized out>, batch_view=...) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/tools/server/server-context.cpp:3664
  213. 3664           const int ret = llama_decode(ctx_tgt, batch_view);
  214. #16 server_context_impl::update_slots (this=<optimized out>) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/tools/server/server-context.cpp:2884
  215. 2884                   bool ok = decode(n_batch, off, batch_view);
  216. #17 0x00007f349e14dad3 in std::function<void()>::operator() (this=<optimized out>, this=<optimized out>) at /usr/include/c++/16/bits/std_function.h:581
  217. 581     return _M_invoker(_M_functor, std::forward<_ArgTypes>(__args)...);
  218. #18 server_queue::start_loop (this=0x55ee813ef7a8, idle_sleep_ms=<optimized out>) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/tools/server/server-queue.cpp:163
  219. 163        callback_update_slots();
  220. #19 0x00007f349e0ee55e in llama_server (params=..., argc=argc@entry=26, argv=argv@entry=0x7fff211e2368) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/tools/server/server.cpp:520
  221. 520        ctx_server.start_loop();
  222. #20 0x00007f349e0ef555 in llama_server (argc=26, argv=0x7fff211e2368) at /usr/src/debug/llama.cpp-cuda-git/llama.cpp/tools/server/server.cpp:112
  223. 112    return llama_server(params, argc, argv);
  224. #21 0x00007f349dc27781 in ?? () from /usr/lib/libc.so.6
  225. #22 0x00007f349dc278b9 in __libc_start_main () from /usr/lib/libc.so.6
  226. #23 0x000055ee40e8f055 in _start ()
  227. [Inferior 1 (process 2055) detached]
  228. ^C^C^C^C^C^C^C^CУбито
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!