API tools faq
paste
Guest User

Untitled

a guest
Oct 22nd, 2023
21
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 7.00 KB | None | 0 0
raw download clone embed print report
  1. 1|start_linux | 2023-10-22 10:41:45 INFO:Loading TheBloke_CodeLlama-7B-Instruct-GPTQ...
  2. 1|start_linux | 2023-10-22 10:41:45 INFO:The AutoGPTQ params are: {'model_basename': 'model', 'device': 'cuda:0', 'use_triton': False, 'inject_fused_attention': True, 'inject_fused_mlp': True, 'use_safetensors': True, 'trust_remote_code': False, 'max_memory': {0: '5010MiB', 'cpu': '99GiB'}, 'quantize_config': None, 'use_cuda_fp16': True, 'disable_exllama': False}
  3. 1|start_linux | 2023-10-22 10:41:46 WARNING:skip module injection for FusedLlamaMLPForQuantizedModel not support integrate without triton yet.
  4. 1|start_linux | 2023-10-22 10:41:46 INFO:Loaded the model in 1.11 seconds.
  5. 1|start_linux | Traceback (most recent call last):
  6. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/modules/callbacks.py", line 56, in gentask
  7. 1|start_linux | ret = self.mfunc(callback=_callback, *args, **self.kwargs)
  8. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  9. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/modules/text_generation.py", line 351, in generate_with_callback
  10. 1|start_linux | shared.model.generate(**kwargs)
  11. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/auto_gptq/modeling/_base.py", line 443, in generate
  12. 1|start_linux | return self.model.generate(**kwargs)
  13. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  14. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
  15. 1|start_linux | return func(*args, **kwargs)
  16. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^
  17. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/generation/utils.py", line 1652, in generate
  18. 1|start_linux | return self.sample(
  19. 1|start_linux | ^^^^^^^^^^^^
  20. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/generation/utils.py", line 2734, in sample
  21. 1|start_linux | outputs = self(
  22. 1|start_linux | ^^^^^
  23. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
  24. 1|start_linux | return self._call_impl(*args, **kwargs)
  25. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  26. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
  27. 1|start_linux | return forward_call(*args, **kwargs)
  28. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  29. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 1038, in forward
  30. 1|start_linux | outputs = self.model(
  31. 1|start_linux | ^^^^^^^^^^^
  32. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
  33. 1|start_linux | return self._call_impl(*args, **kwargs)
  34. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  35. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
  36. 1|start_linux | return forward_call(*args, **kwargs)
  37. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  38. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 925, in forward
  39. 1|start_linux | layer_outputs = decoder_layer(
  40. 1|start_linux | ^^^^^^^^^^^^^^
  41. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
  42. 1|start_linux | return self._call_impl(*args, **kwargs)
  43. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  44. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
  45. 1|start_linux | return forward_call(*args, **kwargs)
  46. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  47. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/transformers/models/llama/modeling_llama.py", line 635, in forward
  48. 1|start_linux | hidden_states, self_attn_weights, present_key_value = self.self_attn(
  49. 1|start_linux | ^^^^^^^^^^^^^^^
  50. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
  51. 1|start_linux | return self._call_impl(*args, **kwargs)
  52. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  53. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
  54. 1|start_linux | return forward_call(*args, **kwargs)
  55. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  56. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/auto_gptq/nn_modules/fused_llama_attn.py", line 53, in forward
  57. 1|start_linux | qkv_states = self.qkv_proj(hidden_states)
  58. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  59. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1518, in _wrapped_call_impl
  60. 1|start_linux | return self._call_impl(*args, **kwargs)
  61. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  62. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/torch/nn/modules/module.py", line 1527, in _call_impl
  63. 1|start_linux | return forward_call(*args, **kwargs)
  64. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  65. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/auto_gptq/nn_modules/qlinear/qlinear_exllama.py", line 167, in forward
  66. 1|start_linux | out = ext_q4_matmul(x.half(), self.q4, self.width)
  67. 1|start_linux | ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  68. 1|start_linux | File "/mnt/Projets/selfGPT/text-generation-webui/installer_files/env/lib/python3.11/site-packages/auto_gptq/nn_modules/qlinear/qlinear_exllama.py", line 38, in ext_q4_matmul
  69. 1|start_linux | q4_matmul(x, q4, output)
  70. 1|start_linux | RuntimeError: CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling `cublasCreate(handle)`
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!