Guest User

Untitled

a guest
Jan 17th, 2024
97
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.98 KB | None | 0 0
  1. Traceback (most recent call last):
  2. File "/home/supermicro/ai/text-generation-webui-testing/modules/callbacks.py", line 61, in gentask
  3. ret = self.mfunc(callback=_callback, *args, **self.kwargs)
  4. File "/home/supermicro/ai/text-generation-webui-testing/modules/text_generation.py", line 378, in generate_with_callback
  5. shared.model.generate(**kwargs)
  6. File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
  7. return func(*args, **kwargs)
  8. File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/transformers/generation/utils.py", line 1455, in generate
  9. return self.assisted_decoding(
  10. File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/transformers/generation/utils.py", line 4338, in assisted_decoding
  11. .ne(eos_token_id_tensor.unsqueeze(1))
  12. RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!
  13.  
Advertisement
Add Comment
Please, Sign In to add comment