Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- Traceback (most recent call last):
- File "/home/supermicro/ai/text-generation-webui-testing/modules/callbacks.py", line 61, in gentask
- ret = self.mfunc(callback=_callback, *args, **self.kwargs)
- File "/home/supermicro/ai/text-generation-webui-testing/modules/text_generation.py", line 378, in generate_with_callback
- shared.model.generate(**kwargs)
- File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
- return func(*args, **kwargs)
- File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/transformers/generation/utils.py", line 1455, in generate
- return self.assisted_decoding(
- File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/transformers/generation/utils.py", line 4338, in assisted_decoding
- .ne(eos_token_id_tensor.unsqueeze(1))
- RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1!
Advertisement
Add Comment
Please, Sign In to add comment