Guest User

Untitled

a guest
Jan 17th, 2024
64
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.51 KB | None | 0 0
  1. File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/transformers/generation/utils.py", line 1455, in generate
  2. return self.assisted_decoding(
  3. File "/home/supermicro/miniconda3/envs/nvidia/lib/python3.10/site-packages/transformers/generation/utils.py", line 4397, in assisted_decoding
  4. n_matches = ((~(candidate_new_tokens == selected_tokens[:, :-1])).cumsum(dim=-1) < 1).sum()
  5. RuntimeError: The size of tensor a (10) must match the size of tensor b (0) at non-singleton dimension 1
Advertisement
Add Comment
Please, Sign In to add comment