Advertisement
mhdew

gemma_download

Mar 29th, 2024
730
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 0.49 KB | None | 0 0
  1. from transformers import AutoTokenizer, AutoModelForCausalLM
  2. import torch
  3.  
  4. tokenizer = AutoTokenizer.from_pretrained("google/gemma-2b-it", token="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")
  5. model = AutoModelForCausalLM.from_pretrained("google/gemma-2b-it",
  6.                                              token="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",
  7.                                              torch_dtype=torch.bfloat16)
  8.  
  9. tokenizer.save_pretrained('gemma_2d_it')
  10. model.save_pretrained('gemma_2d_it')
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement