Advertisement
Guest User

llm-python-embedding.py

a guest
Sep 18th, 2024
23
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
Python 0.45 KB | None | 0 0
  1. #!/bin/python3
  2.  
  3. import sys
  4. # Example: reuse your existing OpenAI setup
  5. from openai import OpenAI
  6.  
  7. prompt = sys.argv[1]
  8. prompt = prompt.strip().lower().replace(',', '')
  9. # Point to the local server
  10. client = OpenAI(base_url="http://localhost:9090/v1", api_key="lm-studio")
  11.  
  12. completion = client.embeddings.create(
  13.   model="nomic-embed-text-v1.5.q8_0",
  14.   input=[
  15.     prompt
  16.   ],
  17. )
  18.  
  19. print(f"\"{prompt}\",\"{completion.data[0].embedding}\"")
  20.  
  21.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement