Chille9

qwe35b q5 mtp 16Gbvram 32gb ram

May 11th, 2026
95
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 0.44 KB | None | 0 0
  1. @echo off
  2. start llama-server ^
  3. -m models/Qwen3.6-35B-A3B-MTP-UD-Q5_K_XL.gguf ^
  4. -fitt 1024 ^
  5. -c 98072 ^
  6. -n 32768 ^
  7. -fa on ^
  8. -np 1 ^
  9. -ctk q8_0 ^
  10. -ctv q8_0 ^
  11. -ctkd q8_0 ^
  12. -ctvd q8_0 ^
  13. -ctxcp 64 ^
  14. --no-mmap ^
  15. --mlock ^
  16. --no-warmup ^
  17. --spec-type mtp ^
  18. --spec-draft-n-max 2 ^
  19. --chat-template-kwargs "{\"preserve_thinking\": true}" ^
  20. --temp 0.6 ^
  21. --top-p 0.95 ^
  22. --top-k 20 ^
  23. --min-p 0.0 ^
  24. --presence-penalty 0.0 ^
  25. --repeat-penalty 1.0
Advertisement
Add Comment
Please, Sign In to add comment