> llm_benchmark run
Total memory size : 31.72 GB
cpu_info: 13th Gen Intel(R) Core(TM) i9-13900K
gpu_info: NVIDIA GeForce RTX 3080 Ti
os_version: Microsoft Windows 11 Pro

ollama_version: 0.5.9
----------
LLM models file path：C:\Users\mark3\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.11_qbz5n2kfra8p0\LocalCache\local-packages\Python311\site-packages\llm_benchmark\data\benchmark_models_32gb_ram.yml
Checking and pulling the following LLM models
phi4:14b
deepseek-r1:14b
deepseek-r1:32b
----------
model_name =    phi4:14b
prompt = Write a step-by-step guide on how to bake a chocolate cake from scratch.
eval rate:            13.98 tokens/s
prompt = Develop a python function that solves the following problem, sudoku game
eval rate:            13.73 tokens/s
prompt = Create a dialogue between two characters that discusses economic crisis
eval rate:            13.60 tokens/s
prompt = In a forest, there are brave lions living there. Please continue the story.
eval rate:            13.81 tokens/s
prompt = I'd like to book a flight for 4 to Seattle in U.S.
eval rate:            14.51 tokens/s
--------------------
Average of eval rate:  13.926  tokens/s
----------------------------------------
model_name =    deepseek-r1:14b
prompt = Summarize the key differences between classical and operant conditioning in psychology.
eval rate:            12.98 tokens/s
prompt = Translate the following English paragraph into Chinese and elaborate more -> Artificial intelligence is transforming various industries by enhancing efficiency and enabling new capabilities.
eval rate:            12.79 tokens/s
prompt = What are the main causes of the American Civil War?
eval rate:            12.37 tokens/s
prompt = How does photosynthesis contribute to the carbon cycle?
eval rate:            12.38 tokens/s
prompt = Develop a python function that solves the following problem, sudoku game.
eval rate:            11.90 tokens/s
--------------------
Average of eval rate:  12.484  tokens/s
----------------------------------------
model_name =    deepseek-r1:32b
prompt = Summarize the key differences between classical and operant conditioning in psychology.
eval rate:            4.02 tokens/s
prompt = Translate the following English paragraph into Chinese and elaborate more -> Artificial intelligence is transforming various industries by enhancing efficiency and enabling new capabilities.
eval rate:            3.91 tokens/s
prompt = What are the main causes of the American Civil War?
eval rate:            3.94 tokens/s
prompt = How does photosynthesis contribute to the carbon cycle?
eval rate:            4.04 tokens/s
prompt = Develop a python function that solves the following problem, sudoku game.
eval rate:            3.85 tokens/s
--------------------
Average of eval rate:  3.952  tokens/s
----------------------------------------