INFO:     172.17.0.2:38978 - "GET /v1/models HTTP/1.1" 200
INFO:     172.17.0.2:38980 - "GET /v1/models HTTP/1.1" 200
INFO:     172.17.0.2:42302 - "POST /v1/chat/completions HTTP/1.1" 200
INFO:     Prompt:
INFO:
INFO:
INFO:     <|im_start|>user
INFO:     whats a frog?<|im_end|>
INFO:     <|im_start|>assistant
INFO:
INFO:     Response:
INFO:     A frog is a type of amphibian, which means it's an animal that lives
both on land and in water. Frogs are typically characterized by their moist,
smooth skin, long hind legs with webbed feet, and large eyes on the top of their
heads. They start their life as tadpoles in water, then metamorphose into adults
that can live on land. Frogs are found all over the world, on every continent
except Antarctica. There are more than 5,000 species of frogs, making them one
of the most diverse groups of vertebrates. Frogs play a crucial role in the food
chain and in the ecosystem as they eat insects and other small animals and serve
as a food source for larger animals. However, many frog species are currently
facing threats due to habitat loss, pollution, climate change, and disease.
INFO:
INFO:     Metrics: 195 tokens generated in 10.12 seconds (19.27 T/s, context 37
tokens)