API tools faq
paste
Guest User

Untitled

a guest
Jan 16th, 2025
99
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 30.54 KB | None | 0 0
raw download clone embed print report
  1. ❯ docker compose up
  2. [+] Running 2/0
  3. ✔ Container ollama-ollama-1 Created 0.0s
  4. ✔ Container ollama-webui-1 Created 0.0s
  5. Attaching to ollama-1, webui-1
  6. ollama-1 | 2025/01/16 22:28:14 routes.go:1187: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES:0 HSA_OVERRIDE_GFX_VERSION:10.3.1 HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://0.0.0.0:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:5m0s OLLAMA_KV_CACHE_TYPE: OLLAMA_LLM_LIBRARY:rocm_v60102 OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:0 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/root/.ollama/models OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:0 OLLAMA_ORIGINS:[http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://* vscode-webview://*] OLLAMA_SCHED_SPREAD:false ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
  7. ollama-1 | time=2025-01-16T22:28:14.081Z level=INFO source=images.go:432 msg="total blobs: 5"
  8. ollama-1 | time=2025-01-16T22:28:14.081Z level=INFO source=images.go:439 msg="total unused blobs removed: 0"
  9. ollama-1 | [GIN-debug] [WARNING] Creating an Engine instance with the Logger and Recovery middleware already attached.
  10. ollama-1 |
  11. ollama-1 | [GIN-debug] [WARNING] Running in "debug" mode. Switch to "release" mode in production.
  12. ollama-1 | - using env: export GIN_MODE=release
  13. ollama-1 | - using code: gin.SetMode(gin.ReleaseMode)
  14. ollama-1 |
  15. ollama-1 | [GIN-debug] POST /api/pull --> github.com/ollama/ollama/server.(*Server).PullHandler-fm (5 handlers)
  16. ollama-1 | [GIN-debug] POST /api/generate --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (5 handlers)
  17. ollama-1 | [GIN-debug] POST /api/chat --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (5 handlers)
  18. ollama-1 | [GIN-debug] POST /api/embed --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (5 handlers)
  19. ollama-1 | [GIN-debug] POST /api/embeddings --> github.com/ollama/ollama/server.(*Server).EmbeddingsHandler-fm (5 handlers)
  20. ollama-1 | [GIN-debug] POST /api/create --> github.com/ollama/ollama/server.(*Server).CreateHandler-fm (5 handlers)
  21. ollama-1 | [GIN-debug] POST /api/push --> github.com/ollama/ollama/server.(*Server).PushHandler-fm (5 handlers)
  22. ollama-1 | [GIN-debug] POST /api/copy --> github.com/ollama/ollama/server.(*Server).CopyHandler-fm (5 handlers)
  23. ollama-1 | [GIN-debug] DELETE /api/delete --> github.com/ollama/ollama/server.(*Server).DeleteHandler-fm (5 handlers)
  24. ollama-1 | [GIN-debug] POST /api/show --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (5 handlers)
  25. ollama-1 | [GIN-debug] POST /api/blobs/:digest --> github.com/ollama/ollama/server.(*Server).CreateBlobHandler-fm (5 handlers)
  26. ollama-1 | [GIN-debug] HEAD /api/blobs/:digest --> github.com/ollama/ollama/server.(*Server).HeadBlobHandler-fm (5 handlers)
  27. ollama-1 | [GIN-debug] GET /api/ps --> github.com/ollama/ollama/server.(*Server).PsHandler-fm (5 handlers)
  28. ollama-1 | [GIN-debug] POST /v1/chat/completions --> github.com/ollama/ollama/server.(*Server).ChatHandler-fm (6 handlers)
  29. ollama-1 | [GIN-debug] POST /v1/completions --> github.com/ollama/ollama/server.(*Server).GenerateHandler-fm (6 handlers)
  30. ollama-1 | [GIN-debug] POST /v1/embeddings --> github.com/ollama/ollama/server.(*Server).EmbedHandler-fm (6 handlers)
  31. ollama-1 | [GIN-debug] GET /v1/models --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (6 handlers)
  32. ollama-1 | [GIN-debug] GET /v1/models/:model --> github.com/ollama/ollama/server.(*Server).ShowHandler-fm (6 handlers)
  33. ollama-1 | [GIN-debug] GET / --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
  34. ollama-1 | [GIN-debug] GET /api/tags --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
  35. ollama-1 | [GIN-debug] GET /api/version --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
  36. ollama-1 | [GIN-debug] HEAD / --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func1 (5 handlers)
  37. ollama-1 | [GIN-debug] HEAD /api/tags --> github.com/ollama/ollama/server.(*Server).ListHandler-fm (5 handlers)
  38. ollama-1 | [GIN-debug] HEAD /api/version --> github.com/ollama/ollama/server.(*Server).GenerateRoutes.func2 (5 handlers)
  39. ollama-1 | time=2025-01-16T22:28:14.081Z level=INFO source=routes.go:1238 msg="Listening on [::]:11434 (version 0.5.6-0-g2539f2d-dirty)"
  40. ollama-1 | time=2025-01-16T22:28:14.081Z level=DEBUG source=common.go:80 msg="runners located" dir=/usr/lib/ollama/runners
  41. ollama-1 | time=2025-01-16T22:28:14.081Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/cpu_avx/ollama_llama_server
  42. ollama-1 | time=2025-01-16T22:28:14.081Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/cpu_avx2/ollama_llama_server
  43. ollama-1 | time=2025-01-16T22:28:14.081Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/rocm_avx/ollama_llama_server
  44. ollama-1 | time=2025-01-16T22:28:14.081Z level=INFO source=routes.go:1267 msg="Dynamic LLM libraries" runners="[cpu cpu_avx cpu_avx2 rocm_avx]"
  45. ollama-1 | time=2025-01-16T22:28:14.081Z level=DEBUG source=routes.go:1268 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
  46. ollama-1 | time=2025-01-16T22:28:14.081Z level=DEBUG source=sched.go:105 msg="starting llm scheduler"
  47. ollama-1 | time=2025-01-16T22:28:14.082Z level=INFO source=gpu.go:226 msg="looking for compatible GPUs"
  48. ollama-1 | time=2025-01-16T22:28:14.083Z level=DEBUG source=gpu.go:99 msg="searching for GPU discovery libraries for NVIDIA"
  49. ollama-1 | time=2025-01-16T22:28:14.083Z level=DEBUG source=gpu.go:517 msg="Searching for GPU library" name=libcuda.so*
  50. ollama-1 | time=2025-01-16T22:28:14.083Z level=DEBUG source=gpu.go:543 msg="gpu library search" globs="[/usr/lib/ollama/libcuda.so* /usr/lib/ollama/libcuda.so* /libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
  51. ollama-1 | time=2025-01-16T22:28:14.083Z level=DEBUG source=gpu.go:576 msg="discovered GPU libraries" paths=[]
  52. ollama-1 | time=2025-01-16T22:28:14.083Z level=DEBUG source=gpu.go:517 msg="Searching for GPU library" name=libcudart.so*
  53. ollama-1 | time=2025-01-16T22:28:14.083Z level=DEBUG source=gpu.go:543 msg="gpu library search" globs="[/usr/lib/ollama/libcudart.so* /usr/lib/ollama/libcudart.so* /libcudart.so* /usr/lib/ollama/libcudart.so* /usr/lib/ollama/libcudart.so* /usr/local/cuda/lib64/libcudart.so* /usr/lib/x86_64-linux-gnu/nvidia/current/libcudart.so* /usr/lib/x86_64-linux-gnu/libcudart.so* /usr/lib/wsl/lib/libcudart.so* /usr/lib/wsl/drivers/*/libcudart.so* /opt/cuda/lib64/libcudart.so* /usr/local/cuda*/targets/aarch64-linux/lib/libcudart.so* /usr/lib/aarch64-linux-gnu/nvidia/current/libcudart.so* /usr/lib/aarch64-linux-gnu/libcudart.so* /usr/local/cuda/lib*/libcudart.so* /usr/lib*/libcudart.so* /usr/local/lib*/libcudart.so*]"
  54. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=gpu.go:576 msg="discovered GPU libraries" paths=[]
  55. ollama-1 | time=2025-01-16T22:28:14.084Z level=WARN source=amd_linux.go:61 msg="ollama recommends running the https://www.amd.com/en/support/linux-drivers" error="amdgpu version file missing: /sys/module/amdgpu/version stat /sys/module/amdgpu/version: no such file or directory"
  56. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:102 msg="evaluating amdgpu node /sys/class/kfd/kfd/topology/nodes/0/properties"
  57. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:122 msg="detected CPU /sys/class/kfd/kfd/topology/nodes/0/properties"
  58. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:102 msg="evaluating amdgpu node /sys/class/kfd/kfd/topology/nodes/1/properties"
  59. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:207 msg="mapping amdgpu to drm sysfs nodes" amdgpu=/sys/class/kfd/kfd/topology/nodes/1/properties vendor=4098 device=29663 unique_id=0
  60. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:241 msg=matched amdgpu=/sys/class/kfd/kfd/topology/nodes/1/properties drm=/sys/class/drm/card1/device
  61. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:319 msg="amdgpu memory" gpu=0 total="12.0 GiB"
  62. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_linux.go:320 msg="amdgpu memory" gpu=0 available="10.3 GiB"
  63. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_common.go:18 msg="evaluating potential rocm lib dir /usr/lib/ollama"
  64. ollama-1 | time=2025-01-16T22:28:14.084Z level=DEBUG source=amd_common.go:48 msg="detected ROCM next to ollama executable /usr/lib/ollama"
  65. ollama-1 | time=2025-01-16T22:28:14.084Z level=INFO source=amd_linux.go:391 msg="skipping rocm gfx compatibility check" HSA_OVERRIDE_GFX_VERSION=10.3.1
  66. ollama-1 | time=2025-01-16T22:28:14.084Z level=INFO source=types.go:131 msg="inference compute" id=0 library=rocm variant="" compute=gfx1031 driver=0.0 name=1002:73df total="12.0 GiB" available="10.3 GiB"
  67. webui-1 | Loading WEBUI_SECRET_KEY from file, not provided as an environment variable.
  68. webui-1 | Loading WEBUI_SECRET_KEY from .webui_secret_key
  69. webui-1 | /app/backend/open_webui
  70. webui-1 | /app/backend
  71. webui-1 | /app
  72. webui-1 | Running migrations
  73. webui-1 | INFO [alembic.runtime.migration] Context impl SQLiteImpl.
  74. webui-1 | INFO [alembic.runtime.migration] Will assume non-transactional DDL.
  75. webui-1 | INFO [open_webui.env] 'ENABLE_SIGNUP' loaded from the latest database entry
  76. webui-1 | INFO [open_webui.env] 'DEFAULT_LOCALE' loaded from the latest database entry
  77. webui-1 | INFO [open_webui.env] 'DEFAULT_PROMPT_SUGGESTIONS' loaded from the latest database entry
  78. webui-1 | WARNI [open_webui.env]
  79. webui-1 |
  80. webui-1 | WARNING: CORS_ALLOW_ORIGIN IS SET TO '*' - NOT RECOMMENDED FOR PRODUCTION DEPLOYMENTS.
  81. webui-1 |
  82. webui-1 | INFO [open_webui.env] 'ENABLE_GOOGLE_DRIVE_INTEGRATION' loaded from the latest database entry
  83. webui-1 | INFO [open_webui.env] 'ENABLE_RAG_WEB_LOADER_SSL_VERIFICATION' loaded from the latest database entry
  84. webui-1 | INFO [open_webui.env] 'PDF_EXTRACT_IMAGES' loaded from the latest database entry
  85. webui-1 | INFO [open_webui.env] Embedding model set: sentence-transformers/all-MiniLM-L6-v2
  86. webui-1 | INFO [open_webui.env] 'YOUTUBE_LOADER_LANGUAGE' loaded from the latest database entry
  87. webui-1 | INFO [open_webui.env] 'YOUTUBE_LOADER_PROXY_URL' loaded from the latest database entry
  88. webui-1 | INFO [open_webui.env] 'ENABLE_RAG_WEB_SEARCH' loaded from the latest database entry
  89. webui-1 | INFO [open_webui.env] 'RAG_WEB_SEARCH_ENGINE' loaded from the latest database entry
  90. webui-1 | INFO [open_webui.env] 'SEARXNG_QUERY_URL' loaded from the latest database entry
  91. webui-1 | INFO [open_webui.env] 'GOOGLE_PSE_API_KEY' loaded from the latest database entry
  92. webui-1 | INFO [open_webui.env] 'GOOGLE_PSE_ENGINE_ID' loaded from the latest database entry
  93. webui-1 | INFO [open_webui.env] 'BRAVE_SEARCH_API_KEY' loaded from the latest database entry
  94. webui-1 | INFO [open_webui.env] 'KAGI_SEARCH_API_KEY' loaded from the latest database entry
  95. webui-1 | INFO [open_webui.env] 'MOJEEK_SEARCH_API_KEY' loaded from the latest database entry
  96. webui-1 | INFO [open_webui.env] 'SERPSTACK_API_KEY' loaded from the latest database entry
  97. webui-1 | INFO [open_webui.env] 'SERPSTACK_HTTPS' loaded from the latest database entry
  98. webui-1 | INFO [open_webui.env] 'SERPER_API_KEY' loaded from the latest database entry
  99. webui-1 | INFO [open_webui.env] 'SERPLY_API_KEY' loaded from the latest database entry
  100. webui-1 | INFO [open_webui.env] 'TAVILY_API_KEY' loaded from the latest database entry
  101. webui-1 | INFO [open_webui.env] 'JINA_API_KEY' loaded from the latest database entry
  102. webui-1 | INFO [open_webui.env] 'SEARCHAPI_API_KEY' loaded from the latest database entry
  103. webui-1 | INFO [open_webui.env] 'SEARCHAPI_ENGINE' loaded from the latest database entry
  104. webui-1 | INFO [open_webui.env] 'BING_SEARCH_V7_ENDPOINT' loaded from the latest database entry
  105. webui-1 | INFO [open_webui.env] 'BING_SEARCH_V7_SUBSCRIPTION_KEY' loaded from the latest database entry
  106. webui-1 | INFO [open_webui.env] 'RAG_WEB_SEARCH_RESULT_COUNT' loaded from the latest database entry
  107. webui-1 | INFO [open_webui.env] 'RAG_WEB_SEARCH_CONCURRENT_REQUESTS' loaded from the latest database entry
  108. webui-1 | WARNI [langchain_community.utils.user_agent] USER_AGENT environment variable not set, consider setting it to identify your requests.
  109. webui-1 |
  110. webui-1 | ___ __ __ _ _ _ ___
  111. webui-1 | / _ \ _ __ ___ _ __ \ \ / /__| |__ | | | |_ _|
  112. webui-1 | | | | | '_ \ / _ \ '_ \ \ \ /\ / / _ \ '_ \| | | || |
  113. webui-1 | | |_| | |_) | __/ | | | \ V V / __/ |_) | |_| || |
  114. webui-1 | \___/| .__/ \___|_| |_| \_/\_/ \___|_.__/ \___/|___|
  115. webui-1 | |_|
  116. webui-1 |
  117. webui-1 |
  118. webui-1 | v0.5.4 - building the best open-source AI user interface.
  119. webui-1 |
  120. webui-1 | https://github.com/open-webui/open-webui
  121. webui-1 |
  122. Fetching 30 files: 100%|██████████| 30/30 [00:00<00:00, 215830.39it/s]
  123. webui-1 | INFO: Started server process [1]
  124. webui-1 | INFO: Waiting for application startup.
  125. webui-1 | INFO: Application startup complete.
  126. webui-1 | INFO: Uvicorn running on http://0.0.0.0:8080 (Press CTRL+C to quit)
  127. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/chats/7ceb53fa-bf75-4bd8-af0e-cc7911ac42d2 HTTP/1.1" 200 OK
  128. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/chats/7ceb53fa-bf75-4bd8-af0e-cc7911ac42d2 HTTP/1.1" 200 OK
  129. webui-1 | INFO: 172.18.0.1:42626 - "POST /api/v1/folders/ HTTP/1.1" 200 OK
  130. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/folders/ HTTP/1.1" 200 OK
  131. webui-1 | INFO: 172.18.0.1:42626 - "POST /api/v1/folders/093925be-01e3-456a-b762-6fcc0b76112a/update/expanded HTTP/1.1" 200 OK
  132. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/users/user/settings HTTP/1.1" 200 OK
  133. webui-1 | INFO: 172.18.0.1:42626 - "POST /api/v1/chats/new HTTP/1.1" 200 OK
  134. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
  135. webui-1 | INFO: 172.18.0.1:42626 - "POST /api/v1/chats/24530012-6546-43fd-a519-8eed1f54bf8b HTTP/1.1" 200 OK
  136. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
  137. webui-1 | INFO [open_webui.routers.openai] get_all_models()
  138. webui-1 | INFO [open_webui.routers.ollama] get_all_models()
  139. ollama-1 | [GIN] 2025/01/16 - 22:28:30 | 200 | 253.137µs | 172.18.0.3 | GET "/api/tags"
  140. ollama-1 | time=2025-01-16T22:28:30.720Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.7 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.2 GiB" now.free_swap="7.5 GiB"
  141. ollama-1 | time=2025-01-16T22:28:30.720Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  142. ollama-1 | time=2025-01-16T22:28:30.720Z level=DEBUG source=sched.go:181 msg="updating default concurrency" OLLAMA_MAX_LOADED_MODELS=0x5621cb2694c0 gpu_count=1
  143. ollama-1 | time=2025-01-16T22:28:30.733Z level=DEBUG source=sched.go:224 msg="loading first model" model=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  144. ollama-1 | time=2025-01-16T22:28:30.733Z level=DEBUG source=memory.go:107 msg=evaluating library=rocm gpu_count=1 available="[10.3 GiB]"
  145. ollama-1 | time=2025-01-16T22:28:30.733Z level=DEBUG source=memory.go:107 msg=evaluating library=rocm gpu_count=1 available="[10.3 GiB]"
  146. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=memory.go:107 msg=evaluating library=rocm gpu_count=1 available="[10.3 GiB]"
  147. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=memory.go:107 msg=evaluating library=rocm gpu_count=1 available="[10.3 GiB]"
  148. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.2 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.2 GiB" now.free_swap="7.5 GiB"
  149. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  150. ollama-1 | time=2025-01-16T22:28:30.734Z level=INFO source=server.go:104 msg="system memory" total="62.5 GiB" free="45.2 GiB" free_swap="7.5 GiB"
  151. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=memory.go:107 msg=evaluating library=rocm gpu_count=1 available="[10.3 GiB]"
  152. ollama-1 | time=2025-01-16T22:28:30.734Z level=INFO source=memory.go:356 msg="offload to rocm" layers.requested=-1 layers.model=41 layers.offload=28 layers.split="" memory.available="[10.3 GiB]" memory.gpu_overhead="0 B" memory.required.full="14.1 GiB" memory.required.partial="10.3 GiB" memory.required.kv="3.1 GiB" memory.required.allocations="[10.3 GiB]" memory.weights.total="10.8 GiB" memory.weights.repeating="10.4 GiB" memory.weights.nonrepeating="402.0 MiB" memory.graph.full="2.0 GiB" memory.graph.partial="2.0 GiB"
  153. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/cpu_avx/ollama_llama_server
  154. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/cpu_avx2/ollama_llama_server
  155. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/rocm_avx/ollama_llama_server
  156. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/cpu_avx/ollama_llama_server
  157. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/cpu_avx2/ollama_llama_server
  158. ollama-1 | time=2025-01-16T22:28:30.734Z level=DEBUG source=common.go:124 msg="availableServers : found" file=/usr/lib/ollama/runners/rocm_avx/ollama_llama_server
  159. ollama-1 | time=2025-01-16T22:28:30.734Z level=INFO source=server.go:158 msg="Invalid OLLAMA_LLM_LIBRARY rocm_v60102 - not found"
  160. ollama-1 | time=2025-01-16T22:28:30.735Z level=INFO source=server.go:376 msg="starting llama server" cmd="/usr/lib/ollama/runners/rocm_avx/ollama_llama_server runner --model /root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20 --ctx-size 16000 --batch-size 512 --n-gpu-layers 28 --verbose --threads 12 --parallel 1 --port 45047"
  161. ollama-1 | time=2025-01-16T22:28:30.735Z level=DEBUG source=server.go:393 msg=subprocess environment="[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin HIP_VISIBLE_DEVICES=0 HSA_OVERRIDE_GFX_VERSION=\"10.3.1\" LD_LIBRARY_PATH=/usr/lib/ollama:/usr/lib/ollama:/usr/lib/ollama:/usr/lib/ollama/runners/rocm_avx ROCR_VISIBLE_DEVICES=0]"
  162. ollama-1 | time=2025-01-16T22:28:30.735Z level=INFO source=sched.go:449 msg="loaded runners" count=1
  163. ollama-1 | time=2025-01-16T22:28:30.735Z level=INFO source=server.go:555 msg="waiting for llama runner to start responding"
  164. ollama-1 | time=2025-01-16T22:28:30.735Z level=INFO source=server.go:589 msg="waiting for server to become available" status="llm server error"
  165. ollama-1 | time=2025-01-16T22:28:30.771Z level=INFO source=runner.go:936 msg="starting go runner"
  166. ollama-1 | /opt/amdgpu/share/libdrm/amdgpu.ids: No such file or directory
  167. ollama-1 |
  168. ollama-1 | rocBLAS error: Could not initialize Tensile host: No devices found
  169. ollama-1 | time=2025-01-16T22:28:31.117Z level=DEBUG source=server.go:416 msg="llama runner terminated" error="signal: aborted (core dumped)"
  170. ollama-1 | time=2025-01-16T22:28:31.236Z level=ERROR source=sched.go:455 msg="error loading llama server" error="llama runner process has terminated: error:Could not initialize Tensile host: No devices found"
  171. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=sched.go:458 msg="triggering expiration for failed load" model=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  172. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=sched.go:360 msg="runner expired event received" modelPath=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  173. webui-1 | INFO: 172.18.0.1:42626 - "POST /api/chat/completions HTTP/1.1" 400 Bad Request
  174. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=sched.go:375 msg="got lock to unload" modelPath=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  175. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.2 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.2 GiB" now.free_swap="7.5 GiB"
  176. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  177. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=server.go:1079 msg="stopping llama server"
  178. ollama-1 | time=2025-01-16T22:28:31.236Z level=DEBUG source=sched.go:380 msg="runner released" modelPath=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  179. ollama-1 | [GIN] 2025/01/16 - 22:28:31 | 500 | 523.185238ms | 172.18.0.3 | POST "/api/chat"
  180. webui-1 | INFO: 172.18.0.1:42626 - "GET /api/v1/chats/?page=1 HTTP/1.1" 200 OK
  181. ollama-1 | time=2025-01-16T22:28:31.487Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.2 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.2 GiB" now.free_swap="7.5 GiB"
  182. ollama-1 | time=2025-01-16T22:28:31.487Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  183. ollama-1 | time=2025-01-16T22:28:31.737Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.2 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.2 GiB" now.free_swap="7.5 GiB"
  184. ollama-1 | time=2025-01-16T22:28:31.737Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  185. ollama-1 | time=2025-01-16T22:28:31.987Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.2 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.2 GiB" now.free_swap="7.5 GiB"
  186. ollama-1 | time=2025-01-16T22:28:31.987Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  187. ollama-1 | time=2025-01-16T22:28:32.237Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.2 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  188. ollama-1 | time=2025-01-16T22:28:32.237Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  189. ollama-1 | time=2025-01-16T22:28:32.487Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  190. ollama-1 | time=2025-01-16T22:28:32.487Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  191. ollama-1 | time=2025-01-16T22:28:32.738Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  192. ollama-1 | time=2025-01-16T22:28:32.738Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  193. ollama-1 | time=2025-01-16T22:28:32.987Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  194. ollama-1 | time=2025-01-16T22:28:32.987Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  195. ollama-1 | time=2025-01-16T22:28:33.237Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  196. ollama-1 | time=2025-01-16T22:28:33.237Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  197. ollama-1 | time=2025-01-16T22:28:33.487Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  198. ollama-1 | time=2025-01-16T22:28:33.487Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  199. ollama-1 | time=2025-01-16T22:28:33.737Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  200. ollama-1 | time=2025-01-16T22:28:33.737Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  201. ollama-1 | time=2025-01-16T22:28:33.987Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  202. ollama-1 | time=2025-01-16T22:28:33.987Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  203. ollama-1 | time=2025-01-16T22:28:34.237Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  204. ollama-1 | time=2025-01-16T22:28:34.237Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  205. ollama-1 | time=2025-01-16T22:28:34.487Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  206. ollama-1 | time=2025-01-16T22:28:34.487Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  207. ollama-1 | time=2025-01-16T22:28:34.738Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  208. ollama-1 | time=2025-01-16T22:28:34.738Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  209. ollama-1 | time=2025-01-16T22:28:34.987Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  210. ollama-1 | time=2025-01-16T22:28:34.987Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  211. ollama-1 | time=2025-01-16T22:28:35.237Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  212. ollama-1 | time=2025-01-16T22:28:35.237Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  213. ollama-1 | time=2025-01-16T22:28:35.487Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  214. ollama-1 | time=2025-01-16T22:28:35.487Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  215. ollama-1 | time=2025-01-16T22:28:35.737Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  216. ollama-1 | time=2025-01-16T22:28:35.737Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  217. ollama-1 | time=2025-01-16T22:28:35.987Z level=DEBUG source=gpu.go:406 msg="updating system memory data" before.total="62.5 GiB" before.free="45.1 GiB" before.free_swap="7.5 GiB" now.total="62.5 GiB" now.free="45.1 GiB" now.free_swap="7.5 GiB"
  218. ollama-1 | time=2025-01-16T22:28:35.987Z level=DEBUG source=amd_linux.go:490 msg="updating rocm free memory" gpu=0 name=1002:73df before="10.3 GiB" now="10.3 GiB"
  219. ollama-1 | time=2025-01-16T22:28:35.987Z level=DEBUG source=sched.go:659 msg="gpu VRAM free memory converged after 4.75 seconds" model=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  220. ollama-1 | time=2025-01-16T22:28:35.987Z level=DEBUG source=sched.go:384 msg="sending an unloaded event" modelPath=/root/.ollama/models/blobs/sha256-fd7b6731c33c57f61767612f56517460ec2d1e2e5a3f0163e0eb3d8d8cb5df20
  221. ollama-1 | time=2025-01-16T22:28:35.987Z level=DEBUG source=sched.go:308 msg="ignoring unload event with no pending requests"
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!