API tools faq
paste
Guest User

Untitled

a guest
Oct 21st, 2024
209
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 20.35 KB | None | 0 0
raw download clone embed print report
  1. 2024/10/21 23:58:04 routes.go:1170: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION: HTTPS_PROXY: HTTP_PROXY: NO_PROXY: OLLAMA_DEBUG:true OLLAMA_FLASH_ATTENTION:false OLLAMA_GPU_OVERHEAD:0 OLLAMA_HOST:http://127.0.0.1:11434 OLLAMA_INTEL_GPU:false OLLAMA_KEEP_ALIVE:50m0s OLLAMA_LLM_LIBRARY: OLLAMA_LOAD_TIMEOUT:5m0s OLLAMA_MAX_LOADED_MODELS:3 OLLAMA_MAX_QUEUE:512 OLLAMA_MODELS:/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/ OLLAMA_MULTIUSER_CACHE:false OLLAMA_NOHISTORY:false OLLAMA_NOPRUNE:false OLLAMA_NUM_PARALLEL:1 OLLAMA_ORIGINS:[* http://localhost https://localhost http://localhost:* https://localhost:* http://127.0.0.1 https://127.0.0.1 http://127.0.0.1:* https://127.0.0.1:* http://0.0.0.0 https://0.0.0.0 http://0.0.0.0:* https://0.0.0.0:* app://* file://* tauri://*] OLLAMA_SCHED_SPREAD:false OLLAMA_TMPDIR: ROCR_VISIBLE_DEVICES: http_proxy: https_proxy: no_proxy:]"
  2. time=2024-10-21T23:58:04.731+02:00 level=INFO source=images.go:754 msg="total blobs: 42"
  3. time=2024-10-21T23:58:04.732+02:00 level=INFO source=images.go:761 msg="total unused blobs removed: 0"
  4. time=2024-10-21T23:58:04.733+02:00 level=INFO source=routes.go:1217 msg="Listening on 127.0.0.1:11434 (version 0.4.0-rc3)"
  5. time=2024-10-21T23:58:04.733+02:00 level=INFO source=common.go:168 msg="extracting embedded files" dir=/tmp/ollama3113795947/runners
  6. time=2024-10-21T23:58:04.733+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cpu payload=linux/amd64/cpu/ollama_llama_server.gz
  7. time=2024-10-21T23:58:04.734+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cpu_avx payload=linux/amd64/cpu_avx/ollama_llama_server.gz
  8. time=2024-10-21T23:58:04.734+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cpu_avx2 payload=linux/amd64/cpu_avx2/ollama_llama_server.gz
  9. time=2024-10-21T23:58:04.734+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cuda_v11 payload=linux/amd64/cuda_v11/ollama_llama_server.gz
  10. time=2024-10-21T23:58:04.734+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cuda_v12 payload=linux/amd64/cuda_v12/ollama_llama_server.gz
  11. time=2024-10-21T23:58:04.734+02:00 level=DEBUG source=common.go:201 msg=extracting runner=rocm payload=linux/amd64/rocm/ollama_llama_server.gz
  12. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu/ollama_llama_server
  13. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu_avx/ollama_llama_server
  14. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu_avx2/ollama_llama_server
  15. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cuda_v11/ollama_llama_server
  16. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cuda_v12/ollama_llama_server
  17. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/rocm/ollama_llama_server
  18. time=2024-10-21T23:58:04.869+02:00 level=INFO source=common.go:82 msg="Dynamic LLM libraries" runners="[cuda_v11 cuda_v12 rocm cpu cpu_avx cpu_avx2]"
  19. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=common.go:83 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
  20. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=sched.go:106 msg="starting llm scheduler"
  21. time=2024-10-21T23:58:04.869+02:00 level=INFO source=gpu.go:221 msg="looking for compatible GPUs"
  22. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=gpu.go:94 msg="searching for GPU discovery libraries for NVIDIA"
  23. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=gpu.go:505 msg="Searching for GPU library" name=libcuda.so*
  24. time=2024-10-21T23:58:04.869+02:00 level=DEBUG source=gpu.go:528 msg="gpu library search" globs="[/usr/local/bin/lib/ollama/libcuda.so* /libcuda.so* /usr/local/cuda*/targets/*/lib/libcuda.so* /usr/lib/*-linux-gnu/nvidia/current/libcuda.so* /usr/lib/*-linux-gnu/libcuda.so* /usr/lib/wsl/lib/libcuda.so* /usr/lib/wsl/drivers/*/libcuda.so* /opt/cuda/lib*/libcuda.so* /usr/local/cuda/lib*/libcuda.so* /usr/lib*/libcuda.so* /usr/local/lib*/libcuda.so*]"
  25. time=2024-10-21T23:58:04.873+02:00 level=DEBUG source=gpu.go:562 msg="discovered GPU libraries" paths="[/usr/lib/i386-linux-gnu/nvidia/current/libcuda.so.560.35.03 /usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.560.35.03]"
  26. library /usr/lib/i386-linux-gnu/nvidia/current/libcuda.so.560.35.03 load err: /usr/lib/i386-linux-gnu/nvidia/current/libcuda.so.560.35.03: wrong ELF class: ELFCLASS32
  27. time=2024-10-21T23:58:04.874+02:00 level=DEBUG source=gpu.go:613 msg="skipping 32bit library" library=/usr/lib/i386-linux-gnu/nvidia/current/libcuda.so.560.35.03
  28. CUDA driver version: 12.6
  29. time=2024-10-21T23:58:05.054+02:00 level=DEBUG source=gpu.go:129 msg="detected GPUs" count=2 library=/usr/lib/x86_64-linux-gnu/nvidia/current/libcuda.so.560.35.03
  30. [GPU-0d670860-09ec-27c9-1b33-2f0da6743886] CUDA totalMem 7870 mb
  31. [GPU-0d670860-09ec-27c9-1b33-2f0da6743886] CUDA freeMem 7731 mb
  32. [GPU-0d670860-09ec-27c9-1b33-2f0da6743886] Compute Capability 8.6
  33. [GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f] CUDA totalMem 11938 mb
  34. [GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f] CUDA freeMem 11826 mb
  35. [GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f] Compute Capability 8.6
  36. time=2024-10-21T23:58:05.393+02:00 level=DEBUG source=amd_linux.go:416 msg="amdgpu driver not detected /sys/module/amdgpu"
  37. releasing cuda driver library
  38. time=2024-10-21T23:58:05.393+02:00 level=INFO source=types.go:123 msg="inference compute" id=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3060 Ti" total="7.7 GiB" available="7.6 GiB"
  39. time=2024-10-21T23:58:05.393+02:00 level=INFO source=types.go:123 msg="inference compute" id=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f library=cuda variant=v12 compute=8.6 driver=12.6 name="NVIDIA GeForce RTX 3060" total="11.7 GiB" available="11.5 GiB"
  40. [GIN] 2024/10/21 - 23:58:15 | 200 | 63.136µs | 127.0.0.1 | HEAD "/"
  41. time=2024-10-21T23:58:15.597+02:00 level=WARN source=routes.go:891 msg="bad manifest filepath" name=registry.ollama.ai/library/llava:latest error="open /srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-7c658f9561e5dbbafb042a00f6a4de57877adddd957809111f3123e272632b4d: no such file or directory"
  42. [GIN] 2024/10/21 - 23:58:15 | 200 | 59.789514ms | 127.0.0.1 | GET "/api/tags"
  43. [GIN] 2024/10/21 - 23:58:20 | 200 | 49.615µs | 127.0.0.1 | HEAD "/"
  44. [GIN] 2024/10/21 - 23:58:20 | 200 | 49.00996ms | 127.0.0.1 | POST "/api/show"
  45. time=2024-10-21T23:58:20.559+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.8 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  46. CUDA driver version: 12.6
  47. time=2024-10-21T23:58:20.748+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  48. time=2024-10-21T23:58:20.911+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  49. releasing cuda driver library
  50. time=2024-10-21T23:58:20.953+02:00 level=DEBUG source=sched.go:225 msg="loading first model" model=/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe
  51. time=2024-10-21T23:58:20.953+02:00 level=DEBUG source=memory.go:107 msg=evaluating library=cuda gpu_count=1 available="[11.5 GiB]"
  52. time=2024-10-21T23:58:20.953+02:00 level=INFO source=sched.go:715 msg="new model will fit in available VRAM in single GPU, loading" model=/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f parallel=1 available=12401442816 required="5.1 GiB"
  53. time=2024-10-21T23:58:20.953+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  54. CUDA driver version: 12.6
  55. time=2024-10-21T23:58:21.109+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  56. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  57. releasing cuda driver library
  58. time=2024-10-21T23:58:21.255+02:00 level=INFO source=llama-server.go:72 msg="system memory" total="31.2 GiB" free="26.7 GiB" free_swap="13.5 GiB"
  59. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=memory.go:107 msg=evaluating library=cuda gpu_count=1 available="[11.5 GiB]"
  60. time=2024-10-21T23:58:21.255+02:00 level=INFO source=memory.go:346 msg="offload to cuda" layers.requested=-1 layers.model=33 layers.offload=33 layers.split="" memory.available="[11.5 GiB]" memory.gpu_overhead="0 B" memory.required.full="5.1 GiB" memory.required.partial="5.1 GiB" memory.required.kv="256.0 MiB" memory.required.allocations="[5.1 GiB]" memory.weights.total="3.9 GiB" memory.weights.repeating="3.5 GiB" memory.weights.nonrepeating="411.0 MiB" memory.graph.full="258.5 MiB" memory.graph.partial="677.5 MiB"
  61. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cpu payload=linux/amd64/cpu/ollama_llama_server.gz
  62. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cpu_avx payload=linux/amd64/cpu_avx/ollama_llama_server.gz
  63. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cpu_avx2 payload=linux/amd64/cpu_avx2/ollama_llama_server.gz
  64. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cuda_v11 payload=linux/amd64/cuda_v11/ollama_llama_server.gz
  65. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=common.go:201 msg=extracting runner=cuda_v12 payload=linux/amd64/cuda_v12/ollama_llama_server.gz
  66. time=2024-10-21T23:58:21.255+02:00 level=DEBUG source=common.go:201 msg=extracting runner=rocm payload=linux/amd64/rocm/ollama_llama_server.gz
  67. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu/ollama_llama_server
  68. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu_avx/ollama_llama_server
  69. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu_avx2/ollama_llama_server
  70. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cuda_v11/ollama_llama_server
  71. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cuda_v12/ollama_llama_server
  72. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/rocm/ollama_llama_server
  73. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu/ollama_llama_server
  74. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu_avx/ollama_llama_server
  75. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cpu_avx2/ollama_llama_server
  76. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cuda_v11/ollama_llama_server
  77. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/cuda_v12/ollama_llama_server
  78. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=common.go:327 msg="availableServers : found" file=/tmp/ollama3113795947/runners/rocm/ollama_llama_server
  79. time=2024-10-21T23:58:21.256+02:00 level=INFO source=llama-server.go:355 msg="starting llama server" cmd="/tmp/ollama3113795947/runners/cuda_v12/ollama_llama_server --model /srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe --ctx-size 2048 --batch-size 512 --embedding --n-gpu-layers 33 --verbose --threads 4 --parallel 1 --port 40883"
  80. time=2024-10-21T23:58:21.256+02:00 level=DEBUG source=llama-server.go:372 msg=subprocess environment="[PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/root/.dotnet/tools LD_LIBRARY_PATH=/usr/local/bin/lib/ollama:/tmp/ollama3113795947/runners/cuda_v12 CUDA_VISIBLE_DEVICES=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f]"
  81. time=2024-10-21T23:58:21.256+02:00 level=INFO source=sched.go:450 msg="loaded runners" count=1
  82. time=2024-10-21T23:58:21.256+02:00 level=INFO source=llama-server.go:534 msg="waiting for llama runner to start responding"
  83. time=2024-10-21T23:58:21.257+02:00 level=INFO source=llama-server.go:568 msg="waiting for server to become available" status="llm server error"
  84. /tmp/ollama3113795947/runners/cuda_v12/ollama_llama_server: error while loading shared libraries: libggml_cuda_v12.so: cannot open shared object file: No such file or directory
  85. time=2024-10-21T23:58:21.507+02:00 level=ERROR source=sched.go:456 msg="error loading llama server" error="llama runner process has terminated: exit status 127"
  86. time=2024-10-21T23:58:21.507+02:00 level=DEBUG source=sched.go:459 msg="triggering expiration for failed load" model=/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe
  87. time=2024-10-21T23:58:21.507+02:00 level=DEBUG source=sched.go:361 msg="runner expired event received" modelPath=/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe
  88. time=2024-10-21T23:58:21.507+02:00 level=DEBUG source=sched.go:376 msg="got lock to unload" modelPath=/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe
  89. [GIN] 2024/10/21 - 23:58:21 | 500 | 985.264603ms | 127.0.0.1 | POST "/api/generate"
  90. time=2024-10-21T23:58:21.508+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  91. CUDA driver version: 12.6
  92. time=2024-10-21T23:58:21.689+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  93. time=2024-10-21T23:58:21.838+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  94. releasing cuda driver library
  95. time=2024-10-21T23:58:21.838+02:00 level=DEBUG source=llama-server.go:1017 msg="stopping llama server"
  96. time=2024-10-21T23:58:21.838+02:00 level=DEBUG source=sched.go:381 msg="runner released" modelPath=/srv/dev-disk-by-uuid-cc50addc-e947-4f3f-b65b-e02d9e31963b/ollama/blobs/sha256-8eeb52dfb3bb9aefdf9d1ef24b3bdbcfbe82238798c4b918278320b6fcef18fe
  97. time=2024-10-21T23:58:22.089+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  98. CUDA driver version: 12.6
  99. time=2024-10-21T23:58:22.289+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  100. time=2024-10-21T23:58:22.446+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  101. releasing cuda driver library
  102. time=2024-10-21T23:58:22.447+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  103. CUDA driver version: 12.6
  104. time=2024-10-21T23:58:22.627+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  105. time=2024-10-21T23:58:22.773+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  106. releasing cuda driver library
  107. time=2024-10-21T23:58:22.773+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  108. CUDA driver version: 12.6
  109. time=2024-10-21T23:58:22.930+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  110. time=2024-10-21T23:58:23.075+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  111. releasing cuda driver library
  112. time=2024-10-21T23:58:23.075+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  113. CUDA driver version: 12.6
  114. time=2024-10-21T23:58:23.245+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  115. time=2024-10-21T23:58:23.404+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-240dbf51-3cd8-1265-cf72-3c625a369b4f name="NVIDIA GeForce RTX 3060" overhead="0 B" before.total="11.7 GiB" before.free="11.5 GiB" now.total="11.7 GiB" now.free="11.5 GiB" now.used="111.1 MiB"
  116. releasing cuda driver library
  117. time=2024-10-21T23:58:23.404+02:00 level=DEBUG source=gpu.go:396 msg="updating system memory data" before.total="31.2 GiB" before.free="26.7 GiB" before.free_swap="13.5 GiB" now.total="31.2 GiB" now.free="26.7 GiB" now.free_swap="13.5 GiB"
  118. CUDA driver version: 12.6
  119. time=2024-10-21T23:58:23.560+02:00 level=DEBUG source=gpu.go:444 msg="updating cuda memory data" gpu=GPU-0d670860-09ec-27c9-1b33-2f0da6743886 name="NVIDIA GeForce RTX 3060 Ti" overhead="0 B" before.total="7.7 GiB" before.free="7.6 GiB" now.total="7.7 GiB" now.free="7.6 GiB" now.used="139.1 MiB"
  120.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!