API tools faq
paste
Guest User

Untitled

a guest
Feb 27th, 2024
63
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 10.42 KB | None | 0 0
raw download clone embed print report
  1. ollama[549340]: [GIN] 2024/02/28 - 03:08:12 | 200 | 2.144736ms | 127.0.0.1 | HEAD "/"
  2. ollama[549340]: [GIN] 2024/02/28 - 03:08:12 | 200 | 8.552854ms | 127.0.0.1 | POST "/api/show"
  3. ollama[549340]: [GIN] 2024/02/28 - 03:08:12 | 200 | 461.818µs | 127.0.0.1 | POST "/api/show"
  4. ollama[549340]: time=2024-02-28T03:08:13.156Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  5. ollama[549340]: time=2024-02-28T03:08:13.156Z level=DEBUG source=amd.go:32 msg="amd driver not detected /sys/module/amdgpu"
  6. ollama[549340]: time=2024-02-28T03:08:13.157Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  7. ollama[549340]: time=2024-02-28T03:08:13.157Z level=DEBUG source=amd.go:32 msg="amd driver not detected /sys/module/amdgpu"
  8. ollama[549340]: time=2024-02-28T03:08:13.157Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  9. ollama[549340]: time=2024-02-28T03:08:13.157Z level=DEBUG source=payload_common.go:93 msg="ordered list of LLM libraries to try [/tmp/ollama1451723426/cpu_avx2/libext_server.so]"
  10. ollama[549340]: time=2024-02-28T03:08:13.174Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama1451723426/cpu_avx2/libext_server.so"
  11. ollama[549340]: time=2024-02-28T03:08:13.174Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  12. ollama[549340]: [1709089693] system info: AVX = 1 | AVX_VNNI = 0 | AVX2 = 1 | AVX512 = 0 | AVX512_VBMI = 0 | AVX512_VNNI = 0 | FMA = 1 | NEON = 0 | ARM_FMA = 0 | F16C = 1 | FP16_VA = 0 | WASM_SIMD = 0 | BLAS = 0 | SSE3 = 1 | SSSE3 = 1 | VSX = 0 | MATMUL_INT8 = 0 |
  13. ollama[549340]: llama_model_loader: loaded meta data with 22 key-value pairs and 325 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:4eca7304a07a42c48887f159ef5ad82ed5a5bd30fe52db4aadae1dd938e26f70 (version GGUF V3 (latest))
  14. ollama[549340]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  15. ollama[549340]: llama_model_loader: - kv 0: general.architecture str = phi2
  16. ollama[549340]: llama_model_loader: - kv 1: general.name str = Phi2
  17. ollama[549340]: llama_model_loader: - kv 2: phi2.context_length u32 = 2048
  18. ollama[549340]: llama_model_loader: - kv 3: phi2.embedding_length u32 = 2560
  19. ollama[549340]: llama_model_loader: - kv 4: phi2.feed_forward_length u32 = 10240
  20. ollama[549340]: llama_model_loader: - kv 5: phi2.block_count u32 = 32
  21. ollama[549340]: llama_model_loader: - kv 6: phi2.attention.head_count u32 = 32
  22. ollama[549340]: llama_model_loader: - kv 7: phi2.attention.head_count_kv u32 = 32
  23. ollama[549340]: llama_model_loader: - kv 8: phi2.attention.layer_norm_epsilon f32 = 0.000010
  24. ollama[549340]: llama_model_loader: - kv 9: phi2.rope.dimension_count u32 = 32
  25. ollama[549340]: llama_model_loader: - kv 10: general.file_type u32 = 2
  26. ollama[549340]: llama_model_loader: - kv 11: tokenizer.ggml.add_bos_token bool = false
  27. ollama[549340]: llama_model_loader: - kv 12: tokenizer.ggml.model str = gpt2
  28. ollama[549340]: llama_model_loader: - kv 13: tokenizer.ggml.tokens arr[str,51200] = ["!", "\"", "#", "$", "%", "&", "'", ...
  29. ollama[549340]: llama_model_loader: - kv 14: tokenizer.ggml.token_type arr[i32,51200] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
  30. ollama[549340]: llama_model_loader: - kv 15: tokenizer.ggml.merges arr[str,50000] = ["Ġ t", "Ġ a", "h e", "i n", "r e",...
  31. ollama[549340]: llama_model_loader: - kv 16: tokenizer.ggml.bos_token_id u32 = 50256
  32. ollama[549340]: llama_model_loader: - kv 17: tokenizer.ggml.eos_token_id u32 = 50295
  33. ollama[549340]: llama_model_loader: - kv 18: tokenizer.ggml.unknown_token_id u32 = 50256
  34. ollama[549340]: llama_model_loader: - kv 19: tokenizer.ggml.padding_token_id u32 = 50256
  35. ollama[549340]: llama_model_loader: - kv 20: tokenizer.chat_template str = {{ bos_token }}{%- set ns = namespace...
  36. ollama[549340]: llama_model_loader: - kv 21: general.quantization_version u32 = 2
  37. ollama[549340]: llama_model_loader: - type f32: 195 tensors
  38. ollama[549340]: llama_model_loader: - type q4_0: 129 tensors
  39. ollama[549340]: llama_model_loader: - type q6_K: 1 tensors
  40. ollama[549340]: llm_load_vocab: mismatch in special tokens definition ( 910/51200 vs 944/51200 ).
  41. ollama[549340]: llm_load_print_meta: format = GGUF V3 (latest)
  42. ollama[549340]: llm_load_print_meta: arch = phi2
  43. ollama[549340]: llm_load_print_meta: vocab type = BPE
  44. ollama[549340]: llm_load_print_meta: n_vocab = 51200
  45. ollama[549340]: llm_load_print_meta: n_merges = 50000
  46. ollama[549340]: llm_load_print_meta: n_ctx_train = 2048
  47. ollama[549340]: llm_load_print_meta: n_embd = 2560
  48. ollama[549340]: llm_load_print_meta: n_head = 32
  49. ollama[549340]: llm_load_print_meta: n_head_kv = 32
  50. ollama[549340]: llm_load_print_meta: n_layer = 32
  51. ollama[549340]: llm_load_print_meta: n_rot = 32
  52. ollama[549340]: llm_load_print_meta: n_embd_head_k = 80
  53. ollama[549340]: llm_load_print_meta: n_embd_head_v = 80
  54. ollama[549340]: llm_load_print_meta: n_gqa = 1
  55. ollama[549340]: llm_load_print_meta: n_embd_k_gqa = 2560
  56. ollama[549340]: llm_load_print_meta: n_embd_v_gqa = 2560
  57. ollama[549340]: llm_load_print_meta: f_norm_eps = 1.0e-05
  58. ollama[549340]: llm_load_print_meta: f_norm_rms_eps = 0.0e+00
  59. ollama[549340]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  60. ollama[549340]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  61. ollama[549340]: llm_load_print_meta: n_ff = 10240
  62. ollama[549340]: llm_load_print_meta: n_expert = 0
  63. ollama[549340]: llm_load_print_meta: n_expert_used = 0
  64. ollama[549340]: llm_load_print_meta: rope scaling = linear
  65. ollama[549340]: llm_load_print_meta: freq_base_train = 10000.0
  66. ollama[549340]: llm_load_print_meta: freq_scale_train = 1
  67. ollama[549340]: llm_load_print_meta: n_yarn_orig_ctx = 2048
  68. ollama[549340]: llm_load_print_meta: rope_finetuned = unknown
  69. ollama[549340]: llm_load_print_meta: model type = 3B
  70. ollama[549340]: llm_load_print_meta: model ftype = Q4_0
  71. ollama[549340]: llm_load_print_meta: model params = 2.78 B
  72. ollama[549340]: llm_load_print_meta: model size = 1.49 GiB (4.61 BPW)
  73. ollama[549340]: llm_load_print_meta: general.name = Phi2
  74. ollama[549340]: llm_load_print_meta: BOS token = 50256 '<|endoftext|>'
  75. ollama[549340]: llm_load_print_meta: EOS token = 50295 '<|im_end|>'
  76. ollama[549340]: llm_load_print_meta: UNK token = 50256 '<|endoftext|>'
  77. ollama[549340]: llm_load_print_meta: PAD token = 50256 '<|endoftext|>'
  78. ollama[549340]: llm_load_print_meta: LF token = 128 'Ä'
  79. ollama[549340]: llm_load_tensors: ggml ctx size = 0.12 MiB
  80. ollama[549340]: llm_load_tensors: CPU buffer size = 1526.50 MiB
  81. ollama[549340]: ...........................................................................................
  82. ollama[549340]: llama_new_context_with_model: n_ctx = 2048
  83. ollama[549340]: llama_new_context_with_model: freq_base = 10000.0
  84. ollama[549340]: llama_new_context_with_model: freq_scale = 1
  85. systemd[1]: ollama.service: Main process exited, code=killed, status=9/KILL
  86. systemd[1]: ollama.service: Failed with result 'signal'.
  87. systemd[1]: ollama.service: Consumed 8.800s CPU time.
  88. systemd[1]: ollama.service: Scheduled restart job, restart counter is at 9.
  89. systemd[1]: Stopped Ollama Service.
  90. systemd[1]: ollama.service: Consumed 8.800s CPU time.
  91. systemd[1]: Started Ollama Service.
  92. ollama[549401]: time=2024-02-28T03:08:42.426Z level=INFO source=images.go:710 msg="total blobs: 6"
  93. ollama[549401]: time=2024-02-28T03:08:42.441Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  94. ollama[549401]: time=2024-02-28T03:08:42.454Z level=INFO source=routes.go:1019 msg="Listening on 127.0.0.1:11434 (version 0.1.27)"
  95. ollama[549401]: time=2024-02-28T03:08:42.455Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  96. ollama[549401]: time=2024-02-28T03:08:52.469Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 cuda_v11 rocm_v5]"
  97. ollama[549401]: time=2024-02-28T03:08:52.470Z level=DEBUG source=payload_common.go:147 msg="Override detection logic by setting OLLAMA_LLM_LIBRARY"
  98. ollama[549401]: time=2024-02-28T03:08:52.470Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  99. ollama[549401]: time=2024-02-28T03:08:52.470Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  100. ollama[549401]: time=2024-02-28T03:08:52.470Z level=DEBUG source=gpu.go:283 msg="gpu management search paths: [/usr/local/cuda/lib64/libnvidia-ml.so* /usr/lib/x86_64-linux-gnu/nvidia/current/libnvidia-ml.so* /usr/lib/x86_64-linux-gnu/libnvidia-ml.so* /usr/lib/wsl/lib/libnvidia-ml.so* /usr/lib/wsl/drivers/*/libnvidia-ml.so* /opt/cuda/lib64/libnvidia-ml.so* /usr/lib*/libnvidia-ml.so* /usr/local/lib*/libnvidia-ml.so* /usr/lib/aarch64-linux-gnu/nvidia/current/libnvidia-ml.so* /usr/lib/aarch64-linux-gnu/libnvidia-ml.so* /opt/cuda/targets/x86_64-linux/lib/stubs/libnvidia-ml.so* /libnvidia-ml.so*]"
  101. ollama[549401]: time=2024-02-28T03:08:52.476Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  102. ollama[549401]: time=2024-02-28T03:08:52.476Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  103. ollama[549401]: time=2024-02-28T03:08:52.476Z level=DEBUG source=gpu.go:283 msg="gpu management search paths: [/opt/rocm*/lib*/librocm_smi64.so* /librocm_smi64.so*]"
  104. ollama[549401]: time=2024-02-28T03:08:52.476Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  105. ollama[549401]: time=2024-02-28T03:08:52.476Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  106. ollama[549401]: time=2024-02-28T03:08:52.476Z level=DEBUG source=amd.go:32 msg="amd driver not detected /sys/module/amdgpu"
  107. ollama[549401]: time=2024-02-28T03:08:52.477Z level=INFO source=routes.go:1042 msg="no GPU detected"
  108.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!