API tools faq
paste
Guest User

Untitled

a guest
Mar 10th, 2024
132
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 158.09 KB | None | 0 0
raw download clone embed print report
  1. -- Journal begins at Sat 2023-06-03 13:57:56 UTC, ends at Sun 2024-03-10 12:53:33 UTC. --
  2. Mar 10 11:26:39 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  3. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: Couldn't find '/usr/share/ollama/.ollama/id_ed25519'. Generating new private key.
  4. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: Your new public key is:
  5. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIB8rtmnDDrYryIqbwhPzutOM4SahYJrgd2ifWWU3pSqQ
  6. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:39.988Z level=INFO source=images.go:710 msg="total blobs: 0"
  7. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:39.989Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  8. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:39.990Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  9. Mar 10 11:26:39 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:39.990Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  10. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.481Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cuda_v11 rocm_v5 rocm_v6 cpu cpu_avx cpu_avx2]"
  11. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.485Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  12. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.486Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  13. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.492Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  14. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.495Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  15. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.495Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  16. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.495Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  17. Mar 10 11:26:47 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:26:47.499Z level=INFO source=routes.go:1044 msg="no GPU detected"
  18. Mar 10 11:27:03 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:27:03 | 200 | 1.282384ms | 127.0.0.1 | HEAD "/"
  19. Mar 10 11:27:03 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:27:03 | 404 | 168.401µs | 127.0.0.1 | POST "/api/show"
  20. Mar 10 11:27:05 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:27:05.012Z level=INFO source=download.go:136 msg="downloading c1864a5eb193 in 17 100 MB part(s)"
  21. Mar 10 11:46:11 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:11.942Z level=INFO source=download.go:136 msg="downloading 097a36493f71 in 1 8.4 KB part(s)"
  22. Mar 10 11:46:13 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:13.751Z level=INFO source=download.go:136 msg="downloading 109037bec39c in 1 136 B part(s)"
  23. Mar 10 11:46:15 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:15.474Z level=INFO source=download.go:136 msg="downloading 22a838ceb7fb in 1 84 B part(s)"
  24. Mar 10 11:46:17 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:17.182Z level=INFO source=download.go:136 msg="downloading 887433b89a90 in 1 483 B part(s)"
  25. Mar 10 11:46:43 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:46:43 | 200 | 19m40s | 127.0.0.1 | POST "/api/pull"
  26. Mar 10 11:46:43 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:46:43 | 200 | 8.611137ms | 127.0.0.1 | POST "/api/show"
  27. Mar 10 11:46:43 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:46:43 | 200 | 508.136µs | 127.0.0.1 | POST "/api/show"
  28. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:45.387Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  29. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:45.388Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  30. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:45.388Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  31. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:45.407Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama287781922/cpu_avx2/libext_server.so"
  32. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:46:45.407Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  33. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  34. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  35. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 0: general.architecture str = gemma
  36. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  37. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  38. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  39. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  40. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  41. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  42. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  43. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  44. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  45. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  46. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  47. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  48. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  49. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  50. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  51. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  52. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  53. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  54. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  55. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 20: general.file_type u32 = 2
  56. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - type f32: 37 tensors
  57. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - type q4_0: 126 tensors
  58. Mar 10 11:46:45 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - type q8_0: 1 tensors
  59. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  60. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: format = GGUF V3 (latest)
  61. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: arch = gemma
  62. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: vocab type = SPM
  63. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_vocab = 256128
  64. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_merges = 0
  65. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_ctx_train = 8192
  66. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd = 2048
  67. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_head = 8
  68. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_head_kv = 1
  69. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_layer = 18
  70. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_rot = 256
  71. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_head_k = 256
  72. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_head_v = 256
  73. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_gqa = 8
  74. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_k_gqa = 256
  75. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_v_gqa = 256
  76. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_norm_eps = 0.0e+00
  77. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  78. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  79. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  80. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_ff = 16384
  81. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_expert = 0
  82. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_expert_used = 0
  83. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: pooling type = 0
  84. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: rope type = 2
  85. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: rope scaling = linear
  86. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: freq_base_train = 10000.0
  87. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: freq_scale_train = 1
  88. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  89. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: rope_finetuned = unknown
  90. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model type = 2B
  91. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model ftype = Q4_0
  92. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model params = 2.51 B
  93. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  94. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: general.name = gemma-2b-it
  95. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: BOS token = 2 '<bos>'
  96. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: EOS token = 1 '<eos>'
  97. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: UNK token = 3 '<unk>'
  98. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: PAD token = 0 '<pad>'
  99. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: LF token = 227 '<0x0A>'
  100. Mar 10 11:46:46 ip-172-26-15-150 ollama[3647639]: llm_load_tensors: ggml ctx size = 0.06 MiB
  101. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  102. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: .....................................................
  103. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: n_ctx = 2048
  104. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: freq_base = 10000.0
  105. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: freq_scale = 1
  106. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  107. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  108. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:47:12.635Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama287781922/cpu_avx2/libext_server.so exception std::bad_alloc"
  109. Mar 10 11:47:12 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:47:12 | 500 | 29.245583486s | 127.0.0.1 | POST "/api/chat"
  110. Mar 10 11:47:24 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:47:24 | 200 | 1.468479ms | 127.0.0.1 | HEAD "/"
  111. Mar 10 11:47:24 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:47:24 | 200 | 8.156201ms | 127.0.0.1 | POST "/api/show"
  112. Mar 10 11:47:24 ip-172-26-15-150 ollama[3647639]: [GIN] 2024/03/10 - 11:47:24 | 200 | 760.186µs | 127.0.0.1 | POST "/api/show"
  113. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:47:26.806Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  114. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:47:26.808Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  115. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:47:26.808Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  116. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:47:26.812Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama287781922/cpu_avx2/libext_server.so"
  117. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: time=2024-03-10T11:47:26.812Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  118. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  119. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  120. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 0: general.architecture str = gemma
  121. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  122. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  123. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  124. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  125. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  126. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  127. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  128. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  129. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  130. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  131. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  132. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  133. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  134. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  135. Mar 10 11:47:26 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  136. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  137. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  138. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  139. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  140. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - kv 20: general.file_type u32 = 2
  141. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - type f32: 37 tensors
  142. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - type q4_0: 126 tensors
  143. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llama_model_loader: - type q8_0: 1 tensors
  144. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  145. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: format = GGUF V3 (latest)
  146. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: arch = gemma
  147. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: vocab type = SPM
  148. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_vocab = 256128
  149. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_merges = 0
  150. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_ctx_train = 8192
  151. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd = 2048
  152. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_head = 8
  153. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_head_kv = 1
  154. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_layer = 18
  155. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_rot = 256
  156. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_head_k = 256
  157. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_head_v = 256
  158. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_gqa = 8
  159. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_k_gqa = 256
  160. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_embd_v_gqa = 256
  161. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_norm_eps = 0.0e+00
  162. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  163. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  164. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  165. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_ff = 16384
  166. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_expert = 0
  167. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_expert_used = 0
  168. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: pooling type = 0
  169. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: rope type = 2
  170. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: rope scaling = linear
  171. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: freq_base_train = 10000.0
  172. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: freq_scale_train = 1
  173. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  174. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: rope_finetuned = unknown
  175. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model type = 2B
  176. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model ftype = Q4_0
  177. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model params = 2.51 B
  178. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  179. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: general.name = gemma-2b-it
  180. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: BOS token = 2 '<bos>'
  181. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: EOS token = 1 '<eos>'
  182. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: UNK token = 3 '<unk>'
  183. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: PAD token = 0 '<pad>'
  184. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_print_meta: LF token = 227 '<0x0A>'
  185. Mar 10 11:47:27 ip-172-26-15-150 ollama[3647639]: llm_load_tensors: ggml ctx size = 0.06 MiB
  186. Mar 10 11:48:04 ip-172-26-15-150 ollama[3647639]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  187. Mar 10 11:48:04 ip-172-26-15-150 ollama[3647639]: .....................................................
  188. Mar 10 11:48:04 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: n_ctx = 2048
  189. Mar 10 11:48:04 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: freq_base = 10000.0
  190. Mar 10 11:48:04 ip-172-26-15-150 ollama[3647639]: llama_new_context_with_model: freq_scale = 1
  191. Mar 10 11:48:04 ip-172-26-15-150 systemd[1]: ollama.service: A process of this unit has been killed by the OOM killer.
  192. Mar 10 11:48:04 ip-172-26-15-150 systemd[1]: ollama.service: Main process exited, code=killed, status=9/KILL
  193. Mar 10 11:48:04 ip-172-26-15-150 systemd[1]: ollama.service: Failed with result 'oom-kill'.
  194. Mar 10 11:48:04 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 39.536s CPU time.
  195. Mar 10 11:48:07 ip-172-26-15-150 systemd[1]: ollama.service: Scheduled restart job, restart counter is at 1.
  196. Mar 10 11:48:07 ip-172-26-15-150 systemd[1]: Stopped Ollama Service.
  197. Mar 10 11:48:07 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 39.536s CPU time.
  198. Mar 10 11:48:07 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  199. Mar 10 11:48:07 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:07.313Z level=INFO source=images.go:710 msg="total blobs: 5"
  200. Mar 10 11:48:07 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:07.322Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  201. Mar 10 11:48:07 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:07.324Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  202. Mar 10 11:48:07 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:07.324Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  203. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.803Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cpu_avx2 cuda_v11 rocm_v5 cpu rocm_v6 cpu_avx]"
  204. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.805Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  205. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.805Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  206. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.817Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  207. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.817Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  208. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.818Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  209. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.818Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  210. Mar 10 11:48:14 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:48:14.819Z level=INFO source=routes.go:1044 msg="no GPU detected"
  211. Mar 10 11:52:01 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:52:01 | 200 | 3.456957ms | 127.0.0.1 | HEAD "/"
  212. Mar 10 11:52:01 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:52:01 | 200 | 4.335627ms | 127.0.0.1 | POST "/api/show"
  213. Mar 10 11:52:01 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:52:01 | 200 | 352.782µs | 127.0.0.1 | POST "/api/show"
  214. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:52:03.283Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  215. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:52:03.284Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  216. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:52:03.284Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  217. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:52:03.306Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama3138562400/cpu_avx2/libext_server.so"
  218. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:52:03.306Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  219. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  220. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  221. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 0: general.architecture str = gemma
  222. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  223. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  224. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  225. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  226. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  227. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  228. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  229. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  230. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  231. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  232. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  233. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  234. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  235. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  236. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  237. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  238. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  239. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  240. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  241. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 20: general.file_type u32 = 2
  242. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - type f32: 37 tensors
  243. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - type q4_0: 126 tensors
  244. Mar 10 11:52:03 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - type q8_0: 1 tensors
  245. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  246. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: format = GGUF V3 (latest)
  247. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: arch = gemma
  248. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: vocab type = SPM
  249. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_vocab = 256128
  250. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_merges = 0
  251. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_ctx_train = 8192
  252. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd = 2048
  253. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_head = 8
  254. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_head_kv = 1
  255. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_layer = 18
  256. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_rot = 256
  257. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_head_k = 256
  258. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_head_v = 256
  259. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_gqa = 8
  260. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_k_gqa = 256
  261. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_v_gqa = 256
  262. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_norm_eps = 0.0e+00
  263. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  264. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  265. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  266. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_ff = 16384
  267. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_expert = 0
  268. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_expert_used = 0
  269. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: pooling type = 0
  270. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: rope type = 2
  271. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: rope scaling = linear
  272. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: freq_base_train = 10000.0
  273. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: freq_scale_train = 1
  274. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  275. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: rope_finetuned = unknown
  276. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model type = 2B
  277. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model ftype = Q4_0
  278. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model params = 2.51 B
  279. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  280. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: general.name = gemma-2b-it
  281. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: BOS token = 2 '<bos>'
  282. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: EOS token = 1 '<eos>'
  283. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: UNK token = 3 '<unk>'
  284. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: PAD token = 0 '<pad>'
  285. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: LF token = 227 '<0x0A>'
  286. Mar 10 11:52:04 ip-172-26-15-150 ollama[3647818]: llm_load_tensors: ggml ctx size = 0.06 MiB
  287. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  288. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: .....................................................
  289. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: n_ctx = 2048
  290. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: freq_base = 10000.0
  291. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: freq_scale = 1
  292. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  293. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  294. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:52:30.940Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama3138562400/cpu_avx2/libext_server.so exception std::bad_alloc"
  295. Mar 10 11:52:30 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:52:30 | 500 | 29.590410936s | 127.0.0.1 | POST "/api/chat"
  296. Mar 10 11:56:58 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:56:58 | 200 | 2.227541ms | 127.0.0.1 | HEAD "/"
  297. Mar 10 11:56:58 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:56:58 | 200 | 8.636837ms | 127.0.0.1 | POST "/api/show"
  298. Mar 10 11:56:58 ip-172-26-15-150 ollama[3647818]: [GIN] 2024/03/10 - 11:56:58 | 200 | 336.215µs | 127.0.0.1 | POST "/api/show"
  299. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:57:00.538Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  300. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:57:00.540Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  301. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:57:00.541Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  302. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:57:00.544Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama3138562400/cpu_avx2/libext_server.so"
  303. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: time=2024-03-10T11:57:00.544Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  304. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  305. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  306. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 0: general.architecture str = gemma
  307. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  308. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  309. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  310. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  311. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  312. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  313. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  314. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  315. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  316. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  317. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  318. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  319. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  320. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  321. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  322. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  323. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  324. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  325. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  326. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - kv 20: general.file_type u32 = 2
  327. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - type f32: 37 tensors
  328. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - type q4_0: 126 tensors
  329. Mar 10 11:57:00 ip-172-26-15-150 ollama[3647818]: llama_model_loader: - type q8_0: 1 tensors
  330. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  331. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: format = GGUF V3 (latest)
  332. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: arch = gemma
  333. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: vocab type = SPM
  334. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_vocab = 256128
  335. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_merges = 0
  336. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_ctx_train = 8192
  337. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd = 2048
  338. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_head = 8
  339. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_head_kv = 1
  340. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_layer = 18
  341. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_rot = 256
  342. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_head_k = 256
  343. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_head_v = 256
  344. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_gqa = 8
  345. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_k_gqa = 256
  346. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_embd_v_gqa = 256
  347. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_norm_eps = 0.0e+00
  348. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  349. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  350. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  351. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_ff = 16384
  352. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_expert = 0
  353. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_expert_used = 0
  354. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: pooling type = 0
  355. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: rope type = 2
  356. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: rope scaling = linear
  357. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: freq_base_train = 10000.0
  358. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: freq_scale_train = 1
  359. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  360. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: rope_finetuned = unknown
  361. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model type = 2B
  362. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model ftype = Q4_0
  363. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model params = 2.51 B
  364. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  365. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: general.name = gemma-2b-it
  366. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: BOS token = 2 '<bos>'
  367. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: EOS token = 1 '<eos>'
  368. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: UNK token = 3 '<unk>'
  369. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: PAD token = 0 '<pad>'
  370. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_print_meta: LF token = 227 '<0x0A>'
  371. Mar 10 11:57:01 ip-172-26-15-150 ollama[3647818]: llm_load_tensors: ggml ctx size = 0.06 MiB
  372. Mar 10 11:57:30 ip-172-26-15-150 ollama[3647818]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  373. Mar 10 11:57:30 ip-172-26-15-150 ollama[3647818]: .....................................................
  374. Mar 10 11:57:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: n_ctx = 2048
  375. Mar 10 11:57:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: freq_base = 10000.0
  376. Mar 10 11:57:30 ip-172-26-15-150 ollama[3647818]: llama_new_context_with_model: freq_scale = 1
  377. Mar 10 11:57:34 ip-172-26-15-150 systemd[1]: ollama.service: Main process exited, code=killed, status=9/KILL
  378. Mar 10 11:57:34 ip-172-26-15-150 systemd[1]: ollama.service: Failed with result 'signal'.
  379. Mar 10 11:57:34 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 15.809s CPU time.
  380. Mar 10 11:57:37 ip-172-26-15-150 systemd[1]: ollama.service: Scheduled restart job, restart counter is at 2.
  381. Mar 10 11:57:37 ip-172-26-15-150 systemd[1]: Stopped Ollama Service.
  382. Mar 10 11:57:37 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 15.809s CPU time.
  383. Mar 10 11:57:37 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  384. Mar 10 11:57:37 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:37.537Z level=INFO source=images.go:710 msg="total blobs: 5"
  385. Mar 10 11:57:37 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:37.545Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  386. Mar 10 11:57:37 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:37.547Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  387. Mar 10 11:57:37 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:37.547Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  388. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.134Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 cuda_v11 rocm_v5]"
  389. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.134Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  390. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.134Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  391. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.147Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  392. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.147Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  393. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.147Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  394. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.147Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  395. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:45.149Z level=INFO source=routes.go:1044 msg="no GPU detected"
  396. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:57:45 | 200 | 1.447883ms | 127.0.0.1 | HEAD "/"
  397. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:57:45 | 200 | 4.521796ms | 127.0.0.1 | POST "/api/show"
  398. Mar 10 11:57:45 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:57:45 | 200 | 651.155µs | 127.0.0.1 | POST "/api/show"
  399. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:47.605Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  400. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:47.606Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  401. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:47.606Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  402. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:47.624Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama2062677850/cpu_avx2/libext_server.so"
  403. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:57:47.625Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  404. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  405. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  406. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 0: general.architecture str = gemma
  407. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  408. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  409. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  410. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  411. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  412. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  413. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  414. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  415. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  416. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  417. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  418. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  419. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  420. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  421. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  422. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  423. Mar 10 11:57:47 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  424. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  425. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  426. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 20: general.file_type u32 = 2
  427. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - type f32: 37 tensors
  428. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - type q4_0: 126 tensors
  429. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - type q8_0: 1 tensors
  430. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  431. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: format = GGUF V3 (latest)
  432. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: arch = gemma
  433. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: vocab type = SPM
  434. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_vocab = 256128
  435. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_merges = 0
  436. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_ctx_train = 8192
  437. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd = 2048
  438. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_head = 8
  439. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_head_kv = 1
  440. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_layer = 18
  441. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_rot = 256
  442. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_head_k = 256
  443. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_head_v = 256
  444. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_gqa = 8
  445. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_k_gqa = 256
  446. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_v_gqa = 256
  447. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_norm_eps = 0.0e+00
  448. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  449. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  450. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  451. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_ff = 16384
  452. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_expert = 0
  453. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_expert_used = 0
  454. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: pooling type = 0
  455. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: rope type = 2
  456. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: rope scaling = linear
  457. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: freq_base_train = 10000.0
  458. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: freq_scale_train = 1
  459. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  460. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: rope_finetuned = unknown
  461. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model type = 2B
  462. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model ftype = Q4_0
  463. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model params = 2.51 B
  464. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  465. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: general.name = gemma-2b-it
  466. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: BOS token = 2 '<bos>'
  467. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: EOS token = 1 '<eos>'
  468. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: UNK token = 3 '<unk>'
  469. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: PAD token = 0 '<pad>'
  470. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: LF token = 227 '<0x0A>'
  471. Mar 10 11:57:48 ip-172-26-15-150 ollama[3647877]: llm_load_tensors: ggml ctx size = 0.06 MiB
  472. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  473. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: .....................................................
  474. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: n_ctx = 2048
  475. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: freq_base = 10000.0
  476. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: freq_scale = 1
  477. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  478. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  479. Mar 10 11:58:14 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:58:14.944Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama2062677850/cpu_avx2/libext_server.so exception std::bad_alloc"
  480. Mar 10 11:58:15 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:58:15 | 500 | 29.290483113s | 127.0.0.1 | POST "/api/chat"
  481. Mar 10 11:58:28 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:58:28 | 200 | 427.761µs | 127.0.0.1 | HEAD "/"
  482. Mar 10 11:58:28 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:58:28 | 200 | 7.236376ms | 127.0.0.1 | POST "/api/show"
  483. Mar 10 11:58:28 ip-172-26-15-150 ollama[3647877]: [GIN] 2024/03/10 - 11:58:28 | 200 | 367.759µs | 127.0.0.1 | POST "/api/show"
  484. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:58:30.479Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  485. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:58:30.480Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  486. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:58:30.480Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  487. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:58:30.483Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama2062677850/cpu_avx2/libext_server.so"
  488. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: time=2024-03-10T11:58:30.483Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  489. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  490. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  491. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 0: general.architecture str = gemma
  492. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  493. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  494. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  495. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  496. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  497. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  498. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  499. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  500. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  501. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  502. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  503. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  504. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  505. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  506. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  507. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  508. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  509. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  510. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  511. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - kv 20: general.file_type u32 = 2
  512. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - type f32: 37 tensors
  513. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - type q4_0: 126 tensors
  514. Mar 10 11:58:30 ip-172-26-15-150 ollama[3647877]: llama_model_loader: - type q8_0: 1 tensors
  515. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  516. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: format = GGUF V3 (latest)
  517. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: arch = gemma
  518. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: vocab type = SPM
  519. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_vocab = 256128
  520. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_merges = 0
  521. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_ctx_train = 8192
  522. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd = 2048
  523. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_head = 8
  524. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_head_kv = 1
  525. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_layer = 18
  526. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_rot = 256
  527. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_head_k = 256
  528. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_head_v = 256
  529. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_gqa = 8
  530. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_k_gqa = 256
  531. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_embd_v_gqa = 256
  532. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_norm_eps = 0.0e+00
  533. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  534. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  535. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  536. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_ff = 16384
  537. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_expert = 0
  538. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_expert_used = 0
  539. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: pooling type = 0
  540. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: rope type = 2
  541. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: rope scaling = linear
  542. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: freq_base_train = 10000.0
  543. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: freq_scale_train = 1
  544. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  545. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: rope_finetuned = unknown
  546. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model type = 2B
  547. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model ftype = Q4_0
  548. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model params = 2.51 B
  549. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  550. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: general.name = gemma-2b-it
  551. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: BOS token = 2 '<bos>'
  552. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: EOS token = 1 '<eos>'
  553. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: UNK token = 3 '<unk>'
  554. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: PAD token = 0 '<pad>'
  555. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_print_meta: LF token = 227 '<0x0A>'
  556. Mar 10 11:58:31 ip-172-26-15-150 ollama[3647877]: llm_load_tensors: ggml ctx size = 0.06 MiB
  557. Mar 10 11:59:21 ip-172-26-15-150 systemd[1]: ollama.service: Main process exited, code=killed, status=9/KILL
  558. Mar 10 11:59:21 ip-172-26-15-150 ollama[3647877]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  559. Mar 10 11:59:21 ip-172-26-15-150 ollama[3647877]: .....................................................
  560. Mar 10 11:59:21 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: n_ctx = 2048
  561. Mar 10 11:59:21 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: freq_base = 10000.0
  562. Mar 10 11:59:21 ip-172-26-15-150 ollama[3647877]: llama_new_context_with_model: freq_scale = 1
  563. Mar 10 11:59:21 ip-172-26-15-150 systemd[1]: ollama.service: Failed with result 'signal'.
  564. Mar 10 11:59:21 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 15.531s CPU time.
  565. Mar 10 11:59:24 ip-172-26-15-150 systemd[1]: ollama.service: Scheduled restart job, restart counter is at 3.
  566. Mar 10 11:59:24 ip-172-26-15-150 systemd[1]: Stopped Ollama Service.
  567. Mar 10 11:59:24 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 15.531s CPU time.
  568. Mar 10 11:59:24 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  569. Mar 10 11:59:24 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:24.561Z level=INFO source=images.go:710 msg="total blobs: 5"
  570. Mar 10 11:59:24 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:24.568Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  571. Mar 10 11:59:24 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:24.571Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  572. Mar 10 11:59:24 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:24.571Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  573. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.233Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 rocm_v5 cuda_v11]"
  574. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.234Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  575. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.235Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  576. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.248Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  577. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.248Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  578. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.248Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  579. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.248Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  580. Mar 10 11:59:32 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T11:59:32.248Z level=INFO source=routes.go:1044 msg="no GPU detected"
  581. Mar 10 12:00:27 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:27 | 200 | 1.632829ms | 127.0.0.1 | HEAD "/"
  582. Mar 10 12:00:27 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:27 | 200 | 4.925762ms | 127.0.0.1 | GET "/api/tags"
  583. Mar 10 12:00:35 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:35 | 200 | 32.981µs | 127.0.0.1 | HEAD "/"
  584. Mar 10 12:00:35 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:35 | 200 | 23.208581ms | 127.0.0.1 | DELETE "/api/delete"
  585. Mar 10 12:00:39 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:39 | 200 | 25.095µs | 127.0.0.1 | HEAD "/"
  586. Mar 10 12:00:39 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:39 | 200 | 129.038µs | 127.0.0.1 | GET "/api/tags"
  587. Mar 10 12:00:47 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:47 | 200 | 29.47µs | 127.0.0.1 | HEAD "/"
  588. Mar 10 12:00:47 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:00:47 | 404 | 132.165µs | 127.0.0.1 | POST "/api/show"
  589. Mar 10 12:00:48 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:00:48.683Z level=INFO source=download.go:136 msg="downloading c1864a5eb193 in 17 100 MB part(s)"
  590. Mar 10 12:01:09 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:09.685Z level=INFO source=download.go:250 msg="c1864a5eb193 part 8 stalled; retrying"
  591. Mar 10 12:01:19 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:19.652Z level=INFO source=download.go:136 msg="downloading 097a36493f71 in 1 8.4 KB part(s)"
  592. Mar 10 12:01:21 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:21.398Z level=INFO source=download.go:136 msg="downloading 109037bec39c in 1 136 B part(s)"
  593. Mar 10 12:01:23 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:23.450Z level=INFO source=download.go:136 msg="downloading 22a838ceb7fb in 1 84 B part(s)"
  594. Mar 10 12:01:25 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:25.250Z level=INFO source=download.go:136 msg="downloading 887433b89a90 in 1 483 B part(s)"
  595. Mar 10 12:01:51 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:01:51 | 200 | 1m4s | 127.0.0.1 | POST "/api/pull"
  596. Mar 10 12:01:51 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:01:51 | 200 | 11.361571ms | 127.0.0.1 | POST "/api/show"
  597. Mar 10 12:01:51 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:01:51 | 200 | 749.474µs | 127.0.0.1 | POST "/api/show"
  598. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:53.419Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  599. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:53.421Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  600. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:53.421Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  601. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:53.446Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama2297219659/cpu_avx2/libext_server.so"
  602. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:01:53.446Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  603. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  604. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  605. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 0: general.architecture str = gemma
  606. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  607. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  608. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  609. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  610. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  611. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  612. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  613. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  614. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  615. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  616. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  617. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  618. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  619. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  620. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  621. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  622. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  623. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  624. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  625. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 20: general.file_type u32 = 2
  626. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - type f32: 37 tensors
  627. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - type q4_0: 126 tensors
  628. Mar 10 12:01:53 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - type q8_0: 1 tensors
  629. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  630. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: format = GGUF V3 (latest)
  631. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: arch = gemma
  632. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: vocab type = SPM
  633. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_vocab = 256128
  634. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_merges = 0
  635. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_ctx_train = 8192
  636. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd = 2048
  637. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_head = 8
  638. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_head_kv = 1
  639. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_layer = 18
  640. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_rot = 256
  641. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_head_k = 256
  642. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_head_v = 256
  643. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_gqa = 8
  644. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_k_gqa = 256
  645. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_v_gqa = 256
  646. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_norm_eps = 0.0e+00
  647. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  648. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  649. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  650. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_ff = 16384
  651. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_expert = 0
  652. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_expert_used = 0
  653. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: pooling type = 0
  654. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: rope type = 2
  655. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: rope scaling = linear
  656. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: freq_base_train = 10000.0
  657. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: freq_scale_train = 1
  658. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  659. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: rope_finetuned = unknown
  660. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model type = 2B
  661. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model ftype = Q4_0
  662. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model params = 2.51 B
  663. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  664. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: general.name = gemma-2b-it
  665. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: BOS token = 2 '<bos>'
  666. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: EOS token = 1 '<eos>'
  667. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: UNK token = 3 '<unk>'
  668. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: PAD token = 0 '<pad>'
  669. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: LF token = 227 '<0x0A>'
  670. Mar 10 12:01:54 ip-172-26-15-150 ollama[3647903]: llm_load_tensors: ggml ctx size = 0.06 MiB
  671. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  672. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: .....................................................
  673. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: n_ctx = 2048
  674. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: freq_base = 10000.0
  675. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: freq_scale = 1
  676. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  677. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  678. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:02:20.794Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama2297219659/cpu_avx2/libext_server.so exception std::bad_alloc"
  679. Mar 10 12:02:20 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:02:20 | 500 | 29.297285599s | 127.0.0.1 | POST "/api/chat"
  680. Mar 10 12:07:18 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:07:18 | 200 | 897.085µs | 127.0.0.1 | HEAD "/"
  681. Mar 10 12:07:18 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:07:18 | 200 | 10.933012ms | 127.0.0.1 | POST "/api/show"
  682. Mar 10 12:07:18 ip-172-26-15-150 ollama[3647903]: [GIN] 2024/03/10 - 12:07:18 | 200 | 421.223µs | 127.0.0.1 | POST "/api/show"
  683. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:07:20.859Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  684. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:07:20.862Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  685. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:07:20.862Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  686. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:07:20.874Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama2297219659/cpu_avx2/libext_server.so"
  687. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: time=2024-03-10T12:07:20.874Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  688. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  689. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  690. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 0: general.architecture str = gemma
  691. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  692. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  693. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  694. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  695. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  696. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  697. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  698. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  699. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  700. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  701. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  702. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  703. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  704. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  705. Mar 10 12:07:20 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  706. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  707. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  708. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  709. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  710. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - kv 20: general.file_type u32 = 2
  711. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - type f32: 37 tensors
  712. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - type q4_0: 126 tensors
  713. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llama_model_loader: - type q8_0: 1 tensors
  714. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  715. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: format = GGUF V3 (latest)
  716. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: arch = gemma
  717. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: vocab type = SPM
  718. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_vocab = 256128
  719. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_merges = 0
  720. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_ctx_train = 8192
  721. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd = 2048
  722. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_head = 8
  723. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_head_kv = 1
  724. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_layer = 18
  725. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_rot = 256
  726. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_head_k = 256
  727. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_head_v = 256
  728. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_gqa = 8
  729. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_k_gqa = 256
  730. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_embd_v_gqa = 256
  731. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_norm_eps = 0.0e+00
  732. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  733. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  734. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  735. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_ff = 16384
  736. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_expert = 0
  737. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_expert_used = 0
  738. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: pooling type = 0
  739. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: rope type = 2
  740. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: rope scaling = linear
  741. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: freq_base_train = 10000.0
  742. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: freq_scale_train = 1
  743. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  744. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: rope_finetuned = unknown
  745. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model type = 2B
  746. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model ftype = Q4_0
  747. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model params = 2.51 B
  748. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  749. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: general.name = gemma-2b-it
  750. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: BOS token = 2 '<bos>'
  751. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: EOS token = 1 '<eos>'
  752. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: UNK token = 3 '<unk>'
  753. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: PAD token = 0 '<pad>'
  754. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_print_meta: LF token = 227 '<0x0A>'
  755. Mar 10 12:07:21 ip-172-26-15-150 ollama[3647903]: llm_load_tensors: ggml ctx size = 0.06 MiB
  756. Mar 10 12:07:54 ip-172-26-15-150 ollama[3647903]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  757. Mar 10 12:07:54 ip-172-26-15-150 ollama[3647903]: .....................................................
  758. Mar 10 12:07:54 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: n_ctx = 2048
  759. Mar 10 12:07:54 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: freq_base = 10000.0
  760. Mar 10 12:07:54 ip-172-26-15-150 ollama[3647903]: llama_new_context_with_model: freq_scale = 1
  761. Mar 10 12:07:56 ip-172-26-15-150 systemd[1]: ollama.service: Main process exited, code=killed, status=9/KILL
  762. Mar 10 12:07:56 ip-172-26-15-150 systemd[1]: ollama.service: Failed with result 'signal'.
  763. Mar 10 12:07:56 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 38.545s CPU time.
  764. Mar 10 12:07:59 ip-172-26-15-150 systemd[1]: ollama.service: Scheduled restart job, restart counter is at 4.
  765. Mar 10 12:07:59 ip-172-26-15-150 systemd[1]: Stopped Ollama Service.
  766. Mar 10 12:07:59 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 38.545s CPU time.
  767. Mar 10 12:07:59 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  768. Mar 10 12:07:59 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:07:59.342Z level=INFO source=images.go:710 msg="total blobs: 5"
  769. Mar 10 12:07:59 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:07:59.351Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  770. Mar 10 12:07:59 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:07:59.355Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  771. Mar 10 12:07:59 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:07:59.355Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  772. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.817Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [rocm_v6 cpu cpu_avx cpu_avx2 cuda_v11 rocm_v5]"
  773. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.819Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  774. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.823Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  775. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.836Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  776. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.837Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  777. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.837Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  778. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.837Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  779. Mar 10 12:08:06 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:08:06.839Z level=INFO source=routes.go:1044 msg="no GPU detected"
  780. Mar 10 12:12:06 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:12:06 | 200 | 2.223958ms | 127.0.0.1 | HEAD "/"
  781. Mar 10 12:12:06 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:12:06 | 404 | 649.328µs | 127.0.0.1 | POST "/api/show"
  782. Mar 10 12:12:07 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:12:07.783Z level=INFO source=download.go:136 msg="downloading 4eca7304a07a in 17 100 MB part(s)"
  783. Mar 10 12:12:51 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:12:51 | 200 | 45.407899742s | 127.0.0.1 | POST "/api/pull"
  784. Mar 10 12:12:57 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:12:57 | 200 | 2.720766ms | 127.0.0.1 | HEAD "/"
  785. Mar 10 12:12:57 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:12:57 | 200 | 5.078392ms | 127.0.0.1 | GET "/api/tags"
  786. Mar 10 12:13:00 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:13:00 | 200 | 27.641µs | 127.0.0.1 | HEAD "/"
  787. Mar 10 12:13:00 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:13:00 | 404 | 76.542µs | 127.0.0.1 | POST "/api/show"
  788. Mar 10 12:13:01 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:01.026Z level=INFO source=download.go:136 msg="downloading 4eca7304a07a in 17 100 MB part(s)"
  789. Mar 10 12:13:05 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:05.773Z level=INFO source=download.go:136 msg="downloading 876a8d805b60 in 1 10 KB part(s)"
  790. Mar 10 12:13:07 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:07.567Z level=INFO source=download.go:136 msg="downloading a47b02e00552 in 1 106 B part(s)"
  791. Mar 10 12:13:09 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:09.328Z level=INFO source=download.go:136 msg="downloading 8b586b146d99 in 1 40 B part(s)"
  792. Mar 10 12:13:11 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:11.084Z level=INFO source=download.go:136 msg="downloading f02dd72bb242 in 1 59 B part(s)"
  793. Mar 10 12:13:12 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:12.855Z level=INFO source=download.go:136 msg="downloading c87a43ded80f in 1 555 B part(s)"
  794. Mar 10 12:13:37 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:13:37 | 200 | 37.535140242s | 127.0.0.1 | POST "/api/pull"
  795. Mar 10 12:13:37 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:13:37 | 200 | 3.520083ms | 127.0.0.1 | POST "/api/show"
  796. Mar 10 12:13:37 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:13:37 | 200 | 627.374µs | 127.0.0.1 | POST "/api/show"
  797. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:38.455Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  798. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:38.456Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  799. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:38.456Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  800. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:38.473Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama153347545/cpu_avx2/libext_server.so"
  801. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:13:38.473Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  802. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: loaded meta data with 22 key-value pairs and 325 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:4eca7304a07a42c48887f159ef5ad82ed5a5bd30fe52db4aadae1dd938e26f70 (version GGUF V3 (latest))
  803. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  804. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 0: general.architecture str = phi2
  805. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 1: general.name str = Phi2
  806. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 2: phi2.context_length u32 = 2048
  807. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 3: phi2.embedding_length u32 = 2560
  808. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 4: phi2.feed_forward_length u32 = 10240
  809. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 5: phi2.block_count u32 = 32
  810. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 6: phi2.attention.head_count u32 = 32
  811. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 7: phi2.attention.head_count_kv u32 = 32
  812. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 8: phi2.attention.layer_norm_epsilon f32 = 0.000010
  813. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 9: phi2.rope.dimension_count u32 = 32
  814. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 10: general.file_type u32 = 2
  815. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 11: tokenizer.ggml.add_bos_token bool = false
  816. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 12: tokenizer.ggml.model str = gpt2
  817. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 13: tokenizer.ggml.tokens arr[str,51200] = ["!", "\"", "#", "$", "%", "&", "'", ...
  818. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 14: tokenizer.ggml.token_type arr[i32,51200] = [1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, ...
  819. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 15: tokenizer.ggml.merges arr[str,50000] = ["Ġ t", "Ġ a", "h e", "i n", "r e",...
  820. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 16: tokenizer.ggml.bos_token_id u32 = 50256
  821. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 17: tokenizer.ggml.eos_token_id u32 = 50295
  822. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 18: tokenizer.ggml.unknown_token_id u32 = 50256
  823. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 19: tokenizer.ggml.padding_token_id u32 = 50256
  824. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 20: tokenizer.chat_template str = {{ bos_token }}{%- set ns = namespace...
  825. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 21: general.quantization_version u32 = 2
  826. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - type f32: 195 tensors
  827. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - type q4_0: 129 tensors
  828. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - type q6_K: 1 tensors
  829. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_vocab: mismatch in special tokens definition ( 910/51200 vs 944/51200 ).
  830. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: format = GGUF V3 (latest)
  831. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: arch = phi2
  832. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: vocab type = BPE
  833. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_vocab = 51200
  834. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_merges = 50000
  835. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_ctx_train = 2048
  836. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd = 2560
  837. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_head = 32
  838. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_head_kv = 32
  839. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_layer = 32
  840. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_rot = 32
  841. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_head_k = 80
  842. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_head_v = 80
  843. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_gqa = 1
  844. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_k_gqa = 2560
  845. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_v_gqa = 2560
  846. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_norm_eps = 1.0e-05
  847. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_norm_rms_eps = 0.0e+00
  848. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  849. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  850. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_ff = 10240
  851. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_expert = 0
  852. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_expert_used = 0
  853. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: pooling type = 0
  854. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: rope type = 2
  855. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: rope scaling = linear
  856. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: freq_base_train = 10000.0
  857. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: freq_scale_train = 1
  858. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_yarn_orig_ctx = 2048
  859. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: rope_finetuned = unknown
  860. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model type = 3B
  861. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model ftype = Q4_0
  862. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model params = 2.78 B
  863. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model size = 1.49 GiB (4.61 BPW)
  864. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: general.name = Phi2
  865. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: BOS token = 50256 '<|endoftext|>'
  866. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: EOS token = 50295 '<|im_end|>'
  867. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: UNK token = 50256 '<|endoftext|>'
  868. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: PAD token = 50256 '<|endoftext|>'
  869. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: LF token = 128 'Ä'
  870. Mar 10 12:13:38 ip-172-26-15-150 ollama[3647978]: llm_load_tensors: ggml ctx size = 0.12 MiB
  871. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llm_load_tensors: CPU buffer size = 1526.50 MiB
  872. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: ...........................................................................................
  873. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: n_ctx = 2048
  874. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: freq_base = 10000.0
  875. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: freq_scale = 1
  876. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: ggml_backend_cpu_buffer_type_alloc_buffer: failed to allocate buffer of size 671088672
  877. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llama_kv_cache_init: failed to allocate buffer for kv cache
  878. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: llama_kv_cache_init() failed for self-attention cache
  879. Mar 10 12:14:03 ip-172-26-15-150 ollama[3647978]: llama_init_from_gpt_params: error: failed to create context with model '/usr/share/ollama/.ollama/models/blobs/sha256:4eca7304a07a42c48887f159ef5ad82ed5a5bd30fe52db4aadae1dd938e26f70'
  880. Mar 10 12:14:04 ip-172-26-15-150 ollama[3647978]: loading library /tmp/ollama153347545/cpu_avx2/libext_server.so
  881. Mar 10 12:14:04 ip-172-26-15-150 ollama[3647978]: {"function":"load_model","level":"ERR","line":395,"model":"/usr/share/ollama/.ollama/models/blobs/sha256:4eca7304a07a42c48887f159ef5ad82ed5a5bd30fe52db4aadae1dd938e26f70","msg":"unable to load model","tid":"140560140453632","timestamp":1710072843}
  882. Mar 10 12:14:04 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:14:04.005Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama153347545/cpu_avx2/libext_server.so error loading model /usr/share/ollama/.ollama/models/blobs/sha256:4eca7304a07a42c48887f159ef5ad82ed5a5bd30fe52db4aadae1dd938e26"
  883. Mar 10 12:14:04 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:14:04 | 500 | 26.132523563s | 127.0.0.1 | POST "/api/chat"
  884. Mar 10 12:16:03 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:16:03 | 200 | 40.94µs | 127.0.0.1 | HEAD "/"
  885. Mar 10 12:16:03 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:16:03 | 200 | 12.78176ms | 127.0.0.1 | POST "/api/show"
  886. Mar 10 12:16:03 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:16:03 | 200 | 392.844µs | 127.0.0.1 | POST "/api/show"
  887. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:16:05.648Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  888. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:16:05.649Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  889. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:16:05.649Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  890. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:16:05.653Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama153347545/cpu_avx2/libext_server.so"
  891. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:16:05.654Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  892. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:c1864a5eb19305c40519da12cc543519e48a0697ecd30e15d5ac228644957d12 (version GGUF V3 (latest))
  893. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  894. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 0: general.architecture str = gemma
  895. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 1: general.name str = gemma-2b-it
  896. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  897. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  898. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  899. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  900. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  901. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  902. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  903. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  904. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  905. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  906. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  907. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  908. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  909. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  910. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  911. Mar 10 12:16:05 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  912. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  913. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  914. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - kv 20: general.file_type u32 = 2
  915. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - type f32: 37 tensors
  916. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - type q4_0: 126 tensors
  917. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llama_model_loader: - type q8_0: 1 tensors
  918. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  919. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: format = GGUF V3 (latest)
  920. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: arch = gemma
  921. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: vocab type = SPM
  922. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_vocab = 256128
  923. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_merges = 0
  924. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_ctx_train = 8192
  925. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd = 2048
  926. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_head = 8
  927. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_head_kv = 1
  928. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_layer = 18
  929. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_rot = 256
  930. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_head_k = 256
  931. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_head_v = 256
  932. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_gqa = 8
  933. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_k_gqa = 256
  934. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_embd_v_gqa = 256
  935. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_norm_eps = 0.0e+00
  936. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  937. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  938. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  939. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_ff = 16384
  940. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_expert = 0
  941. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_expert_used = 0
  942. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: pooling type = 0
  943. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: rope type = 2
  944. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: rope scaling = linear
  945. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: freq_base_train = 10000.0
  946. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: freq_scale_train = 1
  947. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  948. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: rope_finetuned = unknown
  949. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model type = 2B
  950. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model ftype = Q4_0
  951. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model params = 2.51 B
  952. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  953. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: general.name = gemma-2b-it
  954. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: BOS token = 2 '<bos>'
  955. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: EOS token = 1 '<eos>'
  956. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: UNK token = 3 '<unk>'
  957. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: PAD token = 0 '<pad>'
  958. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_print_meta: LF token = 227 '<0x0A>'
  959. Mar 10 12:16:06 ip-172-26-15-150 ollama[3647978]: llm_load_tensors: ggml ctx size = 0.06 MiB
  960. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  961. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: .....................................................
  962. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: n_ctx = 2048
  963. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: freq_base = 10000.0
  964. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: freq_scale = 1
  965. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  966. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  967. Mar 10 12:16:33 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:16:33.613Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama153347545/cpu_avx2/libext_server.so exception std::bad_alloc"
  968. Mar 10 12:16:34 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:16:33 | 500 | 30.06166594s | 127.0.0.1 | POST "/api/chat"
  969. Mar 10 12:26:25 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:25 | 200 | 1.738482ms | 127.0.0.1 | HEAD "/"
  970. Mar 10 12:26:25 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:25 | 200 | 11.092371ms | 127.0.0.1 | GET "/api/tags"
  971. Mar 10 12:26:36 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:36 | 200 | 26.868µs | 127.0.0.1 | HEAD "/"
  972. Mar 10 12:26:36 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:36 | 200 | 18.775192ms | 127.0.0.1 | DELETE "/api/delete"
  973. Mar 10 12:26:40 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:40 | 200 | 27.216µs | 127.0.0.1 | HEAD "/"
  974. Mar 10 12:26:40 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:40 | 200 | 388.413µs | 127.0.0.1 | GET "/api/tags"
  975. Mar 10 12:26:53 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:53 | 200 | 48.142µs | 127.0.0.1 | HEAD "/"
  976. Mar 10 12:26:53 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:26:53 | 200 | 571.901µs | 127.0.0.1 | DELETE "/api/delete"
  977. Mar 10 12:27:04 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:27:04 | 200 | 34.168µs | 127.0.0.1 | HEAD "/"
  978. Mar 10 12:27:04 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:27:04 | 404 | 105.115µs | 127.0.0.1 | POST "/api/show"
  979. Mar 10 12:27:04 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:27:04 | 200 | 333.794438ms | 127.0.0.1 | POST "/api/pull"
  980. Mar 10 12:28:00 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:28:00 | 200 | 28.452µs | 127.0.0.1 | HEAD "/"
  981. Mar 10 12:28:00 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:28:00 | 404 | 83.282µs | 127.0.0.1 | POST "/api/show"
  982. Mar 10 12:28:02 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:28:02.118Z level=INFO source=download.go:136 msg="downloading 456402914e83 in 53 100 MB part(s)"
  983. Mar 10 12:28:17 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:28:17.126Z level=INFO source=download.go:250 msg="456402914e83 part 51 stalled; retrying"
  984. Mar 10 12:28:27 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:28:27.130Z level=INFO source=download.go:250 msg="456402914e83 part 28 stalled; retrying"
  985. Mar 10 12:28:50 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:28:50.124Z level=INFO source=download.go:250 msg="456402914e83 part 4 stalled; retrying"
  986. Mar 10 12:29:42 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:29:42 | 200 | 1m41s | 127.0.0.1 | POST "/api/pull"
  987. Mar 10 12:29:44 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:29:44 | 200 | 1.406437ms | 127.0.0.1 | HEAD "/"
  988. Mar 10 12:29:44 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:29:44 | 404 | 709.71µs | 127.0.0.1 | POST "/api/show"
  989. Mar 10 12:29:44 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:29:44.907Z level=INFO source=download.go:136 msg="downloading 456402914e83 in 53 100 MB part(s)"
  990. Mar 10 12:29:49 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:29:49.898Z level=INFO source=download.go:136 msg="downloading 097a36493f71 in 1 8.4 KB part(s)"
  991. Mar 10 12:29:52 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:29:52.856Z level=INFO source=download.go:136 msg="downloading 109037bec39c in 1 136 B part(s)"
  992. Mar 10 12:29:54 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:29:54.579Z level=INFO source=download.go:136 msg="downloading 22a838ceb7fb in 1 84 B part(s)"
  993. Mar 10 12:29:56 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:29:56.277Z level=INFO source=download.go:136 msg="downloading a443857c4317 in 1 483 B part(s)"
  994. Mar 10 12:31:17 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:31:17 | 200 | 1m33s | 127.0.0.1 | POST "/api/pull"
  995. Mar 10 12:31:17 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:31:17 | 200 | 29.229161ms | 127.0.0.1 | POST "/api/show"
  996. Mar 10 12:31:17 ip-172-26-15-150 ollama[3647978]: [GIN] 2024/03/10 - 12:31:17 | 200 | 386.987µs | 127.0.0.1 | POST "/api/show"
  997. Mar 10 12:33:26 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:33:26.671Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  998. Mar 10 12:33:27 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:33:26.889Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  999. Mar 10 12:33:27 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:33:27.347Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  1000. Mar 10 12:33:28 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:33:27.813Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama153347545/cpu_avx2/libext_server.so"
  1001. Mar 10 12:33:28 ip-172-26-15-150 ollama[3647978]: time=2024-03-10T12:33:28.216Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  1002. Mar 10 12:37:10 ip-172-26-15-150 systemd[1]: ollama.service: Scheduled restart job, restart counter is at 5.
  1003. Mar 10 12:37:10 ip-172-26-15-150 systemd[1]: Stopped Ollama Service.
  1004. Mar 10 12:37:10 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  1005. Mar 10 12:37:10 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:10.578Z level=INFO source=images.go:710 msg="total blobs: 5"
  1006. Mar 10 12:37:10 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:10.588Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  1007. Mar 10 12:37:10 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:10.589Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  1008. Mar 10 12:37:10 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:10.593Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  1009. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.821Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cpu_avx cpu_avx2 rocm_v5 cuda_v11 rocm_v6 cpu]"
  1010. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.825Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  1011. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.825Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  1012. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.835Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  1013. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.835Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  1014. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.835Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  1015. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.835Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1016. Mar 10 12:37:20 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:37:20.838Z level=INFO source=routes.go:1044 msg="no GPU detected"
  1017. Mar 10 12:37:56 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:37:56 | 200 | 1.997308ms | 127.0.0.1 | HEAD "/"
  1018. Mar 10 12:37:56 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:37:56 | 200 | 9.321171ms | 127.0.0.1 | GET "/api/tags"
  1019. Mar 10 12:38:01 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:38:01 | 200 | 31.406µs | 127.0.0.1 | HEAD "/"
  1020. Mar 10 12:38:01 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:38:01 | 200 | 102.181566ms | 127.0.0.1 | DELETE "/api/delete"
  1021. Mar 10 12:39:06 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:39:06 | 200 | 30.168µs | 127.0.0.1 | HEAD "/"
  1022. Mar 10 12:39:06 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:39:06 | 404 | 110.474µs | 127.0.0.1 | POST "/api/show"
  1023. Mar 10 12:39:08 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:39:08.253Z level=INFO source=download.go:136 msg="downloading f5bcce7c7bc5 in 17 100 MB part(s)"
  1024. Mar 10 12:39:39 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:39:39.990Z level=INFO source=download.go:136 msg="downloading 097a36493f71 in 1 8.4 KB part(s)"
  1025. Mar 10 12:39:41 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:39:41.781Z level=INFO source=download.go:136 msg="downloading 4b98b1f4c59c in 1 21 B part(s)"
  1026. Mar 10 12:39:43 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:39:43.528Z level=INFO source=download.go:136 msg="downloading 6df9577c158a in 1 409 B part(s)"
  1027. Mar 10 12:40:09 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:40:09 | 200 | 1m3s | 127.0.0.1 | POST "/api/pull"
  1028. Mar 10 12:40:09 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:40:09 | 200 | 2.008584ms | 127.0.0.1 | POST "/api/show"
  1029. Mar 10 12:40:09 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:40:09 | 200 | 739.312µs | 127.0.0.1 | POST "/api/show"
  1030. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:40:11.703Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1031. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:40:11.704Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1032. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:40:11.704Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  1033. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:40:11.726Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama1128862960/cpu_avx2/libext_server.so"
  1034. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:40:11.726Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  1035. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:f5bcce7c7bc5e8e83365cd084c13c9f299849c2a266082c3e4e9656d2657813d (version GGUF V3 (latest))
  1036. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  1037. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 0: general.architecture str = gemma
  1038. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 1: general.name str = gemma-2b
  1039. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  1040. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  1041. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  1042. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  1043. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  1044. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  1045. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  1046. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  1047. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  1048. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  1049. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  1050. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  1051. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  1052. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  1053. Mar 10 12:40:11 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  1054. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  1055. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  1056. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  1057. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 20: general.file_type u32 = 2
  1058. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - type f32: 37 tensors
  1059. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - type q4_0: 126 tensors
  1060. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - type q8_0: 1 tensors
  1061. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  1062. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: format = GGUF V3 (latest)
  1063. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: arch = gemma
  1064. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: vocab type = SPM
  1065. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_vocab = 256128
  1066. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_merges = 0
  1067. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_ctx_train = 8192
  1068. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd = 2048
  1069. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_head = 8
  1070. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_head_kv = 1
  1071. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_layer = 18
  1072. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_rot = 256
  1073. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_head_k = 256
  1074. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_head_v = 256
  1075. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_gqa = 8
  1076. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_k_gqa = 256
  1077. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_v_gqa = 256
  1078. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_norm_eps = 0.0e+00
  1079. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  1080. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  1081. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  1082. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_ff = 16384
  1083. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_expert = 0
  1084. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_expert_used = 0
  1085. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: pooling type = 0
  1086. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: rope type = 2
  1087. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: rope scaling = linear
  1088. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: freq_base_train = 10000.0
  1089. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: freq_scale_train = 1
  1090. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  1091. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: rope_finetuned = unknown
  1092. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model type = 2B
  1093. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model ftype = Q4_0
  1094. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model params = 2.51 B
  1095. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  1096. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: general.name = gemma-2b
  1097. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: BOS token = 2 '<bos>'
  1098. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: EOS token = 1 '<eos>'
  1099. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: UNK token = 3 '<unk>'
  1100. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: PAD token = 0 '<pad>'
  1101. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: LF token = 227 '<0x0A>'
  1102. Mar 10 12:40:12 ip-172-26-15-150 ollama[3648457]: llm_load_tensors: ggml ctx size = 0.06 MiB
  1103. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  1104. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: .....................................................
  1105. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: n_ctx = 2048
  1106. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: freq_base = 10000.0
  1107. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: freq_scale = 1
  1108. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  1109. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  1110. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:40:38.809Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama1128862960/cpu_avx2/libext_server.so exception std::bad_alloc"
  1111. Mar 10 12:40:38 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:40:38 | 500 | 29.078941253s | 127.0.0.1 | POST "/api/chat"
  1112. Mar 10 12:43:03 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:43:03 | 200 | 5.843366ms | 127.0.0.1 | HEAD "/"
  1113. Mar 10 12:43:03 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:43:03 | 200 | 7.200325ms | 127.0.0.1 | POST "/api/show"
  1114. Mar 10 12:43:03 ip-172-26-15-150 ollama[3648457]: [GIN] 2024/03/10 - 12:43:03 | 200 | 281.344µs | 127.0.0.1 | POST "/api/show"
  1115. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:43:05.584Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1116. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:43:05.588Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1117. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:43:05.588Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  1118. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:43:05.591Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama1128862960/cpu_avx2/libext_server.so"
  1119. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: time=2024-03-10T12:43:05.591Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  1120. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:f5bcce7c7bc5e8e83365cd084c13c9f299849c2a266082c3e4e9656d2657813d (version GGUF V3 (latest))
  1121. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  1122. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 0: general.architecture str = gemma
  1123. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 1: general.name str = gemma-2b
  1124. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  1125. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  1126. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  1127. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  1128. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  1129. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  1130. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  1131. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  1132. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  1133. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  1134. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  1135. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  1136. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  1137. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  1138. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  1139. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  1140. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  1141. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  1142. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - kv 20: general.file_type u32 = 2
  1143. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - type f32: 37 tensors
  1144. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - type q4_0: 126 tensors
  1145. Mar 10 12:43:05 ip-172-26-15-150 ollama[3648457]: llama_model_loader: - type q8_0: 1 tensors
  1146. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  1147. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: format = GGUF V3 (latest)
  1148. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: arch = gemma
  1149. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: vocab type = SPM
  1150. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_vocab = 256128
  1151. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_merges = 0
  1152. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_ctx_train = 8192
  1153. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd = 2048
  1154. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_head = 8
  1155. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_head_kv = 1
  1156. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_layer = 18
  1157. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_rot = 256
  1158. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_head_k = 256
  1159. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_head_v = 256
  1160. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_gqa = 8
  1161. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_k_gqa = 256
  1162. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_embd_v_gqa = 256
  1163. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_norm_eps = 0.0e+00
  1164. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  1165. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  1166. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  1167. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_ff = 16384
  1168. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_expert = 0
  1169. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_expert_used = 0
  1170. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: pooling type = 0
  1171. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: rope type = 2
  1172. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: rope scaling = linear
  1173. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: freq_base_train = 10000.0
  1174. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: freq_scale_train = 1
  1175. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  1176. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: rope_finetuned = unknown
  1177. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model type = 2B
  1178. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model ftype = Q4_0
  1179. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model params = 2.51 B
  1180. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  1181. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: general.name = gemma-2b
  1182. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: BOS token = 2 '<bos>'
  1183. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: EOS token = 1 '<eos>'
  1184. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: UNK token = 3 '<unk>'
  1185. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: PAD token = 0 '<pad>'
  1186. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_print_meta: LF token = 227 '<0x0A>'
  1187. Mar 10 12:43:06 ip-172-26-15-150 ollama[3648457]: llm_load_tensors: ggml ctx size = 0.06 MiB
  1188. Mar 10 12:43:35 ip-172-26-15-150 ollama[3648457]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  1189. Mar 10 12:43:35 ip-172-26-15-150 ollama[3648457]: .....................................................
  1190. Mar 10 12:43:37 ip-172-26-15-150 systemd[1]: ollama.service: Main process exited, code=killed, status=9/KILL
  1191. Mar 10 12:43:37 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: n_ctx = 2048
  1192. Mar 10 12:43:37 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: freq_base = 10000.0
  1193. Mar 10 12:43:37 ip-172-26-15-150 ollama[3648457]: llama_new_context_with_model: freq_scale = 1
  1194. Mar 10 12:43:37 ip-172-26-15-150 systemd[1]: ollama.service: Failed with result 'signal'.
  1195. Mar 10 12:43:37 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 36.687s CPU time.
  1196. Mar 10 12:43:40 ip-172-26-15-150 systemd[1]: ollama.service: Scheduled restart job, restart counter is at 6.
  1197. Mar 10 12:43:40 ip-172-26-15-150 systemd[1]: Stopped Ollama Service.
  1198. Mar 10 12:43:40 ip-172-26-15-150 systemd[1]: ollama.service: Consumed 36.687s CPU time.
  1199. Mar 10 12:43:40 ip-172-26-15-150 systemd[1]: Started Ollama Service.
  1200. Mar 10 12:43:40 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:40.584Z level=INFO source=images.go:710 msg="total blobs: 4"
  1201. Mar 10 12:43:40 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:40.592Z level=INFO source=images.go:717 msg="total unused blobs removed: 0"
  1202. Mar 10 12:43:40 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:40.595Z level=INFO source=routes.go:1021 msg="Listening on 127.0.0.1:11434 (version 0.1.28)"
  1203. Mar 10 12:43:40 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:40.595Z level=INFO source=payload_common.go:107 msg="Extracting dynamic libraries..."
  1204. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.139Z level=INFO source=payload_common.go:146 msg="Dynamic LLM libraries [cpu_avx cpu_avx2 cuda_v11 rocm_v5 rocm_v6 cpu]"
  1205. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.142Z level=INFO source=gpu.go:94 msg="Detecting GPU type"
  1206. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.142Z level=INFO source=gpu.go:265 msg="Searching for GPU management library libnvidia-ml.so"
  1207. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.155Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  1208. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.155Z level=INFO source=gpu.go:265 msg="Searching for GPU management library librocm_smi64.so"
  1209. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.156Z level=INFO source=gpu.go:311 msg="Discovered GPU libraries: []"
  1210. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.156Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1211. Mar 10 12:43:48 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:43:48.157Z level=INFO source=routes.go:1044 msg="no GPU detected"
  1212. Mar 10 12:46:57 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:46:57 | 200 | 3.224014ms | 127.0.0.1 | GET "/api/version"
  1213. Mar 10 12:51:29 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:51:29 | 200 | 2.183632ms | 127.0.0.1 | HEAD "/"
  1214. Mar 10 12:51:29 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:51:29 | 200 | 11.115282ms | 127.0.0.1 | GET "/api/tags"
  1215. Mar 10 12:51:58 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:51:58 | 200 | 27.061µs | 127.0.0.1 | HEAD "/"
  1216. Mar 10 12:51:58 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:51:58 | 200 | 1.159751ms | 127.0.0.1 | POST "/api/show"
  1217. Mar 10 12:51:58 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:51:58 | 200 | 603.377µs | 127.0.0.1 | POST "/api/show"
  1218. Mar 10 12:52:00 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:52:00.889Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1219. Mar 10 12:52:00 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:52:00.892Z level=INFO source=cpu_common.go:11 msg="CPU has AVX2"
  1220. Mar 10 12:52:00 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:52:00.892Z level=INFO source=llm.go:77 msg="GPU not available, falling back to CPU"
  1221. Mar 10 12:52:00 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:52:00.929Z level=INFO source=dyn_ext_server.go:90 msg="Loading Dynamic llm server: /tmp/ollama136388332/cpu_avx2/libext_server.so"
  1222. Mar 10 12:52:00 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:52:00.929Z level=INFO source=dyn_ext_server.go:150 msg="Initializing llama server"
  1223. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: loaded meta data with 21 key-value pairs and 164 tensors from /usr/share/ollama/.ollama/models/blobs/sha256:f5bcce7c7bc5e8e83365cd084c13c9f299849c2a266082c3e4e9656d2657813d (version GGUF V3 (latest))
  1224. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: Dumping metadata keys/values. Note: KV overrides do not apply in this output.
  1225. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 0: general.architecture str = gemma
  1226. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 1: general.name str = gemma-2b
  1227. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 2: gemma.context_length u32 = 8192
  1228. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 3: gemma.block_count u32 = 18
  1229. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 4: gemma.embedding_length u32 = 2048
  1230. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 5: gemma.feed_forward_length u32 = 16384
  1231. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 6: gemma.attention.head_count u32 = 8
  1232. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 7: gemma.attention.head_count_kv u32 = 1
  1233. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 8: gemma.attention.key_length u32 = 256
  1234. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 9: gemma.attention.value_length u32 = 256
  1235. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 10: gemma.attention.layer_norm_rms_epsilon f32 = 0.000001
  1236. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 11: tokenizer.ggml.model str = llama
  1237. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 12: tokenizer.ggml.bos_token_id u32 = 2
  1238. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 13: tokenizer.ggml.eos_token_id u32 = 1
  1239. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 14: tokenizer.ggml.padding_token_id u32 = 0
  1240. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 15: tokenizer.ggml.unknown_token_id u32 = 3
  1241. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 16: tokenizer.ggml.tokens arr[str,256128] = ["<pad>", "<eos>", "<bos>", "<unk>", ...
  1242. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 17: tokenizer.ggml.scores arr[f32,256128] = [0.000000, 0.000000, 0.000000, 0.0000...
  1243. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 18: tokenizer.ggml.token_type arr[i32,256128] = [3, 3, 3, 2, 1, 1, 1, 1, 1, 1, 1, 1, ...
  1244. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 19: general.quantization_version u32 = 2
  1245. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - kv 20: general.file_type u32 = 2
  1246. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - type f32: 37 tensors
  1247. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - type q4_0: 126 tensors
  1248. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llama_model_loader: - type q8_0: 1 tensors
  1249. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_vocab: mismatch in special tokens definition ( 544/256128 vs 388/256128 ).
  1250. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: format = GGUF V3 (latest)
  1251. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: arch = gemma
  1252. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: vocab type = SPM
  1253. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_vocab = 256128
  1254. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_merges = 0
  1255. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_ctx_train = 8192
  1256. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_embd = 2048
  1257. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_head = 8
  1258. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_head_kv = 1
  1259. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_layer = 18
  1260. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_rot = 256
  1261. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_embd_head_k = 256
  1262. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_embd_head_v = 256
  1263. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_gqa = 8
  1264. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_embd_k_gqa = 256
  1265. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_embd_v_gqa = 256
  1266. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: f_norm_eps = 0.0e+00
  1267. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: f_norm_rms_eps = 1.0e-06
  1268. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: f_clamp_kqv = 0.0e+00
  1269. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: f_max_alibi_bias = 0.0e+00
  1270. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_ff = 16384
  1271. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_expert = 0
  1272. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_expert_used = 0
  1273. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: pooling type = 0
  1274. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: rope type = 2
  1275. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: rope scaling = linear
  1276. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: freq_base_train = 10000.0
  1277. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: freq_scale_train = 1
  1278. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: n_yarn_orig_ctx = 8192
  1279. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: rope_finetuned = unknown
  1280. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: model type = 2B
  1281. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: model ftype = Q4_0
  1282. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: model params = 2.51 B
  1283. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: model size = 1.56 GiB (5.34 BPW)
  1284. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: general.name = gemma-2b
  1285. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: BOS token = 2 '<bos>'
  1286. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: EOS token = 1 '<eos>'
  1287. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: UNK token = 3 '<unk>'
  1288. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: PAD token = 0 '<pad>'
  1289. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_print_meta: LF token = 227 '<0x0A>'
  1290. Mar 10 12:52:01 ip-172-26-15-150 ollama[3648622]: llm_load_tensors: ggml ctx size = 0.06 MiB
  1291. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: llm_load_tensors: CPU buffer size = 1594.93 MiB
  1292. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: .....................................................
  1293. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: llama_new_context_with_model: n_ctx = 2048
  1294. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: llama_new_context_with_model: freq_base = 10000.0
  1295. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: llama_new_context_with_model: freq_scale = 1
  1296. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: llama_kv_cache_init: CPU KV buffer size = 36.00 MiB
  1297. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: llama_new_context_with_model: KV self size = 36.00 MiB, K (f16): 18.00 MiB, V (f16): 18.00 MiB
  1298. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: time=2024-03-10T12:52:28.455Z level=WARN source=llm.go:162 msg="Failed to load dynamic library /tmp/ollama136388332/cpu_avx2/libext_server.so exception std::bad_alloc"
  1299. Mar 10 12:52:28 ip-172-26-15-150 ollama[3648622]: [GIN] 2024/03/10 - 12:52:28 | 500 | 29.543704261s | 127.0.0.1 | POST "/api/chat"
  1300.  
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!