API tools faq
paste
Advertisement
Seedmanc

faraday log

Seedmanc
Jul 27th, 2024 (edited)
70
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 24.09 KB | None | 0 0
raw download clone embed print report
  1. [2024-08-10 20:39:47.641] [info] model root path created
  2. [2024-08-10 20:39:54.516] [info] process PID 9704 3304
  3. [2024-08-10 20:39:59.523] [info] process PID 5164 3304
  4. [2024-08-10 20:40:09.843] [info] Applying migration: 000000001000_init....
  5. [2024-08-10 20:40:09.867] [info] Successfully applied migration: 000000001000_init
  6. [2024-08-10 20:40:09.868] [info] Applying migration: 20230817215457_added_open_cl_platform_number....
  7. [2024-08-10 20:40:09.882] [info] Successfully applied migration: 20230817215457_added_open_cl_platform_number
  8. [2024-08-10 20:40:09.882] [info] Applying migration: 20230823022257_new_cache....
  9. [2024-08-10 20:40:09.893] [info] Successfully applied migration: 20230823022257_new_cache
  10. [2024-08-10 20:40:09.894] [info] Applying migration: 20230823175607_grammar....
  11. [2024-08-10 20:40:09.903] [info] Successfully applied migration: 20230823175607_grammar
  12. [2024-08-10 20:40:09.904] [info] Applying migration: 20230823213117_model_layer_mapping....
  13. [2024-08-10 20:40:09.913] [info] Successfully applied migration: 20230823213117_model_layer_mapping
  14. [2024-08-10 20:40:09.914] [info] Applying migration: 20230824231007_lower_context....
  15. [2024-08-10 20:40:09.929] [info] Successfully applied migration: 20230824231007_lower_context
  16. [2024-08-10 20:40:09.929] [info] Applying migration: 20230825224958_added_nsfw_to_local....
  17. [2024-08-10 20:40:09.943] [info] Successfully applied migration: 20230825224958_added_nsfw_to_local
  18. [2024-08-10 20:40:09.944] [info] Applying migration: 20230828221752_added_tags....
  19. [2024-08-10 20:40:09.955] [info] Successfully applied migration: 20230828221752_added_tags
  20. [2024-08-10 20:40:09.955] [info] Applying migration: 20230828222550_added_pinned....
  21. [2024-08-10 20:40:09.970] [info] Successfully applied migration: 20230828222550_added_pinned
  22. [2024-08-10 20:40:09.970] [info] Applying migration: 20230829235119_use_ctx_in_cache....
  23. [2024-08-10 20:40:09.988] [info] Successfully applied migration: 20230829235119_use_ctx_in_cache
  24. [2024-08-10 20:40:09.988] [info] Applying migration: 20230830221903_lorebook....
  25. [2024-08-10 20:40:10.001] [info] Successfully applied migration: 20230830221903_lorebook
  26. [2024-08-10 20:40:10.002] [info] Applying migration: 20230905202236_added_null_to_metal_support....
  27. [2024-08-10 20:40:10.014] [info] Successfully applied migration: 20230905202236_added_null_to_metal_support
  28. [2024-08-10 20:40:10.015] [info] Applying migration: 20230905210814_added_hub....
  29. [2024-08-10 20:40:10.023] [info] Successfully applied migration: 20230905210814_added_hub
  30. [2024-08-10 20:40:10.024] [info] Applying migration: 20230911185620_author_note....
  31. [2024-08-10 20:40:10.038] [info] Successfully applied migration: 20230911185620_author_note
  32. [2024-08-10 20:40:10.038] [info] Applying migration: 20230911222644_remove_threads....
  33. [2024-08-10 20:40:10.051] [info] Successfully applied migration: 20230911222644_remove_threads
  34. [2024-08-10 20:40:10.052] [info] Applying migration: 20230918200612_added_first_version_run....
  35. [2024-08-10 20:40:10.239] [info] Successfully applied migration: 20230918200612_added_first_version_run
  36. [2024-08-10 20:40:10.240] [info] Applying migration: 20231003054732_added_cache_to_gpu_layers....
  37. [2024-08-10 20:40:10.265] [info] Successfully applied migration: 20231003054732_added_cache_to_gpu_layers
  38. [2024-08-10 20:40:10.265] [info] Applying migration: 20231012005010_user_persona....
  39. [2024-08-10 20:40:10.279] [info] Successfully applied migration: 20231012005010_user_persona
  40. [2024-08-10 20:40:10.279] [info] Applying migration: 20231101173615_added_bin_version....
  41. [2024-08-10 20:40:10.288] [info] Successfully applied migration: 20231101173615_added_bin_version
  42. [2024-08-10 20:40:10.289] [info] Applying migration: 20231121192558_layer_bin_version....
  43. [2024-08-10 20:40:10.312] [info] Successfully applied migration: 20231121192558_layer_bin_version
  44. [2024-08-10 20:40:10.313] [info] Applying migration: 20231128085355_remote_connections....
  45. [2024-08-10 20:40:10.328] [info] Successfully applied migration: 20231128085355_remote_connections
  46. [2024-08-10 20:40:10.329] [info] Applying migration: 20231215214940_min_p....
  47. [2024-08-10 20:40:10.343] [info] Successfully applied migration: 20231215214940_min_p
  48. [2024-08-10 20:40:10.343] [info] Applying migration: 20231220132828_min_p_existing....
  49. [2024-08-10 20:40:10.352] [info] Successfully applied migration: 20231220132828_min_p_existing
  50. [2024-08-10 20:40:10.353] [info] Applying migration: 20231222222656_tts....
  51. [2024-08-10 20:40:10.369] [info] Successfully applied migration: 20231222222656_tts
  52. [2024-08-10 20:40:10.369] [info] Applying migration: 20240104000004_tts_input_filter....
  53. [2024-08-10 20:40:10.525] [info] Successfully applied migration: 20240104000004_tts_input_filter
  54. [2024-08-10 20:40:10.526] [info] Applying migration: 20240108214233_tts_speed....
  55. [2024-08-10 20:40:10.552] [info] Successfully applied migration: 20240108214233_tts_speed
  56. [2024-08-10 20:40:10.553] [info] Applying migration: 20240125203611_prompt_template....
  57. [2024-08-10 20:40:10.565] [info] Successfully applied migration: 20240125203611_prompt_template
  58. [2024-08-10 20:40:10.565] [info] Applying migration: 20240126212027_layer_samples....
  59. [2024-08-10 20:40:10.578] [info] Successfully applied migration: 20240126212027_layer_samples
  60. [2024-08-10 20:40:10.579] [info] Applying migration: 20240131193503_refactor_layer_sample....
  61. [2024-08-10 20:40:10.591] [info] Successfully applied migration: 20240131193503_refactor_layer_sample
  62. [2024-08-10 20:40:10.591] [info] Applying migration: 20240205183300_remove_scratch_null....
  63. [2024-08-10 20:40:10.604] [info] Successfully applied migration: 20240205183300_remove_scratch_null
  64. [2024-08-10 20:40:10.605] [info] Applying migration: 20240207032349_add_cache_key....
  65. [2024-08-10 20:40:10.617] [info] Successfully applied migration: 20240207032349_add_cache_key
  66. [2024-08-10 20:40:10.618] [info] Applying migration: 20240215170921_active_gpu....
  67. [2024-08-10 20:40:10.630] [info] Successfully applied migration: 20240215170921_active_gpu
  68. [2024-08-10 20:40:10.631] [info] Applying migration: 20240222183503_can_delete_custom_dialogue....
  69. [2024-08-10 20:40:10.645] [info] Successfully applied migration: 20240222183503_can_delete_custom_dialogue
  70. [2024-08-10 20:40:10.646] [info] Applying migration: 20240319224426_char_duplicate_fix....
  71. [2024-08-10 20:40:10.656] [info] Successfully applied migration: 20240319224426_char_duplicate_fix
  72. [2024-08-10 20:40:10.656] [info] Applying migration: 20240408142001_multiple_images....
  73. [2024-08-10 20:40:10.671] [info] Successfully applied migration: 20240408142001_multiple_images
  74. [2024-08-10 20:40:10.671] [info] Applying migration: 20240419224718_chat_item_output....
  75. [2024-08-10 20:40:10.685] [info] Successfully applied migration: 20240419224718_chat_item_output
  76. [2024-08-10 20:40:10.686] [info] Applying migration: 20240426154057_multiple_user_personas....
  77. [2024-08-10 20:40:10.703] [info] Successfully applied migration: 20240426154057_multiple_user_personas
  78. [2024-08-10 20:40:10.704] [info] Applying migration: 20240516133919_lorebook_improvements....
  79. [2024-08-10 20:40:10.720] [info] Successfully applied migration: 20240516133919_lorebook_improvements
  80. [2024-08-10 20:40:10.720] [info] Applying migration: 20240528124455_remove_lore_json_field....
  81. [2024-08-10 20:40:10.736] [info] Successfully applied migration: 20240528124455_remove_lore_json_field
  82. [2024-08-10 20:40:10.737] [info] Applying migration: 20240529005808_fix_lore_order....
  83. [2024-08-10 20:40:10.747] [info] Successfully applied migration: 20240529005808_fix_lore_order
  84. [2024-08-10 20:40:10.747] [info] Applying migration: 20240529220846_beta_updates....
  85. [2024-08-10 20:40:10.761] [info] Successfully applied migration: 20240529220846_beta_updates
  86. [2024-08-10 20:40:10.761] [info] Applying migration: 20240614100810_fix_beta....
  87. [2024-08-10 20:40:10.775] [info] Successfully applied migration: 20240614100810_fix_beta
  88. [2024-08-10 20:40:10.775] [info] Applying migration: 20240619022550_scratch_buffer....
  89. [2024-08-10 20:40:10.785] [info] Successfully applied migration: 20240619022550_scratch_buffer
  90. [2024-08-10 20:40:10.785] [info] Applying migration: 20240620215052_added_aspect_ratio_to_images....
  91. [2024-08-10 20:40:10.795] [info] Successfully applied migration: 20240620215052_added_aspect_ratio_to_images
  92. [2024-08-10 20:40:10.795] [info] Applying migration: 20240621171238_beta_updates_default....
  93. [2024-08-10 20:40:10.809] [info] Successfully applied migration: 20240621171238_beta_updates_default
  94. [2024-08-10 20:40:10.810] [info] Applying migration: 20240624203143_homepage_sort....
  95. [2024-08-10 20:40:10.823] [info] Successfully applied migration: 20240624203143_homepage_sort
  96. [2024-08-10 20:40:10.824] [info] Applying migration: 20240715195514_added_folders....
  97. [2024-08-10 20:40:10.843] [info] Successfully applied migration: 20240715195514_added_folders
  98. [2024-08-10 20:40:10.844] [info] Applying migration: 20240723013115_homepage_folder....
  99. [2024-08-10 20:40:10.872] [info] Successfully applied migration: 20240723013115_homepage_folder
  100. [2024-08-10 20:40:10.873] [info] Database migration done!
  101. [2024-08-10 20:40:10.874] [info] Migrating Image Aspect Ratio
  102. [2024-08-10 20:40:10.877] [info] Total avatar images without aspectRatio: 0
  103. [2024-08-10 20:40:10.877] [info] Image Aspect Ratio Migration Done!
  104. [2024-08-10 20:40:10.877] [info] Migrating Folder Position
  105. [2024-08-10 20:40:10.881] [info] Folder Position Migration Done!
  106. [2024-08-10 20:40:10.881] [info] Migrating No Parent Folder
  107. [2024-08-10 20:40:10.884] [info] No Parent Folder Migration Done!
  108. [2024-08-10 20:40:12.361] [info] model root path created
  109. [2024-08-10 20:40:12.848] [info] Has patch update but has beta updates off. Skipping
  110. [2024-08-10 20:40:14.327] [info] Pending deeplink url waiting to be handled: --squirrel-firstrun
  111. [2024-08-10 20:41:17.489] [info] Starting gpu detection for cublas-12.1.0
  112. [2024-08-10 20:41:20.291] [info] Finished gpu detection for cublas-12.1.0 after 2802 ms
  113. [2024-08-10 20:41:20.292] [info] Set cached value for gpu detection for cublas-12.1.0
  114. [2024-08-10 20:41:20.293] [info] Starting gpu detection for clblast
  115. [2024-08-10 20:41:20.842] [info] Finished gpu detection for clblast after 549 ms
  116. [2024-08-10 20:41:20.843] [info] Set cached value for gpu detection for clblast
  117. [2024-08-10 20:41:20.843] [info] Starting gpu detection for vulkan
  118. [2024-08-10 20:41:21.770] [info] Finished gpu detection for vulkan after 927 ms
  119. [2024-08-10 20:41:21.771] [info] Set cached value for gpu detection for vulkan
  120. [2024-08-10 20:41:47.091] [info] Using cached value for gpu detection for cublas-12.1.0
  121. [2024-08-10 20:41:47.092] [info] Using cached value for gpu detection for clblast
  122. [2024-08-10 20:41:47.092] [info] Using cached value for gpu detection for vulkan
  123. [2024-08-10 20:45:16.760] [info] Has patch update but has beta updates off. Skipping
  124. [2024-08-10 20:50:16.232] [info] Has patch update but has beta updates off. Skipping
  125. [2024-08-10 20:55:13.355] [info] Has patch update but has beta updates off. Skipping
  126. [2024-08-10 20:55:40.413] [info] Detecting model architecture took 890 ms
  127. [2024-08-10 20:55:40.414] [info] Warning: tried to access the current historyStart from a different chat.
  128. [2024-08-10 20:55:40.430] [info] Spawning new model process...
  129. [2024-08-10 20:55:40.430] [info] Entered init()
  130. [2024-08-10 20:55:40.431] [info] Dispatching action "SPAWN"
  131. [2024-08-10 20:55:40.432] [info] Handling side effects after entering state "spawning-px"
  132. [2024-08-10 20:55:40.459] [info] Spawning model px: { gpuLayers: 0, isAtMaxLayers: false }
  133. [2024-08-10 20:55:40.461] [info] Spawning llama server process...
  134. [2024-08-10 20:55:41.391] [info] Parsing GGUF model header took 871 ms
  135. [2024-08-10 20:55:41.392] [info] Detected model architecture: llama
  136. [2024-08-10 20:55:41.392] [info] Rope params: {
  137. ropeFreqBase: 10000,
  138. ropeFreqScale: 1,
  139. finetuneContextLength: 8192,
  140. ctxSize: 4096
  141. }
  142. [2024-08-10 20:55:41.393] [info] {
  143. model: 'mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  144. llamaBin: 'llama-cpp-binaries\\windows\\nogpu\\v0.25.28\\avx\\backyard.exe',
  145. flags: [
  146. '--host',
  147. '127.0.0.1',
  148. '--port',
  149. '13333',
  150. '--model',
  151. 'C:\\Users\\paran\\AppData\\Roaming\\faraday\\models\\mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  152. '--ctx-size',
  153. '4096',
  154. '--rope-freq-base',
  155. '10000',
  156. '--rope-freq-scale',
  157. '1',
  158. '--batch-size',
  159. '512',
  160. '--log-disable',
  161. '--flash-attn',
  162. '--mlock',
  163. '--n-gpu-layers',
  164. '0'
  165. ]
  166. }
  167. [2024-08-10 20:55:41.394] [info] Attempting to start llama process {}
  168. [2024-08-10 20:55:42.295] [info] Spawned llama process, pid: 6916 GPU Acceleration: 0
  169. [2024-08-10 20:55:42.296] [info] Dispatching action "SPAWN_DONE"
  170. [2024-08-10 20:55:42.296] [info] Finished init()
  171. [2024-08-10 20:55:42.297] [info] Handling side effects after entering state "starting-llama"
  172. [2024-08-10 20:55:42.298] [info] Starting llama server...
  173. [2024-08-10 20:55:42.344] [info]
  174. ___STDERR___
  175. warning: not compiled with GPU offload support, --gpu-layers option will be ignored
  176. warning: see main README.md for information on enabling GPU BLAS support
  177.  
  178. ............
  179. warning: not compiled with GPU offload support, --gpu-layers option will be ignored
  180. warning: see main README.md for information on enabling GPU BLAS support
  181.  
  182. ___STDERR___
  183. [2024-08-10 20:55:42.345] [error] Unexpected error initializing server: Error: Model process unexpectedly failed, exitCode: 3221225501, signal: null
  184. at ChildProcess.<anonymous> (C:\Users\paran\AppData\Local\faraday\app-0.26.0\resources\app.asar\dist\server\main.js:1080:13524)
  185. at ChildProcess.emit (node:events:519:28)
  186. at ChildProcess.emit (node:domain:488:12)
  187. at ChildProcess._handle.onexit (node:internal/child_process:294:12)
  188. [2024-08-10 20:55:42.348] [info] Successfully terminated server px and removed listeners.
  189. [2024-08-10 20:55:42.350] [info] Dispatching action "ERROR"
  190. [2024-08-10 20:55:42.351] [info] Handling side effects after entering state "error"
  191. [2024-08-10 20:57:28.358] [info] Tried to cancel when not streaming
  192. [2024-08-10 20:57:28.388] [info] before-quit false
  193. [2024-08-10 20:57:38.406] [info] Processes wound down. Quitting app gracefully.
  194. [2024-08-10 20:57:38.411] [info] before-quit true
  195. [2024-08-10 20:58:56.722] [info] process PID 4480 7836
  196. [2024-08-10 20:59:06.931] [info] Database migration done!
  197. [2024-08-10 20:59:06.932] [info] Migrating Image Aspect Ratio
  198. [2024-08-10 20:59:06.934] [info] Total avatar images without aspectRatio: 0
  199. [2024-08-10 20:59:06.935] [info] Image Aspect Ratio Migration Done!
  200. [2024-08-10 20:59:06.936] [info] Migrating Folder Position
  201. [2024-08-10 20:59:06.939] [info] Folder Position Migration Done!
  202. [2024-08-10 20:59:06.939] [info] Migrating No Parent Folder
  203. [2024-08-10 20:59:06.942] [info] No Parent Folder Migration Done!
  204. [2024-08-10 20:59:08.959] [info] Has patch update but has beta updates off. Skipping
  205. [2024-08-10 20:59:38.237] [info] Detecting model architecture took 1015 ms
  206. [2024-08-10 20:59:38.238] [info] Warning: tried to access the current historyStart from a different chat.
  207. [2024-08-10 20:59:38.253] [info] Spawning new model process...
  208. [2024-08-10 20:59:38.254] [info] Entered init()
  209. [2024-08-10 20:59:38.254] [info] Dispatching action "SPAWN"
  210. [2024-08-10 20:59:38.255] [info] Handling side effects after entering state "spawning-px"
  211. [2024-08-10 20:59:38.285] [info] Spawning model px: { gpuLayers: 0, isAtMaxLayers: false }
  212. [2024-08-10 20:59:38.287] [info] Spawning llama server process...
  213. [2024-08-10 20:59:39.252] [info] Parsing GGUF model header took 923 ms
  214. [2024-08-10 20:59:39.253] [info] Detected model architecture: llama
  215. [2024-08-10 20:59:39.253] [info] Rope params: {
  216. ropeFreqBase: 10000,
  217. ropeFreqScale: 1,
  218. finetuneContextLength: 8192,
  219. ctxSize: 4096
  220. }
  221. [2024-08-10 20:59:39.282] [info] {
  222. model: 'mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  223. llamaBin: 'llama-cpp-binaries\\windows\\nogpu\\v0.25.28\\avx\\backyard.exe',
  224. flags: [
  225. '--host',
  226. '127.0.0.1',
  227. '--port',
  228. '13333',
  229. '--model',
  230. 'C:\\Users\\paran\\AppData\\Roaming\\faraday\\models\\mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  231. '--ctx-size',
  232. '4096',
  233. '--rope-freq-base',
  234. '10000',
  235. '--rope-freq-scale',
  236. '1',
  237. '--batch-size',
  238. '512',
  239. '--log-disable',
  240. '--flash-attn',
  241. '--mlock',
  242. '--n-gpu-layers',
  243. '0'
  244. ]
  245. }
  246. [2024-08-10 20:59:39.283] [info] Attempting to start llama process {}
  247. [2024-08-10 20:59:39.285] [info] Spawned llama process, pid: 8708 GPU Acceleration: 0
  248. [2024-08-10 20:59:39.286] [info] Dispatching action "SPAWN_DONE"
  249. [2024-08-10 20:59:39.286] [info] Finished init()
  250. [2024-08-10 20:59:39.286] [info] Handling side effects after entering state "starting-llama"
  251. [2024-08-10 20:59:39.287] [info] Starting llama server...
  252. [2024-08-10 20:59:39.416] [info]
  253. ___STDERR___
  254. warning: not compiled with GPU offload support, --gpu-layers option will be ignored
  255. warning: see main README.md for information on enabling GPU BLAS support
  256.  
  257. ............
  258. warning: not compiled with GPU offload support, --gpu-layers option will be ignored
  259. warning: see main README.md for information on enabling GPU BLAS support
  260.  
  261. ___STDERR___
  262. [2024-08-10 20:59:39.418] [error] Unexpected error initializing server: Error: Model process unexpectedly failed, exitCode: 3221225501, signal: null
  263. at ChildProcess.<anonymous> (C:\Users\paran\AppData\Local\faraday\app-0.26.0\resources\app.asar\dist\server\main.js:1080:13524)
  264. at ChildProcess.emit (node:events:519:28)
  265. at ChildProcess.emit (node:domain:488:12)
  266. at ChildProcess._handle.onexit (node:internal/child_process:294:12)
  267. [2024-08-10 20:59:39.424] [info] Successfully terminated server px and removed listeners.
  268. [2024-08-10 20:59:39.427] [info] Dispatching action "ERROR"
  269. [2024-08-10 20:59:39.431] [info] Handling side effects after entering state "error"
  270. [2024-08-10 21:00:00.261] [info] Tried to cancel when not streaming
  271. [2024-08-10 21:00:21.763] [info] Starting gpu detection for cublas-12.1.0
  272. [2024-08-10 21:00:21.951] [info] Finished gpu detection for cublas-12.1.0 after 188 ms
  273. [2024-08-10 21:00:21.951] [info] Set cached value for gpu detection for cublas-12.1.0
  274. [2024-08-10 21:00:21.952] [info] Starting gpu detection for clblast
  275. [2024-08-10 21:00:22.010] [info] Finished gpu detection for clblast after 58 ms
  276. [2024-08-10 21:00:22.010] [info] Set cached value for gpu detection for clblast
  277. [2024-08-10 21:00:22.011] [info] Starting gpu detection for vulkan
  278. [2024-08-10 21:00:22.107] [info] Finished gpu detection for vulkan after 96 ms
  279. [2024-08-10 21:00:22.107] [info] Set cached value for gpu detection for vulkan
  280. [2024-08-10 21:01:10.562] [info] Terminating process.
  281. [2024-08-10 21:01:10.563] [info] Successfully terminated server px and removed listeners.
  282. [2024-08-10 21:01:10.563] [info] Dispatching action "TERMINATED"
  283. [2024-08-10 21:01:10.564] [info] Handling side effects after entering state "none"
  284. [2024-08-10 21:01:10.564] [info] Spawning new model process...
  285. [2024-08-10 21:01:10.564] [info] Entered init()
  286. [2024-08-10 21:01:10.565] [info] Dispatching action "SPAWN"
  287. [2024-08-10 21:01:10.565] [info] Handling side effects after entering state "spawning-px"
  288. [2024-08-10 21:01:30.658] [info] Starting gpu detection for cublas-12.1.0
  289. [2024-08-10 21:01:30.847] [info] Finished gpu detection for cublas-12.1.0 after 188 ms
  290. [2024-08-10 21:01:30.847] [info] Using free VRAM if available
  291. [2024-08-10 21:01:30.848] [info] Fetched GPU and available vRAM {
  292. cardName: 'NVIDIA GeForce RTX 2070 SUPER',
  293. maxUsableVRamMiB: 7421.375,
  294. gpuDeviceInfo: { index: 0, type: 'cublas' }
  295. }
  296. [2024-08-10 21:01:30.850] [info] Spawning model px: { gpuLayers: 1, isAtMaxLayers: false }
  297. [2024-08-10 21:01:30.850] [info] Spawning llama server process...
  298. [2024-08-10 21:01:31.899] [info] Parsing GGUF model header took 1007 ms
  299. [2024-08-10 21:01:31.900] [info] Detected model architecture: llama
  300. [2024-08-10 21:01:31.900] [info] Rope params: {
  301. ropeFreqBase: 10000,
  302. ropeFreqScale: 1,
  303. finetuneContextLength: 8192,
  304. ctxSize: 2048
  305. }
  306. [2024-08-10 21:01:31.901] [info] {
  307. model: 'mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  308. llamaBin: 'llama-cpp-binaries\\windows\\cublas-12.1.0\\v0.25.28\\noavx\\backyard.exe',
  309. flags: [
  310. '--host',
  311. '127.0.0.1',
  312. '--port',
  313. '1516',
  314. '--model',
  315. 'C:\\Users\\paran\\AppData\\Roaming\\faraday\\models\\mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  316. '--ctx-size',
  317. '2048',
  318. '--rope-freq-base',
  319. '10000',
  320. '--rope-freq-scale',
  321. '1',
  322. '--batch-size',
  323. '512',
  324. '--log-disable',
  325. '--flash-attn',
  326. '--mlock',
  327. '--n-gpu-layers',
  328. '1',
  329. '--layer-check'
  330. ]
  331. }
  332. [2024-08-10 21:01:31.901] [info] Attempting to start llama process { CUDA_VISIBLE_DEVICES: '0' }
  333. [2024-08-10 21:01:31.904] [info] Spawned llama process, pid: 4256 GPU Acceleration: 1
  334. [2024-08-10 21:01:31.905] [info] Dispatching action "SPAWN_DONE"
  335. [2024-08-10 21:01:31.906] [info] Finished init()
  336. [2024-08-10 21:01:31.906] [info] Handling side effects after entering state "starting-llama"
  337. [2024-08-10 21:01:31.907] [info] Starting llama server...
  338. [2024-08-10 21:01:31.907] [info] Reusing existing model process...
  339. [2024-08-10 21:01:32.033] [info]
  340. ___STDERR___
  341.  
  342. ............
  343.  
  344. ___STDERR___
  345. [2024-08-10 21:01:32.034] [info] Dispatching action "LAYER_CHECK_DONE"
  346. [2024-08-10 21:01:32.052] [info] Handling side effects after entering state "post-layer-check"
  347. [2024-08-10 21:01:32.053] [info] Error extracting vRam info from stderr: { error: 'Could not extract vRAM' }
  348. [2024-08-10 21:01:32.053] [info] Dispatching action "SPAWN_AFTER_LAYER_CHECK"
  349. [2024-08-10 21:01:32.054] [info] Handling side effects after entering state "spawning-px"
  350. [2024-08-10 21:01:32.073] [info] Spawning model px: { gpuLayers: 0, isAtMaxLayers: false }
  351. [2024-08-10 21:01:32.073] [info] Spawning llama server process...
  352. [2024-08-10 21:01:33.089] [info] Parsing GGUF model header took 984 ms
  353. [2024-08-10 21:01:33.089] [info] Detected model architecture: llama
  354. [2024-08-10 21:01:33.090] [info] Rope params: {
  355. ropeFreqBase: 10000,
  356. ropeFreqScale: 1,
  357. finetuneContextLength: 8192,
  358. ctxSize: 4096
  359. }
  360. [2024-08-10 21:01:33.090] [info] {
  361. model: 'mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  362. llamaBin: 'llama-cpp-binaries\\windows\\nogpu\\v0.25.28\\noavx\\backyard.exe',
  363. flags: [
  364. '--host',
  365. '127.0.0.1',
  366. '--port',
  367. '1517',
  368. '--model',
  369. 'C:\\Users\\paran\\AppData\\Roaming\\faraday\\models\\mistral.7b.kunoichi.gguf_v2.q4_k_m.gguf',
  370. '--ctx-size',
  371. '4096',
  372. '--rope-freq-base',
  373. '10000',
  374. '--rope-freq-scale',
  375. '1',
  376. '--batch-size',
  377. '512',
  378. '--log-disable',
  379. '--flash-attn',
  380. '--mlock',
  381. '--n-gpu-layers',
  382. '0'
  383. ]
  384. }
  385. [2024-08-10 21:01:33.091] [info] Attempting to start llama process {}
  386. [2024-08-10 21:01:33.094] [info] Spawned llama process, pid: 6072 GPU Acceleration: 0
  387. [2024-08-10 21:01:33.094] [info] Dispatching action "SPAWN_DONE"
  388. [2024-08-10 21:01:33.095] [info] Handling side effects after entering state "starting-llama"
  389. [2024-08-10 21:01:33.095] [info] Starting llama server...
  390. [2024-08-10 21:01:33.114] [info]
  391. ___STDERR___
  392. warning: not compiled with GPU offload support, --gpu-layers option will be ignored
  393. warning: see main README.md for information on enabling GPU BLAS support
  394.  
  395. ............
  396. warning: not compiled with GPU offload support, --gpu-layers option will be ignored
  397. warning: see main README.md for information on enabling GPU BLAS support
  398.  
  399. ___STDERR___
  400. [2024-08-10 21:01:33.114] [error] Unexpected error initializing server: Error: Model process unexpectedly failed, exitCode: 3221225501, signal: null
  401. at ChildProcess.<anonymous> (C:\Users\paran\AppData\Local\faraday\app-0.26.0\resources\app.asar\dist\server\main.js:1080:13524)
  402. at ChildProcess.emit (node:events:519:28)
  403. at ChildProcess.emit (node:domain:488:12)
  404. at ChildProcess._handle.onexit (node:internal/child_process:294:12)
  405. [2024-08-10 21:01:33.117] [info] Successfully terminated server px and removed listeners.
  406. [2024-08-10 21:01:33.118] [info] Dispatching action "ERROR"
  407. [2024-08-10 21:01:33.119] [info] Handling side effects after entering state "error"
  408.  
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!