2026-04-23 13:58:04.742 [Info] (WebSocket) New connection from: 127.0.0.1 (id: 17)
2026-04-23 13:58:09.677 [Info] (Server) Loading model: Gemma-4-E2B-it-GGUF
2026-04-23 13:58:09.679 [Info] (LlamaCpp) Loading model: Gemma-4-E2B-it-GGUF
2026-04-23 13:58:09.682 [Info] (LlamaCpp) Starting llama-server...
2026-04-23 13:58:09.684 [Info] (ProcessManager) Process started successfully, PID: 41105
2026-04-23 13:58:09.737 [Info] (Process) dyld[41105]: Library not loaded: u/rpath/libllama-common.0.dylib
2026-04-23 13:58:09.738 [Info] (Process) Referenced from: <1788B481-CB66-3D37-8BA9-E3171CA7DAEE> /Users/Myname/Downloads/llama-b8840/llama-server
2026-04-23 13:58:09.738 [Info] (Process) Reason: tried: '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file)
2026-04-23 13:58:09.861 [Error] (WrappedServer) llama-server process has terminated with exit code: -1
2026-04-23 13:58:09.861 [Error] (WrappedServer) This usually means:
2026-04-23 13:58:09.861 [Error] (WrappedServer) - Missing required drivers or dependencies
2026-04-23 13:58:09.861 [Error] (WrappedServer) - Incompatible model file
2026-04-23 13:58:09.861 [Error] (WrappedServer) - Try running the server manually to see the actual error
2026-04-23 13:58:13.651 [Info] (Server) Loading model: Gemma-4-E2B-it-GGUF
2026-04-23 13:58:13.652 [Info] (Router) Another load is in progress, waiting...
2026-04-23 13:58:18.137 [Warn] (ProcessManager) Process did not respond to SIGTERM, using SIGKILL
2026-04-23 13:58:18.137 [Info] (ProcessManager) Process terminated, waiting for GPU driver cleanup...
2026-04-23 13:58:20.213 [Error] (Router) Backend load failed: llama-server failed to start
2026-04-23 13:58:20.213 [Warn] (Router) Load failed with non-file-not-found error, evicting all models and retrying...
2026-04-23 13:58:20.214 [Info] (Router) Evicting all models (0 total)
2026-04-23 13:58:20.214 [Info] (Router) All models evicted
2026-04-23 13:58:20.214 [Info] (LlamaCpp) Loading model: Gemma-4-E2B-it-GGUF
2026-04-23 13:58:20.214 [Info] (Router) Another load is in progress, waiting...
2026-04-23 13:58:20.214 [Info] (Router) Per-model settings: ctx_size=2048, llamacpp_backend=metal, llamacpp_args=(none)
2026-04-23 13:58:20.215 [Info] (LlamaCpp) Starting llama-server...
2026-04-23 13:58:20.216 [Info] (ProcessManager) Process started successfully, PID: 41112
2026-04-23 13:58:20.228 [Info] (Process) dyld[41112]: Library not loaded: u/rpath/libllama-common.0.dylib
2026-04-23 13:58:20.228 [Info] (Process) Referenced from: <1788B481-CB66-3D37-8BA9-E3171CA7DAEE> /Users/Myname/Downloads/llama-b8840/llama-server
2026-04-23 13:58:20.228 [Info] (Process) Reason: tried: '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file)
2026-04-23 13:58:20.395 [Error] (WrappedServer) llama-server process has terminated with exit code: -1
2026-04-23 13:58:20.396 [Error] (WrappedServer) This usually means:
2026-04-23 13:58:20.396 [Error] (WrappedServer) - Missing required drivers or dependencies
2026-04-23 13:58:20.396 [Error] (WrappedServer) - Incompatible model file
2026-04-23 13:58:20.396 [Error] (WrappedServer) - Try running the server manually to see the actual error
2026-04-23 13:58:28.656 [Warn] (ProcessManager) Process did not respond to SIGTERM, using SIGKILL
2026-04-23 13:58:28.657 [Info] (ProcessManager) Process terminated, waiting for GPU driver cleanup...
2026-04-23 13:58:30.711 [Error] (Router) Retry also failed: llama-server failed to start
2026-04-23 13:58:30.713 [Info] (LlamaCpp) Unloading model...
2026-04-23 13:58:30.713 [Info] (LlamaCpp) Unloading model...
2026-04-23 13:58:30.713 [Error] (Router) Failed to load model: llama-server failed to start
2026-04-23 13:58:30.714 [Info] (LlamaCpp) Loading model: Gemma-4-E2B-it-GGUF
2026-04-23 13:58:30.714 [Error] (Server) Error 500: POST /api/v1/load
2026-04-23 13:58:30.718 [Info] (LlamaCpp) Starting llama-server...
2026-04-23 13:58:30.719 [Info] (ProcessManager) Process started successfully, PID: 41115
2026-04-23 13:58:30.730 [Info] (Process) dyld[41115]: Library not loaded: u/rpath/libllama-common.0.dylib
2026-04-23 13:58:30.730 [Info] (Process) Referenced from: <1788B481-CB66-3D37-8BA9-E3171CA7DAEE> /Users/Myname/Downloads/llama-b8840/llama-server
2026-04-23 13:58:30.730 [Info] (Process) Reason: tried: '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file)
2026-04-23 13:58:30.885 [Error] (WrappedServer) llama-server process has terminated with exit code: -1
2026-04-23 13:58:30.885 [Error] (WrappedServer) This usually means:
2026-04-23 13:58:30.885 [Error] (WrappedServer) - Missing required drivers or dependencies
2026-04-23 13:58:30.885 [Error] (WrappedServer) - Incompatible model file
2026-04-23 13:58:30.885 [Error] (WrappedServer) - Try running the server manually to see the actual error
2026-04-23 13:58:39.163 [Warn] (ProcessManager) Process did not respond to SIGTERM, using SIGKILL
2026-04-23 13:58:39.163 [Info] (ProcessManager) Process terminated, waiting for GPU driver cleanup...
2026-04-23 13:58:41.236 [Error] (Router) Backend load failed: llama-server failed to start
2026-04-23 13:58:41.237 [Warn] (Router) Load failed with non-file-not-found error, evicting all models and retrying...
2026-04-23 13:58:41.237 [Info] (Router) Evicting all models (0 total)
2026-04-23 13:58:41.237 [Info] (Router) All models evicted
2026-04-23 13:58:41.238 [Info] (LlamaCpp) Loading model: Gemma-4-E2B-it-GGUF
2026-04-23 13:58:41.238 [Info] (LlamaCpp) Starting llama-server...
2026-04-23 13:58:41.240 [Info] (ProcessManager) Process started successfully, PID: 41129
2026-04-23 13:58:41.250 [Info] (Process) dyld[41129]: Library not loaded: u/rpath/libllama-common.0.dylib
2026-04-23 13:58:41.250 [Info] (Process) Referenced from: <1788B481-CB66-3D37-8BA9-E3171CA7DAEE> /Users/Myname/Downloads/llama-b8840/llama-server
2026-04-23 13:58:41.250 [Info] (Process) Reason: tried: '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (file system sandbox blocked open()), '/System/Volumes/Preboot/Cryptexes/OS/Users/Myname/Downloads/llama-b8840/libllama-common.0.dylib' (no such file)
2026-04-23 13:58:41.417 [Error] (WrappedServer) llama-server process has terminated with exit code: -1
2026-04-23 13:58:41.417 [Error] (WrappedServer) This usually means:
2026-04-23 13:58:41.417 [Error] (WrappedServer) - Missing required drivers or dependencies
2026-04-23 13:58:41.417 [Error] (WrappedServer) - Incompatible model file
2026-04-23 13:58:41.417 [Error] (WrappedServer) - Try running the server manually to see the actual error
2026-04-23 13:58:49.745 [Warn] (ProcessManager) Process did not respond to SIGTERM, using SIGKILL
2026-04-23 13:58:49.749 [Info] (ProcessManager) Process terminated, waiting for GPU driver cleanup...
2026-04-23 13:58:51.821 [Error] (Router) Retry also failed: llama-server failed to start
2026-04-23 13:58:51.821 [Info] (LlamaCpp) Unloading model...
2026-04-23 13:58:51.821 [Info] (LlamaCpp) Unloading model...
2026-04-23 13:58:51.821 [Error] (Router) Failed to load model: llama-server failed to start
2026-04-23 13:58:51.821 [Error] (Server) Failed to load model: llama-server failed to start
2026-04-23 13:58:51.821 [Error] (Server) Error 500: POST /api/v1/load