API tools faq
paste
Guest User

Untitled

a guest
May 2nd, 2026
58
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 12.05 KB | None | 0 0
raw download clone embed print report
  1. release that supports one of these CUDA versions: 12.8, 13.0
  2. (EngineCore pid=44608) _warn_unsupported_code(d, device_cc, code_ccs)
  3. (EngineCore pid=44608) C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\torch\cuda\__init__.py:489: UserWarning:
  4. (EngineCore pid=44608) NVIDIA GeForce RTX 5090 with CUDA capability sm_120 is not compatible with the current PyTorch installation.
  5. (EngineCore pid=44608) The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_61 sm_70 sm_75 sm_80 sm_86 sm_90.
  6. (EngineCore pid=44608) If you want to use the NVIDIA GeForce RTX 5090 GPU with PyTorch, please check the instructions at https://pytorch.org/get-started/locally/
  7. (EngineCore pid=44608)
  8. (EngineCore pid=44608) queued_call()
  9. (EngineCore pid=44608) INFO 05-02 18:19:57 [registry.py:126] All limits of multimodal modalities supported by the model are set to 0, running in text-only mode.
  10. (EngineCore pid=44608) INFO 05-02 18:19:57 [parallel_state.py:1455] world_size=1 rank=0 local_rank=0 distributed_init_method=tcp://192.168.2.18:52901 backend=gloo
  11. [W502 18:19:57.000000000 socket.cpp:764] [c10d] The client socket has failed to connect to [WoodyhoNeo]:52901 (system error: 10049 - The requested address is not valid in its context.).
  12. (EngineCore pid=44608) INFO 05-02 18:19:57 [parallel_state.py:1767] rank 0 in world size 1 is assigned as DP rank 0, PP rank 0, PCP rank 0, TP rank 0, EP rank N/A, EPLB rank N/A
  13. (EngineCore pid=44608) Failed to get device capability: SM 12.x requires CUDA >= 12.9.
  14. (EngineCore pid=44608) Failed to get device capability: SM 12.x requires CUDA >= 12.9.
  15. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] EngineCore failed to start.
  16.  
  17. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] Traceback (most recent call last):
  18.  
  19. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 1082, in run_engine_core
  20.  
  21. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs)
  22.  
  23. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  24.  
  25. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\tracing\otel.py", line 178, in sync_wrapper
  26.  
  27. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] return func(*args, **kwargs)
  28.  
  29. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^
  30.  
  31. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 848, in __init__
  32.  
  33. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] super().__init__(
  34.  
  35. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 114, in __init__
  36.  
  37. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self.model_executor = executor_class(vllm_config)
  38.  
  39. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  40.  
  41. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\tracing\otel.py", line 178, in sync_wrapper
  42.  
  43. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] return func(*args, **kwargs)
  44.  
  45. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^
  46.  
  47. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\executor\abstract.py", line 109, in __init__
  48.  
  49. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self._init_executor()
  50.  
  51. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\executor\uniproc_executor.py", line 47, in _init_executor
  52.  
  53. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self.driver_worker.init_device()
  54.  
  55. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\worker\worker_base.py", line 312, in init_device
  56.  
  57. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self.worker.init_device() # type: ignore
  58.  
  59. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^^^^^
  60.  
  61. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\tracing\otel.py", line 178, in sync_wrapper
  62.  
  63. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] return func(*args, **kwargs)
  64.  
  65. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^
  66.  
  67. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\worker\gpu_worker.py", line 311, in init_device
  68.  
  69. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self.model_runner = GPUModelRunnerV1(self.vllm_config, self.device)
  70.  
  71. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  72.  
  73. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\worker\gpu_model_runner.py", line 480, in __init__
  74.  
  75. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self.sampler = Sampler(logprobs_mode=self.model_config.logprobs_mode)
  76.  
  77. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  78.  
  79. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\sample\sampler.py", line 64, in __init__
  80.  
  81. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] self.topk_topp_sampler = TopKTopPSampler(logprobs_mode)
  82.  
  83. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  84.  
  85. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\sample\ops\topk_topp_sampler.py", line 40, in __init__
  86.  
  87. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] from vllm.v1.attention.backends.flashinfer import FlashInferBackend
  88.  
  89. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\attention\backends\flashinfer.py", line 11, in <module>
  90.  
  91. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] from flashinfer import (
  92.  
  93. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\flashinfer\__init__.py", line 24, in <module>
  94.  
  95. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] from . import jit as jit
  96.  
  97. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\flashinfer\jit\__init__.py", line 125, in <module>
  98.  
  99. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] raise ValueError(
  100.  
  101. (EngineCore pid=44608) ERROR 05-02 18:19:58 [core.py:1108] ValueError: CUDA_LIB_PATH is not set. CUDA_LIB_PATH need to be set with the absolute path to CUDA root folder on Windows (for example, set CUDA_LIB_PATH=C:\CUDA\v12.4)
  102. (EngineCore pid=44608) Process EngineCore:
  103. (EngineCore pid=44608) Traceback (most recent call last):
  104. (EngineCore pid=44608) File "multiprocessing\process.py", line 314, in _bootstrap
  105. (EngineCore pid=44608) File "multiprocessing\process.py", line 108, in run
  106. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 1112, in run_engine_core
  107. (EngineCore pid=44608) raise e
  108. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 1082, in run_engine_core
  109. (EngineCore pid=44608) engine_core = EngineCoreProc(*args, engine_index=dp_rank, **kwargs)
  110. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  111. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\tracing\otel.py", line 178, in sync_wrapper
  112. (EngineCore pid=44608) return func(*args, **kwargs)
  113. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^
  114. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 848, in __init__
  115. (EngineCore pid=44608) super().__init__(
  116. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\engine\core.py", line 114, in __init__
  117. (EngineCore pid=44608) self.model_executor = executor_class(vllm_config)
  118. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  119. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\tracing\otel.py", line 178, in sync_wrapper
  120. (EngineCore pid=44608) return func(*args, **kwargs)
  121. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^
  122. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\executor\abstract.py", line 109, in __init__
  123. (EngineCore pid=44608) self._init_executor()
  124. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\executor\uniproc_executor.py", line 47, in _init_executor
  125. (EngineCore pid=44608) self.driver_worker.init_device()
  126. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\worker\worker_base.py", line 312, in init_device
  127. (EngineCore pid=44608) self.worker.init_device() # type: ignore
  128. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^^^^^
  129. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\tracing\otel.py", line 178, in sync_wrapper
  130. (EngineCore pid=44608) return func(*args, **kwargs)
  131. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^
  132. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\worker\gpu_worker.py", line 311, in init_device
  133. (EngineCore pid=44608) self.model_runner = GPUModelRunnerV1(self.vllm_config, self.device)
  134. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  135. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\worker\gpu_model_runner.py", line 480, in __init__
  136. (EngineCore pid=44608) self.sampler = Sampler(logprobs_mode=self.model_config.logprobs_mode)
  137. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  138. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\sample\sampler.py", line 64, in __init__
  139. (EngineCore pid=44608) self.topk_topp_sampler = TopKTopPSampler(logprobs_mode)
  140. (EngineCore pid=44608) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  141. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\sample\ops\topk_topp_sampler.py", line 40, in __init__
  142. (EngineCore pid=44608) from vllm.v1.attention.backends.flashinfer import FlashInferBackend
  143. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\vllm\v1\attention\backends\flashinfer.py", line 11, in <module>
  144. (EngineCore pid=44608) from flashinfer import (
  145. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\flashinfer\__init__.py", line 24, in <module>
  146. (EngineCore pid=44608) from . import jit as jit
  147. (EngineCore pid=44608) File "C:\_vLLM\qwen3.6-windows-server\python\Lib\site-packages\flashinfer\jit\__init__.py", line 125, in <module>
  148. (EngineCore pid=44608) raise ValueError(
  149. (EngineCore pid=44608) ValueError: CUDA_LIB_PATH is not set. CUDA_LIB_PATH need to be set with the absolute path to CUDA root folder on Windows (for example, set CUDA_LIB_PATH=C:\CUDA\v12.4)
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!