安装 vllm 时会安装依赖 torch,安装完之后报如下错误:
完整报错信息:
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/root/miniconda3/envs/wlz_vllm/lib/python3.9/site-packages/torch/__init__.py", line 367, in <module>
from torch._C import * # noqa: F403
ImportError: /root/miniconda3/envs/wlz_vllm/lib/python3.9/site-packages/torch/lib/../../nvidia/cusparse/lib/libcusparse.so.12: undefined symbol: __nvJitLinkComplete_12_4, version libnvJitLink.so.12
解决方案:
把你conda环境里的nvidia/nvjitlink里的lib路径放到LD_LIBRARY_PATH环境变量中
export LD_LIBRARY_PATH=/root/miniconda3/envs/wlz_vllm/lib/python3.9/site-packages/nvidia/nvjitlink/lib:$LD_LIBRARY_PATH