使用colab下载大模型基模的时候报错处理

最新推荐文章于 2025-03-19 19:54:27 发布

完颜振江

最新推荐文章于 2025-03-19 19:54:27 发布

阅读量251

点赞数 2

CC 4.0 BY-SA版权

文章标签： colab llama 2 大模型训练

本文链接：https://blog.csdn.net/ethnicitybeta/article/details/137019525

报错明细

User
ImportError                               Traceback (most recent call last)
<ipython-input-8-bcbf3706e26d> in <cell line: 24>()
     22 )
     23 
---> 24 model = transformers.AutoModelForCausalLM.from_pretrained(
     25     model_id,
     26     trust_remote_code=True,

2 frames
/usr/local/lib/python3.10/dist-packages/transformers/quantizers/quantizer_bnb_4bit.py in validate_environment(self, *args, **kwargs)
     60     def validate_environment(self, *args, **kwargs):
     61         if not (is_accelerate_available() and is_bitsandbytes_available()):
---> 62             raise ImportError(
     63                 "Using `bitsandbytes` 8-bit quantization requires Accelerate: `pip install accelerate` "
     64                 "and the latest version of bitsandbytes: `pip install -i https://pypi.org/simple/ bitsandbytes`"

ImportError: Using `bitsandbytes` 8-bit quantization requires Accelerate: `pip install accelerate` and the