runtime error
of-00002.bin: 45%|βββββ | 2.00G/4.48G [00:13<00:10, 231MB/s][A pytorch_model-00002-of-00002.bin: 51%|βββββ | 2.29G/4.48G [00:17<00:15, 139MB/s][A pytorch_model-00002-of-00002.bin: 56%|ββββββ | 2.53G/4.48G [00:18<00:12, 155MB/s][A pytorch_model-00002-of-00002.bin: 64%|βββββββ | 2.87G/4.48G [00:19<00:08, 192MB/s][A pytorch_model-00002-of-00002.bin: 70%|βββββββ | 3.14G/4.48G [00:21<00:07, 186MB/s][A pytorch_model-00002-of-00002.bin: 75%|ββββββββ | 3.38G/4.48G [00:23<00:06, 164MB/s][A pytorch_model-00002-of-00002.bin: 82%|βββββββββ | 3.68G/4.48G [00:24<00:04, 193MB/s][A pytorch_model-00002-of-00002.bin: 92%|ββββββββββ| 4.11G/4.48G [00:25<00:01, 242MB/s][A pytorch_model-00002-of-00002.bin: 99%|ββββββββββ| 4.45G/4.48G [00:26<00:00, 261MB/s][A pytorch_model-00002-of-00002.bin: 100%|ββββββββββ| 4.48G/4.48G [00:26<00:00, 169MB/s] Downloading shards: 100%|ββββββββββ| 2/2 [01:30<00:00, 42.03s/it][A Downloading shards: 100%|ββββββββββ| 2/2 [01:30<00:00, 45.25s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 5, in <module> model = AutoModelForCausalLM.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 561, in from_pretrained return model_class.from_pretrained( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3706, in from_pretrained ) = cls._load_pretrained_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3835, in _load_pretrained_model raise ValueError( ValueError: The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the weights in this format.
Container logs:
Fetching error logs...