Qwen/Qwen2.5-0.5B-Instruct-GPTQ-Int8
Text Generation • 0.5B • Updated • 693 • 10
Tiny Models
These can run on a NVIDIA GeForce MX150 at a relatively fast performance, load in FP16 if they aren't already BF16 or FP16
These can run on a NVIDIA GeForce MX150 at a relatively fast performance, load in FP16 if they aren't already BF16 or FP16
