Inference Optimized Checkpoints (with Model Optimizer) Collection A collection of generative models quantized and optimized for inference with Model Optimizer. • 54 items • Updated 2 days ago • 114
Running on A10G 1.87k GGUF My Repo 🦙 1.87k Quantize a Hugging Face model to GGUF and create a repo