Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

10,806

Base only

Active filters: quantized

empero-ai/Qwythos-9B-Claude-Mythos-5-1M-GGUF

Text Generation • 9B • Updated 5 days ago • 487k • 619

nvidia/Qwen3.6-35B-A3B-NVFP4

Text Generation • 19B • Updated 14 days ago • 4.81M • 363

nvidia/GLM-5.2-NVFP4

Text Generation • 381B • Updated about 8 hours ago • 441 • 98

sahilchachra/Unlimited-OCR-GGUF

Image-Text-to-Text • 3B • Updated about 16 hours ago • 7.36k • 28

nvidia/MiniMax-M3-NVFP4

Text Generation • 247B • Updated about 15 hours ago • 7.09k • 26

empero-ai/Qwable-9B-Claude-Fable-5-GGUF

Image-Text-to-Text • 9B • Updated 8 days ago • 18.3k • 36

nvidia/DeepSeek-V4-Flash-NVFP4

Text Generation • 167B • Updated 12 days ago • 209k • 46

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 14 days ago • 15.8k • 73

nvidia/Gemma-4-26B-A4B-NVFP4

Text Generation • 14B • Updated May 11 • 2.01M • 97

DJLougen/Qwable-5-27B-Coder-GGUF

Text Generation • 27B • Updated 4 days ago • 2.77k • 15

antirez/deepseek-v4-gguf

Text Generation • 284B • Updated 27 days ago • 6.12M • 275

PhalaCloud/GLM-5.2-W4AFP8

Text Generation • 392B • Updated 5 days ago • 9.37k • 22

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-mlx-4Bit

Text Generation • 35B • Updated about 1 month ago • 791 • 28

autotrust/gpt-oss-120b-Fable-5-Distilled-GGUF

Text Generation • 117B • Updated about 16 hours ago • 1.64k • 14

lilcheaty/Krea2-INT8-ConvRot

Text-to-Image • Updated 4 days ago • 11

huihui-ai/Huihui-DeepSeek-V4-Flash-abliterated-ds4-GGUF

284B • Updated 20 days ago • 189k • 68

unsloth/Qwen-Image-Edit-2511-GGUF

Image-to-Image • 20B • Updated Jan 8 • 227k • 519

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 8 days ago • 15.4k • 48

AlicanKiraz0/Titus-CybersecurityLLM-v1.0-Q4_K_M-No-MTP-GGUF

Text Generation • 35B • Updated 26 days ago • 1.83k • 17

Jiunsong/SuperGemma-4-12b-abliterated-gguf-4bit

Text Generation • 12B • Updated 2 days ago • 224 • 9

douyamv/Gemma-4-31B-JANG_4M-CRACK-GGUF

Text Generation • 31B • Updated Apr 9 • 227k • 224

SC117/gemma-4-12B-it-heretic-QAT-GGUF

12B • Updated 19 days ago • 33.5k • 28

SupraLabs/Supra-1.5-50M-instruct-exp-gguf

Text Generation • 51.8M • Updated 14 days ago • 5.39k • 16

DJLougen/Qwable-5-27B-Coder-NVFP4

Text Generation • 15B • Updated 4 days ago • 467 • 7

Winnougan/Boogu-INT8

Text-to-Image • Updated 6 minutes ago • 7

mudler/Qwen3.6-35B-A3B-APEX-GGUF

35B • Updated Apr 27 • 68.4k • 172

nvidia/diffusiongemma-26B-A4B-it-NVFP4

Text Generation • 14B • Updated 16 days ago • 921k • 87

inferencerlabs/GLM-5.2-MLX-Q4.8-INF

Text Generation • Updated 9 days ago • 4.17k • 9

autotrust/gemma4-31B-Fable-5-Distilled-GGUF

Image-Text-to-Text • 31B • Updated 3 days ago • 403 • 7

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 8 days ago • 14.9k • 37