Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

25,074

Base only

Active filters: llama-cpp

prism-ml/Ternary-Bonsai-27B-gguf

Text Generation • 27B • Updated 5 days ago • 644k • • 1.28k

prism-ml/Bonsai-27B-gguf

Text Generation • 27B • Updated Jul 17 • 490k • 838

SC117/Qwen3.8-27B-Uncensored-FIT-GGUF

Text Generation • 27B • Updated 7 days ago • 6.11k • 10

NANI-Nithin/K2-Horizon-MoVA-36B-A4B-GGUF

Text Generation • 37B • Updated 1 day ago • 18.2k • 9

jica98/qwen3.5-4B-super-coder

Text Generation • 4B • Updated Jun 27 • 34.1k • 91

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 120k • 777

chenyumo/moziAI-35B-A3B-MOE-MTP

Text Generation • 36B • Updated 5 days ago • 12.9k • 9

jan1k/Hermes3.6-35B-A3B-Uncensored-Genesis-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated about 19 hours ago • 31.2k • 4

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jun 13 • 30.2k • 149

Hikari07jp/Ternary-Bonsai-27B-Abliterated-LowDeg-GGUF

Text Generation • 27B • Updated Jul 22 • 11.5k • 31

douyamv/Qwen3.8-27B-abliterated-GGUF

Text Generation • Updated 22 days ago • 17

prithivMLmods/inclusionAI-UI-Venus-2-9B-GGUF

Image-Text-to-Text • 9B • Updated 5 days ago • 425 • 3

jan1k/Tiel-Coder-35B-A3B-Genesis-Hermes-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated 1 day ago • 652 • 3

jan1k/Qwen3.6-35B-A3B-Uncensored-Genesis-Final-NVFP4-GGUF

Image-Text-to-Text • 35B • Updated about 19 hours ago • 3

Hugggme/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF

Text Generation • 0.5B • Updated Sep 18, 2024 • 2.71k • 7

AlicanKiraz0/Cybersecurity-BaronLLM_Offensive_Security_LLM_Q6_K_GGUF

Text Generation • 8B • Updated Jun 4, 2025 • 11.5k • 300

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 8.66k • 338

prism-ml/Bonsai-4B-gguf

Text Generation • 4B • Updated Apr 18 • 20.9k • 59

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated Jun 10 • 5.57k • 34

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated Jun 10 • 372k • 148

audarai/Audar-ASR-V1-Turbo

Automatic Speech Recognition • 2B • Updated 17 days ago • 2.11k • 14

ISTA-DASLab/Qwen3.5-4B-GGUF-GSQ

Text Generation • 4B • Updated May 26 • 255 • 3

Abiray/OvisOCR2-GGUF

Image-Text-to-Text • 0.8B • Updated Jul 13 • 7.28k • 28

ScottzillaSystems/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated Jul 16 • 259 • 3

KridgeDookie/KAT-Coder-V2.5-Dev-35B-A3B-ABLITERATED-UNCENSORED-PHILADELPHIA-CLASS

Text Generation • 35B • Updated 30 days ago • 19.9k • 4

Abiray/Qwen3.8-27B-Q4_K_M-GGUF

Image-Text-to-Text • 27B • Updated 23 days ago • 48.7k • 19

ge525/Qwen3.8-9B-Distill-uncensored-heretic-Q4_K_M-GGUF

Text Generation • 9B • Updated 14 days ago • 10.6k • 12

Jackrong/Qwen-Tool-Calling-Template-Fix

Text Generation • Updated 13 days ago • 1 • 15

chenyumo/moziAI-27B-MTP

Text Generation • 27B • Updated 5 days ago • 6k • 2

prithivMLmods/NuExtract3-GGUF

Image-Text-to-Text • 4B • Updated 5 days ago • 517 • 2