Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

42,934

Base only

Active filters: bitsandbytes

unsloth/Qwen3.8-27B-unsloth-bnb-4bit

27B • Updated 6 days ago • 77.7k • 11

shidowake/gemma-7b-base-bnb-4bit

Text Generation • 9B • Updated Feb 23, 2024 • 7 • 1

nikravan/glm-4vq

Document Question Answering • 14B • Updated Jun 16, 2024 • 56 • 38

miguel-kjh/pythia-70m_instruction_code_tuning

Text Generation • 70.7M • Updated Jul 3, 2024 • 17 • 1

miguel-kjh/phi-2_instruction_code_tuning

Text Generation • 3B • Updated Jul 5, 2024 • 11 • 1

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • 8B • Updated Feb 15, 2025 • 98.1k • 103

hhamxa678/Llama-3-8b-chat-finetune

Text Generation • 8B • Updated Aug 14, 2024 • 13 • 1

winglian/llama-3.1-8b-talk-like-a-pirate

Updated Sep 24, 2024 • 8 • 2

unsloth/Llama-3.2-3B-Instruct-bnb-4bit

Text Generation • 3B • Updated Jun 2, 2025 • 42.7k • 37

unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit

Image-Text-to-Text • 11B • Updated Dec 10, 2024 • 5.91k • 86

NetoAISolutions/TSLAM-4B

4B • Updated Jul 17 • 46 • 24

unsloth/llava-v1.6-mistral-7b-hf-bnb-4bit

Image-Text-to-Text • 8B • Updated Feb 13, 2025 • 284 • 9

ai-sage/GigaChat-20B-A3B-instruct-v1.5-int8

21B • Updated Jan 30, 2025 • 44 • 2

unsloth/gpt-oss-120b-unsloth-bnb-4bit

Text Generation • 117B • Updated Aug 8, 2025 • 6.09k • 19

philosop/qwen3-235b-8bit

235B • Updated Oct 23, 2025 • 1

unsloth/gemma-4-31B-it-unsloth-bnb-4bit

Image-Text-to-Text • 31B • Updated Jul 17 • 24.4k • 23

fe-dev-dl/Ornith-1.0-9B-Hardware-Expert-fp16

Text Generation • 9B • Updated Jul 15 • 106 • 4

voxta/Llama-3-8B-LLM2Vec-ARDY-INT8

Feature Extraction • 8B • Updated Jul 30 • 80 • 1

OpenMOSS-Team/MOSS-VL-Realtime-NF4

Video-Text-to-Text • 11B • Updated 13 days ago • 266 • 14

unsloth/Muse-Glimmer-30B-unsloth-bnb-4bit

Image-Text-to-Text • 30B • Updated 21 days ago • 19.5k • 12

OpenMOSS-Team/MOSS-VL-Instruct-0708-NF4

Video-Text-to-Text • 11B • Updated 13 days ago • 148 • 15

prathmeshadsod/MoneyOps-Llama-4-Scout-17B-16E-Instruct

Text Generation • Updated 19 days ago • 15 • 2

Hatim2221/Mubsir-Qwen2.5-7B-VL-v2

Image-to-Text • 8B • Updated 7 days ago • 231 • 1

TomMoeras/contragand-qwen3.5-4b-closed

Text Generation • Updated 7 days ago • 34 • 1

TomMoeras/contragand-qwen3.5-4b-open

Text Generation • Updated 7 days ago • 35 • 1

Risim-hanse/krutrim-2-instruct-4bit

12B • Updated 2 days ago • 13 • 1

ApyHTML19/Gemma-2b-It_EU-AI-Reglementation

3B • Updated 1 day ago • 11 • 1

manitcor/Qwen3.8-27B-Obliterated-E03-bnb-4bit

Text Generation • 27B • Updated about 24 hours ago • 31 • 1

dddx/mehmehmeh

Text Generation • 7B • Updated Apr 4, 2025 • 14

rosyvs/whisat

Automatic Speech Recognition • Updated Apr 29, 2025 • 12 • 3