Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

mixed-precision

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

437

Base only

Active filters: mixed-precision

mlx-community/Qwen3.6-27B-OptiQ-4bit

Text Generation • 27B • Updated 3 days ago • 14.3k • 23

mlx-community/gemma-4-e4b-it-OptiQ-4bit

Text Generation • 7B • Updated 4 days ago • 12.4k • 23

mlx-community/Qwen3.6-35B-A3B-OptiQ-4bit

Text Generation • 35B • Updated 3 days ago • 6.55k • 9

rdtand/Qwen3.5-122B-A10B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 72B • Updated Apr 21 • 21.8k • 17

rdtand/Qwen3.6-35B-A3B-PrismaQuant-4.75bit-vllm

Image-Text-to-Text • 21B • Updated Apr 21 • 142k • 27

JANGQ-AI/MiniMax-M2.7-JANGTQ_K

Text Generation • 20B • Updated 21 days ago • 1.73k • 11

dealignai/Nemotron-3-Super-120B-A12B-UNCENSORED-JANG_2L

Text Generation • 13B • Updated Apr 25 • 3.68k • 12

rdtand/Qwen3.6-27B-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm

17B • Updated 25 days ago • 91.9k • 19

osmapi/osmQwopus-3.6-27B-V2-heretic-abliterated-uncensored-OptiQ-3.7bpw-mlx

Image-Text-to-Text • 27B • Updated 5 days ago • 763 • 2

JANGQ-AI/Mistral-Small-4-119B-A6B-JANG_2L

Text Generation • 12B • Updated Apr 25 • 1.18k • 8

MarkChen1214/cohere-transcribe-03-2026-MLX-Mixed-3bit4bit

Automatic Speech Recognition • 0.3B • Updated Apr 1 • 92 • 4

mconcat/Qwopus3.5-27B-v3-NVFP4

Text Generation • 22B • Updated Apr 8 • 249 • 5

mlx-community/gemma-4-e2b-it-OptiQ-4bit

Text Generation • 1B • Updated 4 days ago • 2.93k • 3

splats/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ8e

10B • Updated about 1 month ago • 2.82k • 4

splats/Qwen3.6-35B-A3B-Claude-4.7-Opus-Reasoning-Distilled-oQ4e

6B • Updated about 1 month ago • 3.05k • 4

mlx-community/gemma-4-31B-it-OptiQ-4bit

Text Generation • 31B • Updated 4 days ago • 5.38k • 5

deucebucket/Qwen3.6-35B-A3B-Cerebellum-GGUF

Image-Text-to-Text • 35B • Updated 11 days ago • 1.75k • 9

cyburn/Qwopus3.6-35B-A3B-v1-PrismaSCOUT-Blackwell-NVFP4-BF16-vllm-4.75bits

Image-Text-to-Text • 21B • Updated 22 days ago • 29.8k • 6

OsaurusAI/ZAYA1-8B-JANGTQ_K

Text Generation • 0.9B • Updated 18 days ago • 233 • 1

mlx-community/Qwen3.5-9B-OptiQ-4bit

Text Generation • 9B • Updated 3 days ago • 229k • 47

dealignai/MiniMax-M2.7-JANGTQ_K-CRACK

Text Generation • 20B • Updated 21 days ago • 1.65k • 12

newmindai/Llama-3.1-8B-Instruct-w16a16-tw

Text Generation • 8B • Updated Dec 9, 2025 • 5

newmindai/Llama-3.1-8B-Instruct-w16a8-1node-bs8

Text Generation • 8B • Updated Dec 9, 2025 • 21

newmindai/Llama-3.1-8B-Instruct-w16a8-8nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 9

newmindai/Llama-3.1-8B-Instruct-w16a8-rw

Text Generation • 8B • Updated Dec 9, 2025 • 6

newmindai/Llama-3.1-8B-Instruct-w16a8-mxtw

Text Generation • 8B • Updated Dec 9, 2025 • 6

newmindai/Llama-3.1-8B-Instruct_w16a8_rw_with_gw_hp

Text Generation • 8B • Updated Dec 9, 2025 • 7

newmindai/Llama-3.1-8B-Instruct-w16a16-4nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 4

newmindai/Llama-3.1-8B-Instruct-w16a8-4nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 5

newmindai/Llama-3.1-8B-Instruct-w16a16-8nodes-bs32

Text Generation • 8B • Updated Dec 9, 2025 • 5