Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,115

Base only

Active filters: 4bit

orcarouter/Qwen3.8-Flash-Next-Uncensored-MLX

Image-Text-to-Text • 177B • Updated 12 days ago • 666 • 51

mlx-community/Qwen3.5-9B-MLX-4bit

Image-Text-to-Text • 9B • Updated Mar 23 • 26.3k • 164

mlx-community/Qwen3.8-27B-Uncensored-OptiQ-4bit

Text Generation • 27B • Updated 17 days ago • 6.82k • 17

EricRollei/HunyuanImage-3-NF4-v2

Text-to-Image • 83B • Updated Feb 21 • 97 • 3

orcarouter/GLM-5.3-Flash-Uncensored-MLX

Image-Text-to-Text • 341B • Updated 11 days ago • 254 • 18

mlx-community/Qwen3.5-4B-MLX-4bit

5B • Updated Mar 2 • 25.2k • 40

mlx-community/Qwen3.5-0.8B-OptiQ-4bit

Text Generation • 0.8B • Updated Jul 14 • 1.41k • 23

mlx-community/gpt-oss-20b-OptiQ-4bit

Text Generation • 21B • Updated 12 days ago • 19.3k • 9

Vishva007/Qwen3.8-27B-W4A16-AutoRound-GPTQ

Image-Text-to-Text • 3B • Updated about 20 hours ago • 34.7k • 9

barrydeen/Qwen3.8-27B-AWQ-4bit

Image-Text-to-Text • 11B • Updated 27 days ago • 119k • 9

sokada4/Qwen3.8-27B-GPTQ-Int4

Image-Text-to-Text • 28B • Updated 26 days ago • 10k • 2

TheCluster/Qwen3.8-27B-Heretic-MLX-4bit

Image-Text-to-Text • 27B • Updated 22 days ago • 1.81k • 3

mondk/MiniCPM5-2B-Abliterated-Uncensored-MLX-4Bit

Text Generation • 3B • Updated 2 days ago • 303 • 1

mondk/Spark-x2.5-4B-Abliterated-Uncensored-MLX-4Bit

Text Generation • 4B • Updated about 14 hours ago • 283 • 1

Jommarn/UNSEEN_Gemma_4_26B_NSFW-GGUF

Image-Text-to-Text • 25B • Updated 9 days ago • 23.5k • 74

mayaeary/pygmalion-6b-4bit-128g

Text Generation • Updated Mar 28, 2023 • 33 • 39

mayaeary/pygmalion-6b_dev-4bit-128g

Text Generation • Updated Mar 28, 2023 • 36 • 121

mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g

Text Generation • Updated Mar 31, 2023 • 13 • 2

mayaeary/PPO_Pygway-6b-Mix-4bit-128g

Text Generation • Updated Mar 31, 2023 • 14 • 2

Ancestral/Dolly_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 17 • 5

Ancestral/PPO_Shygmalion-6b-4bit-128g

Text Generation • Updated Apr 9, 2023 • 12

Ancestral/Dolly_Malion-6b-4bit-128g

Text Generation • Updated Apr 10, 2023 • 19 • 1

4bit/pygmalion-6b-4bit-128g

Text Generation • Updated Apr 13, 2023 • 13 • 3

mlabonne/gpt2-GPTQ-4bit

Text Generation • Updated Jul 8, 2023 • 42 • 2

seonglae/opt-125m-4bit-gptq

Text Generation • Updated Jul 19, 2023 • 21

seonglae/wizardlm-7b-uncensored-gptq

Text Generation • Updated Jul 19, 2023 • 12

seonglae/llama-2-7b-chat-hf-gptq

Text Generation • Updated Jul 20, 2023 • 22

seonglae/llama-2-13b-chat-hf-gptq

Text Generation • Updated Jul 20, 2023 • 16

CalderaAI/13B-Ouroboros-GPTQ4bit-128g-CUDA

Text Generation • Updated Jul 20, 2023 • 9

SebastianSchramm/UniNER-7B-all-GPTQ-4bit-128g-actorder_True

Text Generation • 7B • Updated Nov 28, 2023 • 11 • 8