Inference Providers
Active filters: 4bit
mlx-community/Qwen3.5-9B-MLX-4bit
2B • Updated • 95.6k
• 52
Sepolian/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-Q4_K_M
Text Generation
• 27B • Updated • 1.26k
• 9
0xSero/GLM-4.7-REAP-218B-A32B-W4A16
Text Generation
• 2B • Updated • 212
• 23
bullpoint/Qwen3-Coder-Next-AWQ-4bit
Text Generation
• 14B • Updated • 1.22M
• 19
mlx-community/Qwen3.5-0.8B-OptiQ-4bit
Text Generation
• 0.2B • Updated • 2.37k
• 5
0xSero/GLM-4.7-REAP-50-W4A16
Text Generation
• 2B • Updated • 162
• 69
olka-fi/Qwen3.5-27B-MXFP4
Image-Text-to-Text
• 20B • Updated • 645
• 2
mlx-community/Qwen3.5-9B-OptiQ-4bit
Text Generation
• 9B • Updated • 6.01k
• 13
vanch007/Huihui-Qwen3.5-27B-Claude-4.6-Opus-abliterated-mlx-4bit
Image-Text-to-Text
• 5B • Updated • 1.03k
• 2
legraphista/glm-4-9b-chat-GGUF
Text Generation
• 9B • Updated • 12.5k
• 21
0xSero/GLM-4.6-REAP-218B-A32B-W4A16-AutoRound
Text Generation
• 2B • Updated • 108
• 8
smkrv/Qwen3-0.6B-CoreML-4bit
Text Generation
• Updated • 36
• 2
0xSero/GLM-4.7-REAP-40-W4A16
Text Generation
• 2B • Updated • 35
• 7
unsloth/Z-Image-Turbo-unsloth-bnb-4bit
Text-to-Image
• Updated • 761
• 4
mlx-community/Qwen3.5-4B-MLX-4bit
1.0B • Updated • 27.7k
• 11
mlx-community/Qwen3.5-2B-OptiQ-4bit
Text Generation
• 0.4B • Updated • 3.45k
• 2
mlx-community/Qwen3.5-4B-OptiQ-4bit
Text Generation
• 0.8B • Updated • 4.75k
• 7
Chun121/Qwen3-4B-RPG-Roleplay-V2
Text Generation
• 4B • Updated • 9.93k
• 43
mayaeary/pygmalion-6b-4bit-128g
Text Generation
• Updated • 19
• 40
mayaeary/pygmalion-6b_dev-4bit-128g
Text Generation
• Updated • 16
• 121
mayaeary/PPO_Pygway-V8p4_Dev-6b-4bit-128g
Text Generation
• Updated • 10
• 2
mayaeary/PPO_Pygway-6b-Mix-4bit-128g
Text Generation
• Updated • 3
• 2
Ancestral/Dolly_Shygmalion-6b-4bit-128g
Text Generation
• Updated • 8
• 5
Ancestral/PPO_Shygmalion-6b-4bit-128g
Text Generation
• Updated • 33
Ancestral/Dolly_Malion-6b-4bit-128g
Text Generation
• Updated • 5
• 1
4bit/pygmalion-6b-4bit-128g
Text Generation
• Updated • 2
• 3
Text Generation
• Updated • 3
• 1
seonglae/opt-125m-4bit-gptq
Text Generation
• Updated • 25
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
• Updated • 1
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
• Updated • 2