4.0 bpw exl3 quant of Qwen/Qwen3-235B-A22B

Runs on 5x24GB with 16k context (Q6).

Downloads last month
2
Safetensors
Model size
60B params
Tensor type
F16
·
I16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support