mlx-gen
Collection
Models prepared and quantized for Apple MLX by mlx-gen based on mflux. https://github.com/lpalbou/mlx-gen • 23 items • Updated
You need to agree to share your contact information to access this model
This repository is publicly accessible, but you have to accept the conditions to access its files and content.
Access is for non-commercial use under the FLUX Non-Commercial License and Black Forest Labs Acceptable Use Policy. This repository is a quantized derivative of a gated Black Forest Labs FLUX.2 Klein 9B model.
Log in or Sign Up to review the conditions and access this model content.
flux.2-klein-9b-4bit
This repository contains MLX-Gen saved weights for black-forest-labs/FLUX.2-klein-9B. The checkpoint is designed for local Apple Silicon inference with mlx-gen.
It uses the mflux/MLX saved-weight layout and MLX quantization tensors. It is not a Diffusers or Transformers from_pretrained() checkpoint.
Source Model
Original model: black-forest-labs/FLUX.2-klein-9B.
License and Access
This checkpoint is a quantized derivative of a gated Black Forest Labs FLUX.2 Klein 9B source model. The source model is distributed under the FLUX Non-Commercial License.
Host this derivative as a gated Hugging Face repository and require users to accept the same non-commercial license terms and Black Forest Labs Acceptable Use Policy before accessing the files.
Quantization
This is an MLX 4-bit checkpoint. Model-specific quantization predicates may keep unsupported layers unquantized or at a different precision. See the MLX-Gen quantization docs for compatibility notes.
Compatibility
Requires mlx-gen >= 0.18.2.
Generated with mlx-gen 0.18.2.
Use the mlxgen command and Python import path for new MLX-Gen projects.
Usage
python -m pip install -U mlx-gen
mlxgen download --model AbstractFramework/flux.2-klein-9b-4bit
mlxgen generate \
--model AbstractFramework/flux.2-klein-9b-4bit \
--prompt "Your prompt here" \
--steps 20 \
--seed 42 \
--output image.png
Attribution
MLX-Gen is based on mflux by Filip Strand and the original mflux contributors. This model card is generated by MLX-Gen so derived checkpoints keep that attribution visible.
Quantized and contributed by @lpalbou.
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for AbstractFramework/flux.2-klein-9b-4bit
Base model
black-forest-labs/FLUX.2-klein-9B