HuggingFaceH4/CodeAlpaca_20K
Viewer • Updated • 20k • 9.21k • 108
How to use mlx-community/gemma-2b-coder with MLX:
# Make sure mlx-lm is installed
# pip install --upgrade mlx-lm
# if on a CUDA device, also pip install mlx[cuda]
# Generate text with mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/gemma-2b-coder")
prompt = "Once upon a time in"
text = generate(model, tokenizer, prompt=prompt, verbose=True)How to use mlx-community/gemma-2b-coder with MLX LM:
# Install MLX LM uv tool install mlx-lm # Generate some text mlx_lm.generate --model "mlx-community/gemma-2b-coder" --prompt "Once upon a time"
This model was converted to MLX format from MAISAAI/gemma-2b-coder.
Refer to the original model card for more details on the model.
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("mlx-community/gemma-2b-coder")
response = generate(model, tokenizer, prompt="hello", verbose=True)
Quantized