mlx-community
/

gemma-3-12b-pt-6bit

Image-Text-to-Text

text-generation-inference

Model card Files Files and versions Community

mlx-community/gemma-3-12b-pt-6bit

This model was converted to MLX format from google/gemma-3-12b-pt using mlx-vlm version 0.1.18. Refer to the original model card for more details on the model.

Use with mlx

pip install -U mlx-vlm

python -m mlx_vlm.generate --model mlx-community/gemma-3-12b-pt-6bit --max-tokens 100 --temperature 0.0 --prompt "Describe this image." --image <path_to_image>

Downloads last month: 10

Inference Providers NEW

Image-Text-to-Text

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including mlx-community/gemma-3-12b-pt-6bit

Gemma 3

A collection of lightweight, state-of-the-art open models built from the same research and technology that powers the Gemini 2.0 models • 31 items • Updated Mar 12 • 24