https://huggingface.co/stduhpf/google-gemma-3-12b-it-qat-q4_0-gguf-small but with tokens 105 and 106 and their corresponding image tokens set to control instead of normal. Added general.name metadata.

Downloads last month
1,960
GGUF
Model size
11.8B params
Architecture
gemma3
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support