unsloth/gemma-3-12b-it-qat-GGUF
Image-Text-to-Text
•
Updated
•
6.18k
•
7
Gemma 3
All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats.
Note Gemma 3 (QAT) GGUFs to run:
-
unsloth/gemma-3-27b-it-qat-GGUF
Image-Text-to-Text • Updated • 4.47k • 5 -
unsloth/gemma-3-4b-it-qat-GGUF
Image-Text-to-Text • Updated • 3.79k • 4 -
unsloth/gemma-3-12b-it-qat-int4-GGUF
Image-Text-to-Text • Updated • 2.15k • 2
unsloth/gemma-3-27b-it-GGUF
Image-Text-to-Text • Updated • 111k • 114Note GGUFs to run Gemma 3:
-
unsloth/gemma-3-12b-it-GGUF
Image-Text-to-Text • Updated • 34.8k • 65 -
unsloth/gemma-3-4b-it-GGUF
Image-Text-to-Text • Updated • 34.3k • 79 -
unsloth/gemma-3-1b-it-GGUF
Text Generation • Updated • 25.5k • 32
unsloth/gemma-3-4b-it-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 282k • 14Note Unsloth Dynamic 4-bit Instruct:
-
unsloth/gemma-3-12b-it-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 152k • 9 -
unsloth/gemma-3-27b-it-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 52.3k • 15 -
unsloth/gemma-3-1b-it-unsloth-bnb-4bit
Text Generation • Updated • 57.6k • 2
unsloth/gemma-3-27b-it-bnb-4bit
Image-Text-to-Text • Updated • 16.1k • 17Note 4-bit BitsandBytes Instruct:
-
unsloth/gemma-3-1b-it-bnb-4bit
Text Generation • Updated • 263k • 6 -
unsloth/gemma-3-4b-it-bnb-4bit
Image-Text-to-Text • Updated • 17.7k • 6 -
unsloth/gemma-3-12b-it-bnb-4bit
Image-Text-to-Text • Updated • 8.41k • 3
unsloth/gemma-3-12b-pt-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 1.27kNote Unsloth Dynamic 4-bit Base:
-
unsloth/gemma-3-4b-pt-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 28k • 1 -
unsloth/gemma-3-27b-pt-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 706 • 3 -
unsloth/gemma-3-1b-pt-unsloth-bnb-4bit
Text Generation • Updated • 3.51k • 2
unsloth/gemma-3-1b-it
Text Generation • Updated • 44.7k • 8Note 16-bit Instruct models:
-
unsloth/gemma-3-12b-it
Image-Text-to-Text • Updated • 13.5k • 6 -
unsloth/gemma-3-4b-it
Image-Text-to-Text • Updated • 44.3k • 9 -
unsloth/gemma-3-27b-it
Image-Text-to-Text • Updated • 46.3k • 8
unsloth/gemma-3-1b-pt
Text Generation • Updated • 1.7k • 3Note 16-bit base models:
-
unsloth/gemma-3-4b-pt
Image-Text-to-Text • Updated • 2.59k • 1 -
unsloth/gemma-3-12b-pt
Image-Text-to-Text • Updated • 409 • 3 -
unsloth/gemma-3-27b-pt
Image-Text-to-Text • Updated • 280 • 3
unsloth/gemma-3-1b-pt-bnb-4bit
Text Generation • Updated • 532 • 3Note 4-bit BitsandBytes Base:
-
unsloth/gemma-3-4b-pt-bnb-4bit
Image-Text-to-Text • Updated • 1.05k • 1 -
unsloth/gemma-3-12b-pt-bnb-4bit
Image-Text-to-Text • Updated • 432 -
unsloth/gemma-3-27b-pt-bnb-4bit
Image-Text-to-Text • Updated • 7.61k
unsloth/gemma-3-27b-it-qat-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 483Note Gemma 3 (QAT) safetensors:
-
unsloth/gemma-3-27b-it-qat
Image-Text-to-Text • Updated • 341 • 2 -
unsloth/gemma-3-4b-it-qat
Image-Text-to-Text • Updated • 396 • 1 -
unsloth/gemma-3-27b-it-qat-bnb-4bit
Image-Text-to-Text • Updated • 123 • 2 -
unsloth/gemma-3-12b-it-qat-int4
Image-Text-to-Text • Updated • 112 • 1 -
unsloth/gemma-3-4b-it-qat-int4-GGUF
Updated • 943 • 1 -
unsloth/gemma-3-12b-it-qat-bnb-4bit
Image-Text-to-Text • Updated • 529 -
unsloth/gemma-3-12b-it-qat-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 303 -
unsloth/gemma-3-12b-it-qat-int4-unsloth-bnb-4bit
Updated • 209 -
unsloth/gemma-3-4b-it-qat-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 170 -
unsloth/gemma-3-12b-it-qat
Image-Text-to-Text • Updated • 151 -
unsloth/gemma-3-4b-it-qat-bnb-4bit
Image-Text-to-Text • Updated • 134 -
unsloth/gemma-3-4b-it-qat-int4-bnb-4bit
Image-Text-to-Text • Updated • 110 -
unsloth/gemma-3-1b-it-qat
Updated • 32 -
unsloth/gemma-3-12b-it-qat-int4-bnb-4bit
Updated • 26 -
unsloth/gemma-3-4b-it-qat-int4-unsloth-bnb-4bit
Image-Text-to-Text • Updated • 23 -
unsloth/gemma-3-4b-it-qat-int4
Image-Text-to-Text • Updated • 6