Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
gaunernst 's Collections
DeepSeek testing
Gemma 3 QAT INT4 (from GGUF)
Gemma 3 QAT INT4 (from Flax)
Mini BERT models
Face Recognition Models
LLMs < 1B
LLMs 1B - 2B
LLMs 2B - 4B
Smallish LLM pre-training datasets
Llama2-compatible
Llama3-compatible

Gemma 3 QAT INT4 (from Flax)

updated Apr 6

These are converted from the official QAT INT4 Flax checkpoints on Kaggle. Supported formats: AutoAWQ, GGUF

Upvote
5

  • gaunernst/gemma-3-1b-it-int4-awq

    Text Generation • Updated Apr 6 • 555 • 2

  • gaunernst/gemma-3-4b-it-int4-awq

    Image-Text-to-Text • Updated Apr 6 • 768 • 1

  • gaunernst/gemma-3-12b-it-int4-awq

    Image-Text-to-Text • Updated Apr 6 • 3.96k • 9

  • gaunernst/gemma-3-27b-it-int4-awq

    Image-Text-to-Text • Updated Apr 6 • 11.9k • 18

  • gaunernst/gemma-3-1b-it-int4-gguf

    Text Generation • Updated Apr 6 • 117 • 3

  • gaunernst/gemma-3-4b-it-int4-gguf

    Image-Text-to-Text • Updated Apr 6 • 56

  • gaunernst/gemma-3-12b-it-int4-gguf

    Image-Text-to-Text • Updated Apr 6 • 75 • 1

  • gaunernst/gemma-3-27b-it-int4-gguf

    Image-Text-to-Text • Updated Apr 6 • 139 • 3

  • gaunernst/gemma-3-1b-it-int4

    Text Generation • Updated Mar 30 • 9

  • gaunernst/gemma-3-4b-it-int4

    Image-Text-to-Text • Updated Mar 29 • 35

  • gaunernst/gemma-3-12b-it-int4

    Image-Text-to-Text • Updated Mar 30 • 42

  • gaunernst/gemma-3-27b-it-int4

    Updated Mar 31
Upvote
5
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs