gemma-2-2b-it-GGUF / README.md
apepkuss79's picture
Create README.md
9555193 verified
metadata
base_model: google/gemma-2-2b-it
inference: false
library_name: transformers
license: gemma
model_creator: Google
model_name: gemma-2-2b-it
quantized_by: Second State Inc.
pipeline_tag: text-generation
tags:
  - conversational

Gemma-2-2b-it-GGUF

Original Model

google/gemma-2-2b-it

Run with Gaianet

Prompt template:

prompt template: gemma-instruct

Context size:

chat_ctx_size: 2048

Run with GaiaNet:

Quantized with llama.cpp b3463