matrixportal/Gemmasutra-Small-4B-v1-GGUF

Gemmasutra-Small-4B-v1 GGUF Quantized Models

Model Information

• Base Model: TheDrummer/Gemmasutra-Small-4B-v1
• Quantized by: matrixportal
• Format: GGUF (for llama.cpp compatible tools)
• Quantized on: 2025-04-09

Recommended Downloads

• Q4_K_M: gemmasutra-small-4b-v1.q4_k_m.gguf
• Q4_0: gemmasutra-small-4b-v1.q4_0.gguf
• Q8_0: gemmasutra-small-4b-v1.q8_0.gguf

All Available Quantizations

File	Download
gemmasutra-small-4b-v1.f16.gguf	Download
gemmasutra-small-4b-v1.q2_k.gguf	Download
gemmasutra-small-4b-v1.q3_k_m.gguf	Download
gemmasutra-small-4b-v1.q4_0.gguf	Download
gemmasutra-small-4b-v1.q4_k_m.gguf	Download
gemmasutra-small-4b-v1.q5_k_m.gguf	Download
gemmasutra-small-4b-v1.q6_k.gguf	Download
gemmasutra-small-4b-v1.q8_0.gguf	Download

Usage Instructions

1. Download desired GGUF file
2. Use with compatible tools:
   • llama.cpp
   • Ollama
   • LM Studio
   • GPT4All

💡 Tip: Q4_K_M offers the best balance for most use cases.