Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
granite-3.2-2b-instruct-abliterated-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions Community
1
granite-3.2-2b-instruct-abliterated-GGUF
Ctrl+K
Ctrl+K
  • 1 contributor
History: 6 commits
MaziyarPanahi's picture
MaziyarPanahi
ab7735ea4dacfa47130ac306b669d37d5e1fe2e507738d4a2d3e399f6d867d84
edf11ad verified 2 months ago
  • .gitattributes
    1.93 kB
    ab7735ea4dacfa47130ac306b669d37d5e1fe2e507738d4a2d3e399f6d867d84 2 months ago
  • README.md
    3.14 kB
    e70800ab4140cbc9b29971a5f3274cdbbc17a74db055d6d15af536226b82eee6 2 months ago
  • granite-3.2-2b-instruct-abliterated.Q5_K_M.gguf
    1.8 GB
    LFS
    e70800ab4140cbc9b29971a5f3274cdbbc17a74db055d6d15af536226b82eee6 2 months ago
  • granite-3.2-2b-instruct-abliterated.Q5_K_S.gguf
    1.76 GB
    LFS
    3d30775d71febb6f5682e4f71dea21804cf6601fde53f6b75735d09c646304d5 2 months ago
  • granite-3.2-2b-instruct-abliterated.Q6_K.gguf
    2.08 GB
    LFS
    ab7735ea4dacfa47130ac306b669d37d5e1fe2e507738d4a2d3e399f6d867d84 2 months ago
  • granite-3.2-2b-instruct-abliterated.Q8_0.gguf
    2.69 GB
    LFS
    be74940fd59d0f6d2cfd8a53cc79ca3d0ad508ba1779797ea6930e7948a52d1c 2 months ago
  • granite-3.2-2b-instruct-abliterated.fp16.gguf
    5.07 GB
    LFS
    f3fc61738d0b7cdf6f7251be649fee6a82f4dec45d182e1122a418af82b0d144 2 months ago