tensorblock
/

granite-3.1-8b-instruct-GGUF

Text Generation

Model card Files Files and versions Community

granite-3.1-8b-instruct-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

morriszms's picture

Update README.md

a1a350b verified 21 days ago

.gitattributes

2.37 kB

Upload folder using huggingface_hub 4 months ago
README.md

6.13 kB

Update README.md 21 days ago
granite-3.1-8b-instruct-Q2_K.gguf

3.1 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q3_K_L.gguf

4.35 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q3_K_M.gguf

4 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q3_K_S.gguf

3.59 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q4_0.gguf

4.65 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q4_K_M.gguf

4.94 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q4_K_S.gguf

4.69 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q5_0.gguf

5.65 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q5_K_M.gguf

5.8 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q5_K_S.gguf

5.65 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q6_K.gguf

6.71 GB
LFS

Upload folder using huggingface_hub 4 months ago
granite-3.1-8b-instruct-Q8_0.gguf

8.68 GB
LFS

Upload folder using huggingface_hub 4 months ago