ggml-org
/

Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Text Generation

Model card Files Files and versions

Meta-Llama-3.1-8B-Instruct-Q4_0-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 6 commits

ggerganov's picture

q4_0 : match AWQ format (F16 input / output tensors)

0aba27d verified 8 months ago

.gitattributes

1.59 kB

Upload meta-llama-3.1-8b-instruct-q4_0.gguf with huggingface_hub 9 months ago
README.md

15.7 kB

readme : switch to ggml-org 9 months ago
imatrix.dat

989 kB

Upload imatrix.dat with huggingface_hub 9 months ago
meta-llama-3.1-8b-instruct-q4_0.gguf

6.04 GB
xet

q4_0 : match AWQ format (F16 input / output tensors) 8 months ago