Hugging Face's logo

fbaldassarri
/
meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int8-gs128-asym

Text Generation
Transformers
Safetensors
PyTorch
llama
autoround
intel-autoround
autogptq
auto-gptq
gptq
woq
meta
llama-3
intel
conversational
text-generation-inference
8-bit precision
Model card Files Community
meta-llama_Llama-3.1-8B-Instruct-auto_gptq-int8-gs128-asym
File size: 135 Bytes 
ee43647
 
 
 
1
2
3
4
 
version https://git-lfs.github.com/spec/v1
oid sha256:9d7beb02e63b9c3d66becd368bbf90c8dbaba60f87d595672a87383aeafc7343
size 4304944584