Hugging Face's logo

catid
/
cat-llama-3-70b-awq-q128-w4-gemm

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
4-bit precision
awq
Model card Files Community
1
cat-llama-3-70b-awq-q128-w4-gemm
  • 1 contributor
 History: 9 commits
catid's picture
catid
Merge branch 'main' of hf.co:catid/cat-llama-3-70b-awq-q128-w4-gemm
6821a88