Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

catid
/
cat-llama-3-70b-awq-q256-w4-gemm

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
4-bit precision
awq
Model card Files Files and versions Community
cat-llama-3-70b-awq-q256-w4-gemm
Ctrl+K
Ctrl+K
  • 1 contributor
History: 3 commits
catid's picture
catid
add model
8a611a0 about 1 year ago
  • .gitattributes
    1.52 kB
    initial commit about 1 year ago
  • README.md
    694 Bytes
    Create README.md about 1 year ago
  • config.json
    895 Bytes
    add model about 1 year ago
  • generation_config.json
    152 Bytes
    add model about 1 year ago
  • model-00001-of-00008.safetensors
    4.92 GB
    LFS
    add model about 1 year ago
  • model-00002-of-00008.safetensors
    4.92 GB
    LFS
    add model about 1 year ago
  • model-00003-of-00008.safetensors
    5 GB
    LFS
    add model about 1 year ago
  • model-00004-of-00008.safetensors
    4.92 GB
    LFS
    add model about 1 year ago
  • model-00005-of-00008.safetensors
    4.92 GB
    LFS
    add model about 1 year ago
  • model-00006-of-00008.safetensors
    5 GB
    LFS
    add model about 1 year ago
  • model-00007-of-00008.safetensors
    4.92 GB
    LFS
    add model about 1 year ago
  • model-00008-of-00008.safetensors
    4.52 GB
    LFS
    add model about 1 year ago
  • model.safetensors.index.json
    159 kB
    add model about 1 year ago
  • special_tokens_map.json
    301 Bytes
    add model about 1 year ago
  • tokenizer.json
    9.08 MB
    add model about 1 year ago
  • tokenizer_config.json
    50.9 kB
    add model about 1 year ago