PrunaAI
/

Meta-Llama-3-8b-instruct-AWQ-smashed

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

Meta-Llama-3-8b-instruct-AWQ-smashed

Ctrl+K

Ctrl+K

2 contributors

History: 19 commits

sharpenb's picture

Update README.md

7ac0cb2 verified 9 months ago

.gitattributes

1.52 kB

initial commit about 1 year ago
LICENSE

7.8 kB

Upload LICENSE with huggingface_hub about 1 year ago
README.md

5.28 kB

Update README.md 10 months ago
config.json

981 Bytes

Upload config.json with huggingface_hub about 1 year ago
generation_config.json

142 Bytes

Upload generation_config.json with huggingface_hub about 1 year ago
model-00001-of-00002.safetensors

4.68 GB
xet

Upload model-00001-of-00002.safetensors with huggingface_hub about 1 year ago
model-00002-of-00002.safetensors

1.05 GB
xet

Upload model-00002-of-00002.safetensors with huggingface_hub about 1 year ago
model.safetensors.index.json

63.5 kB

Upload model.safetensors.index.json with huggingface_hub about 1 year ago
quant_config.json

82 Bytes

Upload quant_config.json with huggingface_hub about 1 year ago
special_tokens_map.json

301 Bytes

Upload special_tokens_map.json with huggingface_hub about 1 year ago
tokenizer.json

9.08 MB

Upload tokenizer.json with huggingface_hub about 1 year ago
tokenizer_config.json

50.9 kB

Upload tokenizer_config.json with huggingface_hub about 1 year ago