altomek
/

Higgs-Llama-3-70B-4bpw-EXL2

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Higgs-Llama-3-70B

ExLlamav2 4 bpw 8 hb quants of https://huggingface.co/bosonai/Higgs-Llama-3-70B

Downloads last month: 5

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for altomek/Higgs-Llama-3-70B-4bpw-EXL2

Base model

meta-llama/Meta-Llama-3-70B

Finetuned

bosonai/Higgs-Llama-3-70B

Quantized

(5)

this model