Edit Models filters

Model Tree

meta-llama/Llama-3.1-70B

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

76

Full-text search

Active filters: meta-llama/Llama-3.1-70B

mradermacher/Meta-Llama-3.1-70B-i1-GGUF

Updated Dec 16, 2024 • 110 • 2

NousResearch/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 23, 2024 • 284 • 41

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 4 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 4 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 4 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 3 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 16, 2024 • 10 • 3

XelotX/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 17, 2024 • 15 • 1

casperhansen/llama-3.3-70b-instruct-awq

Text Generation • Updated Dec 6, 2024 • 45.2k • 31

Infermatic/Llama-3.3-70B-Instruct-FP8-Dynamic

Text Generation • Updated Dec 9, 2024 • 115k • 1

roleplaiapp/Llama-3.3-70B-Instruct-Q4_0-GGUF

Text Generation • Updated Jan 15 • 117 • 2

Mungert/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated 29 days ago • 19.9k • 3

MikeRoz/deepcogito_cogito-v1-preview-llama-70B-8.0bpw-h8-exl2

Text Generation • Updated 26 days ago • 9 • 1

gghfez/cogito-v1-preview-llama-70B-exl2-4.5bpw

Text Generation • Updated 25 days ago • 15 • 1

Mungert/cogito-v1-preview-llama-70B-GGUF

Text Generation • Updated 12 days ago • 2.22k • 1

Mungert/cogito-v1-preview-llama-8B-GGUF

Text Generation • Updated 12 days ago • 2.19k • 1

Mungert/cogito-v1-preview-llama-3B-GGUF

Text Generation • Updated 12 days ago • 1.41k • 1

unsloth/Meta-Llama-3.1-70B-bnb-4bit

Text Generation • Updated Nov 22, 2024 • 2.89k • 31

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • Updated Aug 8, 2024 • 51 • 2

mradermacher/Meta-Llama-3.1-70B-GGUF

Updated Dec 16, 2024 • 192

RedHatAI/Meta-Llama-3.1-70B-FP8

Text Generation • Updated Oct 9, 2024 • 101 • 1

Orion-zhen/Hermes-3-Llama-3.1-70B-4.5bpw-exl2

Updated Aug 18, 2024

bigstorm/Hermes-3-Llama-3.1-70B-6.5bpw-8hb-exl2

Updated Aug 22, 2024

bullerwins/Hermes-3-Llama-3.1-70B-exl2_4.0bpw

Updated Aug 24, 2024

bullerwins/Hermes-3-Llama-3.1-70B-exl2_5.0bpw

Updated Aug 24, 2024

bullerwins/Hermes-3-Llama-3.1-70B-exl2_6.0bpw

Updated Aug 24, 2024

Niansuh/Hermes-3-Llama-3.1-70B-GGUF

Updated Aug 25, 2024 • 7 • 1