sofya-ai/Meta-Llama-3.1-70B-Instruct-int4-auto-gptq
Updated
•
2
Edit Models filters
Inference Providers
Active filters:
meta-llama/Llama-3.1-70B-Instruct
espressor/meta-llama.Llama-3.1-70B-Instruct_W8A8_FP8
Text Generation
•
Updated
OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc
Updated
•
17
•
1
OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc
Updated
•
3
•
1
bartowski/Llama-3.3-70B-Instruct-exl2
Text Generation
•
Updated
•
15
•
3
etemiz/Llama-3.1-70B-Instruct-GGUF
Updated
•
35
RedHatAI/Llama-3.3-70B-Instruct-quantized.w4a16
Text Generation
•
Updated
•
3.43k
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q2_K-GGUF
Text Generation
•
Updated
•
7
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_S-GGUF
Text Generation
•
Updated
•
2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_M-GGUF
Text Generation
•
Updated
•
3
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q3_K_L-GGUF
Text Generation
•
Updated
•
2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_0-GGUF
Text Generation
•
Updated
•
3
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_S-GGUF
Text Generation
•
Updated
•
2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q4_K_M-GGUF
Text Generation
•
Updated
•
12
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_0-GGUF
Text Generation
•
Updated
•
2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_S-GGUF
Text Generation
•
Updated
•
2
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q5_K_M-GGUF
Text Generation
•
Updated
•
4
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K-GGUF
Text Generation
•
Updated
•
15
roleplaiapp/Llama-3.1-Nemotron-70B-Instruct-HF-Q8_0-GGUF
Text Generation
•
Updated
•
4
tensorblock/Llama-3.1-70B-Instruct-GGUF
Text Generation
•
Updated
•
56
context-labs/neuralmagic-llama-3.1-70b-instruct-FP8
Text Generation
•
Updated
•
1
necva/replicate-IEPile-Llama3.1-70B
Updated
•
1
necva/replica-IEPile-Llama3.1-70B
Updated
•
1