Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

304

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

Kondara/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Sep 27, 2024 • 20

argearriojas/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 27, 2024 • 1

mayanksharma3/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Sep 27, 2024 • 24

kingabzpro/llama-3.2-3b-it-Ecommerce-ChatBot

Text Generation • Updated Oct 1, 2024 • 86 • 7

BitStreamX/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 28, 2024 • 16

pipilok/Llama-3.2-3B-Instruct-Q4_0_4_8-GGUF

Text Generation • Updated Nov 1, 2024 • 37

Kondara/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Sep 28, 2024 • 1

Kondara/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Sep 28, 2024 • 1

argearriojas/Llama-3.2-3B-Instruct-Q2_K-GGUF

Text Generation • Updated Sep 30, 2024 • 2

CreativeWorksAi/iSA-01-Mini-3B-GGUF

Updated Oct 4, 2024 • 33

WTNLXTBL/Llama-3.2-3B-Instruct-Q4_K_S-GGUF

Text Generation • Updated Oct 2, 2024 • 1

hugger128/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 2, 2024 • 2

QuantFactory/Llama-3.2-Taiwan-Legal-3B-Instruct-GGUF

Text Generation • Updated Nov 2, 2024 • 1.21k • 11

carboncrystalx/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 4, 2024 • 1

QuantFactory/Evil-Alpaca-3B-L3.2-GGUF

Updated Oct 4, 2024 • 194 • 1

kalq18/llama4chan

Text Generation • Updated Oct 5, 2024 • 174

argearriojas/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 5, 2024 • 1

jairo/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 5, 2024 • 3

matrixportal/Llama-3.2-3B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Oct 6, 2024 • 2

matrixportal/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 6, 2024 • 1

ParisNeo/LLama-3.2-3B-Lollms-Finetuned-GGUF

Text2Text Generation • Updated Dec 17, 2024 • 31

QuantFactory/VersatiLlama-Llama-3.2-3B-Instruct-Abliterated-GGUF

Text Generation • Updated Oct 8, 2024 • 313 • 4

BitStreamX/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Oct 8, 2024 • 1

llmware/llama-3.2-3b-instruct-ov

Updated Oct 31, 2024 • 1.79k • 1

QuantFactory/Llama3.2-3B-ShiningValiant2-GGUF

Text Generation • Updated Oct 8, 2024 • 265 • 3

QuantFactory/Llama3.2-3B-Esper2-GGUF

Text Generation • Updated Oct 8, 2024 • 329 • 3

Jeethu/Llama-3.2-3B-Instruct-PLLM

Text Generation • Updated Oct 8, 2024 • 12

QuantFactory/Llama-3.2-3B-Instruct-abliterated-GGUF

Updated Oct 8, 2024 • 466 • 6

Esperanto/llama-3.2-3B-Instruct-kvc-fp16-onnx

Text Generation • Updated Dec 11, 2024 • 1

cyrille-colin/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 9, 2024 • 1