Edit Models filters

Model Tree

meta-llama/Llama-3.2-3B-Instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

304

Full-text search

Active filters: meta-llama/Llama-3.2-3B-Instruct

noidname/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 30, 2024

okoknik/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 30, 2024 • 1

david12345678/Llama-3.2-3B-Instruct-Q4_0-GGUF

Text Generation • Updated Oct 30, 2024 • 2

zhangfeng026/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Oct 30, 2024 • 1

singhjagpreet/Llama-3.2-3B-Instruct-Q8_0-GGUF

Text Generation • Updated Oct 31, 2024 • 1

velyan/Llama-3.2-3B-Instruct-Q3_K_M-GGUF

Text Generation • Updated Oct 31, 2024 • 2

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs128-asym

Text Generation • Updated Nov 11, 2024 • 15

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_round-int4-gs128-sym

Text Generation • Updated Nov 11, 2024 • 26

ModelCloud/Llama-3.2-3B-Instruct-gptqmodel-4bit-vortex-v3

Text Generation • Updated Nov 11, 2024 • 91 • 5

velyan/Llama-3.2-3B-Instruct-IQ3_M-GGUF

Text Generation • Updated Nov 2, 2024 • 12

velyan/Llama-3.2-3B-Instruct-Q5_K_S-GGUF

Text Generation • Updated Nov 2, 2024 • 6

Akshit-77/llama-3.2-3b-chatbot

Text Generation • Updated Mar 6 • 5

velyan/Llama-3.2-3B-Instruct-IQ3_XXS-GGUF

Text Generation • Updated Nov 2, 2024 • 3

velyan/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 2, 2024 • 16

velyan/Llama-3.2-3B-Instruct-Q3_K_L-GGUF

Text Generation • Updated Nov 2, 2024 • 26

velyan/Llama-3.2-3B-Instruct-Q5_0-GGUF

Text Generation • Updated Nov 2, 2024 • 4

vanhocpham/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 6, 2024 • 22 • 1

andmev/Llama-3.2-3B-Instruct-CoreML

Text Generation • Updated Nov 9, 2024 • 3 • 4

AIFunOver/Llama-3.2-3B-Instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 5 • 1

AIFunOver/Llama-3.2-3B-Instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 8

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 30

tensorblock/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 14 days ago • 44

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • Updated Nov 11, 2024 • 66

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • Updated Nov 11, 2024 • 14

Jaelin/Llama-3.2-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 12, 2024 • 11

smartloop-ai/Meta-Llama-3.2-3B-Instruct-GGUF

Updated Nov 13, 2024 • 1

kshervington/Llama-3.2-3B-Instruct-Q6_K-GGUF

Text Generation • Updated Nov 15, 2024 • 13

prithivMLmods/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated Nov 15, 2024 • 73 • 2

nvidia/Meta-Llama-3.2-3B-Instruct-ONNX-INT4

Updated Nov 15, 2024 • 7

mav23/Llama-3.2-3B-Instruct-Frog-GGUF

Text Generation • Updated Nov 16, 2024 • 99 • 1