Edit Models filters

Model Tree

meta-llama/Llama-3.2-1B-Instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

241

Full-text search

Active filters: meta-llama/Llama-3.2-1B-Instruct

ModelCloud/Llama-3.2-1B-Instruct-gptqmodel-4bit-vortex-v2.5

Text Generation • Updated Nov 11, 2024 • 363 • 5

kvrma/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 7, 2024 • 1

kvrma/Llama-3.2-1B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 7, 2024 • 1

AIFunOver/Llama-3.2-1B-Instruct-openvino-8bit

Text Generation • Updated Nov 7, 2024 • 3

AIFunOver/Llama-3.2-1B-Instruct-openvino-4bit

Text Generation • Updated Nov 7, 2024 • 3

mav23/llama-v1-GGUF

Text Generation • Updated Nov 7, 2024 • 48

j0park/Llama-3.2-1B-Instruct-Q5_K_M-GGUF

Text Generation • Updated Nov 8, 2024 • 2

hieupt/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 8, 2024 • 1

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • Updated Nov 8, 2024 • 58

tensorblock/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated 13 days ago • 57 • 1

Hjgugugjhuhjggg/Llama-3.2-1B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 9, 2024 • 10

nautilie7/Llama-3.2-1B-Instruct-IQ4_NL-GGUF

Text Generation • Updated Nov 9, 2024 • 3

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int4-gs128-asym

Text Generation • Updated Nov 11, 2024 • 14

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • Updated Nov 11, 2024 • 14

Jaelin/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 12, 2024 • 4

Jaelin/Llama-3.2-1B-Instruct-Q2_K-GGUF

Text Generation • Updated Nov 12, 2024 • 2

klgchanu/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 12, 2024 • 2

cyberbaggage/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 15, 2024 • 1

Jaelin/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 15, 2024 • 21

osllmai-community/Qwen2.5-Coder-7B-Instruct-bnb-4bit

Text Generation • Updated Jan 31

Jeffsimpsons/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 16, 2024 • 6

mav23/Llama_3.2_1B_Intruct_Tool_Calling_V2-GGUF

Updated Nov 17, 2024 • 552

Almheiri/Llama-3.2-1B-Instruct-AWQ-INT4

Updated Dec 11, 2024

bandoti/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 21, 2024 • 1

Pseudoface/Llama-3.2-1B-Instruct-q4f16_1-MLC

Updated Nov 22, 2024

alices2/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 23, 2024 • 3 • 1

QuantFactory/OneLLM-Doey-V1-Llama-3.2-1B-it-GGUF

Text Generation • Updated Nov 24, 2024 • 36 • 2

Maites/Llama-3.2-1B-Instruct-Q4_K_M-GGUF

Text Generation • Updated Nov 25, 2024 • 1

Maites/Llama-3.2-1B-Instruct-Q8_0-GGUF

Text Generation • Updated Nov 25, 2024 • 2

QuantFactory/OneLLM-Doey-ChatQA-V1-Llama-3.2-1B-GGUF

Text Generation • Updated Nov 25, 2024 • 105 • 5