Edit Models filters

Model Tree

ibm-granite/granite-3.1-2b-instruct

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

29

Full-text search

Active filters: ibm-granite/granite-3.1-2b-instruct

lmstudio-community/granite-3.1-2b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 76 • 1

Mungert/granite-3.2-2b-instruct-GGUF

Text Generation • Updated about 1 month ago • 568 • 5

bartowski/granite-3.1-2b-instruct-GGUF

Text Generation • Updated Dec 23, 2024 • 1.91k • 4

NikolayKozloff/granite-3.1-2b-instruct-Q8_0-GGUF

Text Generation • Updated Dec 18, 2024 • 5 • 1

DevQuasar/ibm-granite.granite-3.1-2b-instruct-GGUF

Text Generation • Updated Feb 1 • 25

mradermacher/granite-3.1-2b-instruct-GGUF

Updated Dec 20, 2024 • 50

mradermacher/granite-3.1-2b-instruct-i1-GGUF

Updated Dec 20, 2024 • 57

skarmani/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 21, 2024 • 2

itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 23, 2024 • 4

Triangle104/granite-3.1-2b-instruct-Q4_K_S-GGUF

Text Generation • Updated Dec 25, 2024 • 2

Triangle104/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Dec 25, 2024 • 3

Triangle104/granite-3.1-2b-instruct-Q5_K_S-GGUF

Text Generation • Updated Dec 25, 2024 • 2

Triangle104/granite-3.1-2b-instruct-Q5_K_M-GGUF

Text Generation • Updated Dec 25, 2024 • 5

Triangle104/granite-3.1-2b-instruct-Q6_K-GGUF

Text Generation • Updated Dec 25, 2024 • 2

Triangle104/granite-3.1-2b-instruct-Q8_0-GGUF

Text Generation • Updated Dec 25, 2024 • 2

tensorblock/granite-3.1-2b-instruct-GGUF

Text Generation • Updated 13 days ago • 66

Alcoft/granite-3.1-2b-instruct-GGUF

Text Generation • Updated Jan 5 • 201

msyukorai/granite-3.1-2b-instruct-Q4_0-GGUF

Text Generation • Updated Jan 5 • 14

digital512/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Jan 7 • 3

RedHatAI/granite-3.1-2b-instruct-FP8-dynamic

Text Generation • Updated Jan 28 • 11

RedHatAI/granite-3.1-2b-instruct-quantized.w8a8

Text Generation • Updated Feb 28 • 371

RedHatAI/granite-3.1-2b-instruct-quantized.w4a16

Text Generation • Updated Feb 28 • 137

cgus/granite-3.1-2b-instruct-exl2

Text Generation • Updated Jan 22

ruslanmv/granite-3.1-2b-Reasoning-GGUF

Text Generation • Updated Feb 12 • 27

ruslanmv/granite-3.1-2b-Reasoning-4bit

Text Generation • Updated Feb 11 • 5

ObeJ/granite-3.1-2b-instruct-Q2_K-GGUF

Text Generation • Updated Feb 17 • 11

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q8_0-GGUF

Text Generation • Updated Feb 17 • 12

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q6_K-GGUF

Text Generation • Updated Feb 17 • 5

Lucy-in-the-Sky/granite-3.1-2b-instruct-Q4_K_M-GGUF

Text Generation • Updated Feb 17 • 11