Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

26,630

Full-text search

Active filters: 4-bit

secemp9/TraceBack-12b

Text Generation • Updated 2 days ago • 471 • 26

Qwen/QwQ-32B-AWQ

Text Generation • Updated 5 days ago • 87.2k • 88

unsloth/QwQ-32B-unsloth-bnb-4bit

Text Generation • Updated 9 days ago • 11.7k • 26

unsloth/gemma-3-27b-it-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 15.8k • 9

mlx-community/DeepSeek-R1-4bit

Updated 18 days ago • 6.53k • 26

mlx-community/QwQ-32B-4bit

Text Generation • Updated 11 days ago • 3.98k • 27

cognitivecomputations/DeepSeek-R1-AWQ

Text Generation • Updated 28 days ago • 50k • 71

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 27 days ago • 174k • 38

Qwen/Qwen2.5-VL-3B-Instruct-AWQ

Image-Text-to-Text • Updated 27 days ago • 29k • 24

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated 9 days ago • 171k • 40

unsloth/gemma-3-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 14.5k • 4

mlx-community/OLMo-2-0325-32B-Instruct-4bit

Text Generation • Updated 2 days ago • 56 • 4

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 2.61M • 85

Qwen/Qwen2.5-32B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 9, 2024 • 199k • 30

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_4.0bpw_H8

Text Generation • Updated 1 day ago • 346 • 3

unsloth/gemma-3-4b-it-bnb-4bit

Image-Text-to-Text • Updated 3 days ago • 1.51k • 3

unsloth/gemma-3-1b-it-bnb-4bit

Text Generation • Updated 3 days ago • 785 • 3

MaziyarPanahi/gemma-3-1b-it-GGUF

Text Generation • Updated 4 days ago • 174k • 3

mlx-community/QwQ-DeepSeek-R1-SkyT1-Flash-Lightest-32B-mlx-4Bit

Text Generation • Updated 2 days ago • 118 • 3

unsloth/c4ai-command-a-03-2025-unsloth-bnb-4bit

Text Generation • Updated 2 days ago • 31 • 3

unsloth/c4ai-command-a-03-2025-bnb-4bit

Text Generation • Updated 2 days ago • 19.4k • 3

CohereForAI/c4ai-command-r-plus-4bit

Text Generation • Updated Sep 27, 2024 • 856 • 253

unsloth/gemma-2-2b-it-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 17.8k • 17

Qwen/Qwen2.5-7B-Instruct-GPTQ-Int4

Text Generation • Updated Oct 18, 2024 • 53.6k • 18

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated 17 days ago • 32.5k • 40

casperhansen/deepseek-r1-distill-qwen-32b-awq

Updated Feb 8 • 27.8k • 9

mlx-community/Mistral-Small-24B-Instruct-2501-4bit

Updated Jan 30 • 1.19k • 10

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 1.13M • 2

Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-4bit

Text Generation • Updated Feb 3 • 303 • 2

unsloth/Phi-4-mini-instruct-unsloth-bnb-4bit

Text Generation • Updated 13 days ago • 3.23k • 9