Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

30,596

Full-text search

Active filters: 4-bit

lmstudio-community/Qwen3-30B-A3B-MLX-4bit

Text Generation • Updated 3 days ago • 2.3k • 14

Orion-zhen/Qwen3-32B-AWQ

Updated 3 days ago • 1.68k • 11

mlx-community/Dia-1.6B-4bit

Text-to-Speech • Updated 7 days ago • 266 • 7

fantos/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 20 • 168 • 6

Qwen/Qwen3-32B-AWQ

Text Generation • Updated about 15 hours ago • 6

Zhihu-ai/Zhi-writing-dsr1-14b-gptq-int4

Text Generation • Updated 11 days ago • 188 • 10

unsloth/Qwen3-30B-A3B-bnb-4bit

Updated 3 days ago • 3.03k • 5

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 26 days ago • 98.3k • 60

Qwen/QwQ-32B-AWQ

Text Generation • Updated Mar 11 • 88.6k • 122

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated 26 days ago • 43.8k • 40

mlx-community/Qwen3-30B-A3B-4bit

Text Generation • Updated 3 days ago • 987 • 4

Qwen/Qwen3-14B-AWQ

Text Generation • Updated about 15 hours ago • 4

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 75.8k • 76

openbmb/MiniCPM-o-2_6-int4

Any-to-Any • Updated Feb 27 • 5.08k • 44

unsloth/gemma-3-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 7 days ago • 285k • 14

OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym

Updated 2 days ago • 62.2k • 13

FunAGI/Qwen2.5-Omni-7B-GPTQ-4bit

Any-to-Any • Updated Mar 28 • 3.29k • 52

unsloth/Qwen3-32B-unsloth-bnb-4bit

Text Generation • Updated 3 days ago • 1.19k • 3

unsloth/Qwen3-32B-bnb-4bit

Updated 3 days ago • 661 • 3

unsloth/Qwen3-0.6B-unsloth-bnb-4bit

Text Generation • Updated 3 days ago • 1.4k • 3

lmstudio-community/Qwen3-14B-MLX-4bit

Text Generation • Updated 3 days ago • 1.58k • 3

mlx-community/Qwen3-4B-4bit

Text Generation • Updated 3 days ago • 703 • 3

mlx-community/Qwen3-235B-A22B-4bit

Text Generation • Updated 3 days ago • 496 • 3

bullerwins/Qwen3-32B-awq

Text Generation • Updated 3 days ago • 700 • 3

unsloth/Phi-4-mini-reasoning-unsloth-bnb-4bit

Text Generation • Updated 1 day ago • 176 • 3

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 253k • 80

mlx-community/Qwen2.5-Coder-32B-Instruct-4bit

Text Generation • Updated Nov 11, 2024 • 74.2k • 9

mlx-community/DeepSeek-R1-Distill-Llama-70B-4bit

Text Generation • Updated Feb 26 • 634 • 8

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 102k • 50

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 5 • 166 • 2