Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

30,635

Full-text search

Active filters: 4-bit

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 102k • 50

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 5 • 166 • 2

ritvik77/Medical_Doctor_AI_LoRA-Mistral-7B-Instruct_FullModel

Text Generation • Updated Mar 10 • 1.65k • 13

infinitestack/tinyllama-sugarcane

Updated Mar 24 • 64 • 3

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Mar 27 • 5.91k • 9

gaunernst/gemma-3-27b-it-qat-autoawq

Image-Text-to-Text • Updated 12 days ago • 987 • 5

mlx-community/GLM-Z1-9B-0414-4bit

Text Generation • Updated 15 days ago • 166 • 3

YaTharThShaRma999/orpheus_awq

Text-to-Speech • Updated 8 days ago • 63 • 3

unsloth/GLM-4-32B-0414-unsloth-bnb-4bit

Text Generation • Updated 2 days ago • 176 • 2

unsloth/GLM-4-32B-0414-bnb-4bit

Text Generation • Updated 2 days ago • 89 • 2

unsloth/gemma-3-27b-it-qat-bnb-4bit

Image-Text-to-Text • Updated 7 days ago • 119 • 2

kaitchup/GLM-Z1-32B-0414-autoround-gptq-4bit

Updated 4 days ago • 26 • 2

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • Updated 3 days ago • 2.92k • 2

unsloth/Qwen3-1.7B-unsloth-bnb-4bit

Text Generation • Updated 3 days ago • 760 • 2

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • Updated 4 days ago • 36.8k • 2

MaziyarPanahi/Qwen3-14B-GGUF

Text Generation • Updated 4 days ago • 36.1k • 2

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 3 days ago • 19.1k • 2

JunHowie/Qwen3-32B-GPTQ-Int4

Text Generation • Updated 3 days ago • 93 • 2

TheBloke/stable-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 49 • 219

TheBloke/WizardLM-7B-uncensored-GPTQ

Text Generation • Updated Oct 26, 2023 • 477 • 194

TheBloke/GPT4All-13B-snoozy-GPTQ

Text Generation • Updated Aug 21, 2023 • 151 • 33

TheBloke/gpt4-x-vicuna-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 110 • 34

TheBloke/Wizard-Vicuna-13B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 4.18k • 320

TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 3.78k • 163

TheBloke/samantha-33B-GPTQ

Text Generation • Updated Aug 21, 2023 • 26 • 20

TheBloke/Wizard-Vicuna-30B-Uncensored-GPTQ

Text Generation • Updated Sep 27, 2023 • 440 • 580

TheBloke/WizardLM-Uncensored-SuperCOT-StoryTelling-30B-GPTQ

Text Generation • Updated Sep 27, 2023 • 113 • 87

TheBloke/Karen_theEditor_13B-GPTQ

Text Generation • Updated Sep 27, 2023 • 22 • 13

TheBloke/Nous-Hermes-13B-GPTQ

Text Generation • Updated Aug 21, 2023 • 766 • 176

TheBloke/airoboros-33B-gpt4-1.4-GPTQ

Text Generation • Updated Aug 21, 2023 • 35 • 27