Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

6,937

Full-text search

Active filters: awq

Qwen/Qwen3-32B-AWQ

Text Generation • Updated 1 day ago • 324 • 17

Orion-zhen/Qwen3-32B-AWQ

Updated 4 days ago • 2.61k • 11

Qwen/Qwen3-14B-AWQ

Text Generation • Updated 1 day ago • 194 • 10

Qwen/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated 26 days ago • 96.2k • 60

Qwen/QwQ-32B-AWQ

Text Generation • Updated Mar 11 • 95.3k • 122

OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym

Updated 3 days ago • 23.2k • 13

Qwen/Qwen2.5-VL-32B-Instruct-AWQ

Image-Text-to-Text • Updated 26 days ago • 43.1k • 40

bullerwins/Qwen3-32B-awq

Text Generation • Updated 4 days ago • 714 • 3

Qwen/Qwen2.5-32B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 75.2k • 76

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 101k • 50

gaunernst/gemma-3-27b-it-qat-autoawq

Image-Text-to-Text • Updated 12 days ago • 990 • 5

Orion-zhen/Qwen3-8B-AWQ

Updated 4 days ago • 7.86k • 2

TheBloke/Llama-2-7B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 7.11k • 21

TheBloke/Llama-2-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 126 • 14

TheBloke/Yarn-Llama-2-7B-128K-AWQ

Text Generation • Updated Nov 9, 2023 • 50 • 1

TheBloke/Phind-CodeLlama-34B-v2-AWQ

Text Generation • Updated Nov 9, 2023 • 143 • 34

TheBloke/13B-Chimera-AWQ

Text Generation • Updated Nov 9, 2023 • 44 • 2

TheBloke/30B-Epsilon-AWQ

Text Generation • Updated Nov 9, 2023 • 30 • 3

TheBloke/Wizard-Vicuna-30B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 102 • 13

TheBloke/Wizard-Vicuna-7B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 88 • 7

TheBloke/WizardLM-13B-Uncensored-AWQ

Text Generation • Updated Nov 9, 2023 • 78 • 2

TheBloke/Mistral-7B-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 1.28k • 31

TheBloke/Mistral-7B-Instruct-v0.1-AWQ

Text Generation • Updated Nov 9, 2023 • 3.07k • 38

TheBloke/zephyr-7B-alpha-AWQ

Text Generation • Updated Nov 9, 2023 • 80 • 18

TheBloke/llava-v1.5-13B-AWQ

Text Generation • Updated Nov 9, 2023 • 147 • 35

TheBloke/Yarn-Mistral-7B-128k-AWQ

Text Generation • Updated Nov 9, 2023 • 485 • 72

TheBloke/deepseek-coder-33B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 3.09k • 37

TheBloke/deepseek-coder-6.7B-instruct-AWQ

Text Generation • Updated Nov 13, 2023 • 258 • 16

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 92 • 9

TheBloke/LLaMA2-13B-TiefighterLR-AWQ

Text Generation • Updated Nov 9, 2023 • 38 • 2