Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

6,959

Full-text search

Active filters: awq

graelo/Qwen2.5-14B-Instruct-1M-AWQ

Updated Jan 29 • 1.21k • 1

graelo/Qwen2.5-7B-Instruct-1M-AWQ

Updated Jan 29 • 348 • 5

casperhansen/mistral-small-24b-instruct-2501-awq

Updated Jan 30 • 2.19k • 7

stelterlab/Mistral-Small-24B-Instruct-2501-AWQ

Text Generation • Updated Mar 30 • 18.5k • 20

stelterlab/DeepSeek-R1-Distill-Qwen-14B-AWQ

Text Generation • Updated Feb 2 • 1.13k • 3

kishizaki-sci/gemma-2-9b-AWQ-4bit-EN-JP

Updated Feb 8 • 1 • 1

v2ray/GPT4chan-24B-AWQ

Text Generation • Updated Feb 5 • 17 • 1

curiousmind147/microsoft-phi-4-AWQ-4bit-GEMM

Text Generation • Updated Feb 4 • 371 • 1

mhdaw/s1-32B-awq

Text Generation • Updated Feb 6 • 6 • 1

CAPsMANyo/DeepSeekR1-Qwen2.5-Coder-32B-Preview-AWQ

Updated Feb 7 • 26 • 1

Valdemardi/Dolphin3.0-R1-Mistral-24B-AWQ

Text Generation • Updated Feb 7 • 79 • 5

Valdemardi/Dolphin3.0-Mistral-24B-AWQ

Text Generation • Updated Feb 7 • 31 • 2

Benasd/Qwen2.5-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 8 • 231 • 7

MPWARE/DeepSeek-R1-Distill-Qwen-14B-AWQ-4bits-GEMM

Updated Feb 10 • 5 • 1

PointerHQ/Qwen2.5-VL-72B-Instruct-Pointer-AWQ

Image-Text-to-Text • Updated Feb 23 • 117 • 8

GuilhermeNaturaUmana/Nature-Reason-1-AGI-AWQ

Text Generation • Updated Feb 10 • 11 • 2

Valdemardi/s1.1-32B-AWQ

Text Generation • Updated Feb 12 • 7 • 1

Qwen/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Mar 7 • 71.8k • 50

Benasd/Qwen2.5-VL-72B-Instruct-AWQ

Image-Text-to-Text • Updated Feb 20 • 205 • 6

Niazi/Llama-3-8B-AWQ-4bitV2

Updated Feb 14 • 3 • 1

Benasd/Qwen2.5-VL-72B-Instruct-AWQ-fix

Image-Text-to-Text • Updated Mar 2 • 67 • 1

rootonchair/InternVL2_5-4B-AWQ

Image-Text-to-Text • Updated Mar 3 • 32 • 2

kaitchup/QwQ-32B-AWQ-4bit

Text Generation • Updated Mar 7 • 561 • 2

radna/Light-Deepseek-R1-32B-awq-max

Updated Mar 7 • 10 • 1

InfiniAILab/QwQ-7B-AWQ

Updated Mar 8 • 28 • 1

radna/Qwen-1M-DeepSeek-R1-14B-awq-max

Updated Mar 8 • 5 • 1

noneUsername/QwQ-32B-abliterated-AWQ-INT4

Updated Mar 8 • 258 • 4

noneUsername/QwQ-32B-abliterated-AWQ-INT4-float16

Updated Mar 8 • 101 • 2

jeetpatel978/LLama-3.2-awq

Updated Mar 9 • 13 • 1

LGAI-EXAONE/EXAONE-Deep-2.4B-AWQ

Text Generation • Updated Mar 19 • 226 • 16