Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

6,940

Full-text search

Active filters: awq

elyza/Llama-3-ELYZA-JP-8B-AWQ

Text Generation • Updated Jun 26, 2024 • 601 • 4

shuyuej/MedLLaMA3-70B-base-AWQ

Text Generation • Updated Jun 26, 2024 • 1

casperhansen/deepseek-coder-v2-instruct-awq

Text Generation • Updated Jul 3, 2024 • 351 • 12

TechxGenus/DeepSeek-V2-Lite-Chat-AWQ

Text Generation • Updated Jul 4, 2024 • 944 • 2

TechxGenus/DeepSeek-V2-Lite-AWQ

Text Generation • Updated Jul 4, 2024 • 208 • 1

arcee-ai/Arcee-Nova-AWQ

Text Generation • Updated Jul 16, 2024 • 8 • 1

hugging-quants/Meta-Llama-3.1-8B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 345k • 67

hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7, 2024 • 50.7k • 100

casperhansen/mistral-nemo-instruct-2407-awq

Text Generation • Updated Sep 27, 2024 • 10.4k • 10

Qwen/Qwen2-VL-7B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 25, 2024 • 12.4k • 49

Qwen/Qwen2-VL-2B-Instruct-AWQ

Image-Text-to-Text • Updated Sep 21, 2024 • 5.36k • 22

aixsatoshi/c4ai-command-r-plus-08-2024-awq

Updated Sep 2, 2024 • 102 • 5

jfiekdjdk/glm-4-9b-chat-awq

Updated Sep 15, 2024 • 8 • 2

Qwen/Qwen2.5-7B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 26.9k • 23

Qwen/Qwen2.5-72B-Instruct-AWQ

Text Generation • Updated Oct 9, 2024 • 261k • 65

Qwen/Qwen2.5-Coder-7B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 13.9k • 13

Qwen/Qwen2.5-Coder-1.5B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 6.17k • 3

peakji/steiner-32b-preview-awq

Updated Oct 21, 2024 • 4 • 4

ibnzterrell/Nvidia-Llama-3.1-Nemotron-70B-Instruct-HF-AWQ-INT4

Text Generation • Updated Dec 7, 2024 • 268 • 4

PyrTools/Ministral-8B-Instruct-2410-AWQ

Updated Oct 25, 2024 • 2.04k • 1

IntelLabs/sqft-phi-3.5-mini-instruct-wikitext2-awq-64g-ppl10.41

Text Generation • Updated Feb 25 • 15 • 1

Qwen/Qwen2.5-Coder-32B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 16.4k • 27

Qwen/Qwen2.5-Coder-14B-Instruct-AWQ

Text Generation • Updated Jan 12 • 4.59k • 12

Qwen/Qwen2.5-Coder-3B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 8.91k • 4

Qwen/Qwen2.5-Coder-0.5B-Instruct-AWQ

Text Generation • Updated Nov 18, 2024 • 351 • 2

xingyaoww/Qwen2.5-Coder-32B-Instruct-AWQ-128k

Text Generation • Updated Nov 11, 2024 • 179 • 7

LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct-AWQ

Updated Nov 19, 2024 • 12 • 5

andretisch/llava-saiga-8b-awq

Updated Dec 2, 2024 • 27 • 1

KirillR/QwQ-32B-Preview-AWQ

Text Generation • Updated Nov 27, 2024 • 498 • 24

kosbu/Athene-V2-Chat-AWQ

Text Generation • Updated Nov 29, 2024 • 857 • 6