Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

6,940

Full-text search

Active filters: awq

TheBloke/deepseek-coder-6.7B-base-AWQ

Text Generation • Updated Nov 9, 2023 • 86 • 9

TheBloke/LLaMA2-13B-TiefighterLR-AWQ

Text Generation • Updated Nov 9, 2023 • 35 • 2

TheBloke/Qwen-7B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 148 • 9

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-AWQ

Text Generation • Updated Nov 30, 2023 • 77 • 1

TheBloke/deepseek-llm-7B-base-AWQ

Text Generation • Updated Nov 29, 2023 • 1.88k • 2

TheBloke/deepseek-llm-7B-chat-AWQ

Text Generation • Updated Nov 29, 2023 • 271 • 2

TheBloke/Mistral-7B-Instruct-v0.2-AWQ

Text Generation • Updated Dec 11, 2023 • 32.9k • 44

TheBloke/Rogue-Rose-103b-v0.2-AWQ

Text Generation • Updated Dec 16, 2023 • 2.63k • 5

TheBloke/dolphin-2.7-mixtral-8x7b-AWQ

Text Generation • Updated Jan 1, 2024 • 5.91k • 22

TheBloke/DiscoLM_German_7b_v1-AWQ

Text Generation • Updated Jan 24, 2024 • 97 • 4

BioMistral/BioMistral-7B-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 213 • 5

Qwen/Qwen1.5-72B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 259 • 24

Qwen/Qwen1.5-14B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 791 • 23

Qwen/Qwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 281 • 13

Qwen/Qwen1.5-4B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 488 • 3

Qwen/Qwen1.5-1.8B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 129 • 4

Qwen/Qwen1.5-0.5B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 138 • 7

BioMistral/BioMistral-7B-DARE-AWQ-QGS128-W4-GEMM

Text Generation • Updated Feb 19, 2024 • 184 • 3

alexandreteles/bonito-v1-awq

Text2Text Generation • Updated Mar 16, 2024 • 205 • 3

cnmoro/Mistral-7B-Portuguese-AWQ

Text Generation • Updated Mar 3, 2024 • 18 • 1

Qwen/Qwen1.5-32B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 63 • 18

taeminlee/KULLM3-awq

Text Generation • Updated Apr 8, 2024 • 27 • 6

Qwen/CodeQwen1.5-7B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 123 • 14

casperhansen/llama-3-8b-instruct-awq

Text Generation • Updated Jun 8, 2024 • 10k • 23

Qwen/Qwen1.5-110B-Chat-AWQ

Text Generation • Updated Apr 30, 2024 • 27 • 9

Qwen/Qwen2-72B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 296 • 40

Qwen/Qwen2-1.5B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 6.9k • 8

Qwen/Qwen2-7B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 712 • 21

Qwen/Qwen2-0.5B-Instruct-AWQ

Text Generation • Updated Aug 21, 2024 • 518 • 4

cecibas/Midnight-Miqu-70B-v1.5-4bit

Text Generation • Updated Jun 7, 2024 • 207k • 3