Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

4-bit precision

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,785

Full-text search

Active filters: gptq

TheBloke/openchat_3.5-GPTQ

Text Generation • Updated Nov 2, 2023 • 124 • 17

TheBloke/OpenHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 2, 2023 • 746 • 28

TheBloke/deepseek-coder-6.7B-instruct-GPTQ

Text Generation • Updated Nov 5, 2023 • 273 • 25

TheBloke/merlyn-education-corpus-qa-v2-GPTQ

Text Generation • Updated Nov 16, 2023 • 18 • 3

TheBloke/merlyn-education-safety-GPTQ

Text Generation • Updated Nov 16, 2023 • 17 • 3

TheBloke/saiga_mistral_7b-GPTQ

Text Generation • Updated Nov 28, 2023 • 65 • 8

TheBloke/deepseek-llm-67b-chat-GPTQ

Text Generation • Updated Nov 29, 2023 • 91 • 7

TheBloke/deepseek-llm-7B-chat-GPTQ

Text Generation • Updated Nov 30, 2023 • 1.31k • 1

Qwen/Qwen-1_8B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 66 • 5

Qwen/Qwen-1_8B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 1.26k • 35

Qwen/Qwen-72B-Chat-Int4

Text Generation • Updated Jan 4, 2024 • 99 • 47

Qwen/Qwen-72B-Chat-Int8

Text Generation • Updated Jan 4, 2024 • 78 • 17

AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 48 • 6

Pi3141/alpaca-7b-native-enhanced-GPTQ

Text Generation • Updated Dec 3, 2023 • 2

AI-Sweden-Models/gpt-sw3-20b-instruct-4bit-gptq

Text Generation • Updated Jan 7 • 41 • 4

TheBloke/Mixtral-8x7B-Instruct-v0.1-GPTQ

Text Generation • Updated Dec 14, 2023 • 92.4k • 136

TheBloke/Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Dec 11, 2023 • 18.9k • 51

TheBloke/dolphin-2.5-mixtral-8x7b-GPTQ

Text Generation • Updated Dec 14, 2023 • 146 • 112

TheBloke/GEITje-7B-chat-GPTQ

Text Generation • Updated Dec 19, 2023 • 29 • 4

TheBloke/LLaMA-Pro-8B-Instruct-GPTQ

Text Generation • Updated Jan 7, 2024 • 109 • 5

TheBloke/laser-dolphin-mixtral-2x7b-dpo-GPTQ

Text Generation • Updated Jan 15, 2024 • 23 • 11

TheBloke/DareVox-7B-GPTQ

Text Generation • Updated Jan 17, 2024 • 18 • 2

TheBloke/CodeLlama-70B-Instruct-GPTQ

Text Generation • Updated Jan 31, 2024 • 50 • 13

TheBloke/CodeLlama-70B-Python-GPTQ

Text Generation • Updated Jan 31, 2024 • 92 • 19

TheBloke/CapybaraHermes-2.5-Mistral-7B-GPTQ

Updated Jan 31, 2024 • 508 • 57

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 12 • 10

Qwen/Qwen1.5-72B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 95 • 7

Qwen/Qwen1.5-72B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 3.03k • 37

Qwen/Qwen1.5-14B-Chat-GPTQ-Int4

Text Generation • Updated Apr 30, 2024 • 151 • 21

Qwen/Qwen1.5-7B-Chat-GPTQ-Int8

Text Generation • Updated Apr 30, 2024 • 93 • 26