Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

416

Full-text search

Active filters: hqq

mobiuslabsgmbh/Qwen2.5-VL-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated 18 days ago • 162 • 1

mlabonne/AlphaMonarch-7B-2bit-HQQ

Text Generation • Updated Mar 28, 2024 • 10 • 7

speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ

Text Generation • Updated Apr 4, 2024 • 24 • 1

mayflowergmbh/occiglot-7b-de-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 3

mayflowergmbh/occiglot-7b-es-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 14

mayflowergmbh/occiglot-7b-eu5-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 13

mayflowergmbh/occiglot-7b-fr-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 4

mayflowergmbh/occiglot-7b-it-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 4

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation • Updated Apr 15, 2024 • 3 • 1

mayflowergmbh/SauerkrautLM-7b-LaserChat-HQQ

Text Generation • Updated Apr 19, 2024 • 4

mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-HQQ

Text Generation • Updated Apr 26, 2024 • 15

mayflowergmbh/Llama3_DiscoLM_German_8b_v0.1_experimental-HQQ

Text Generation • Updated Apr 26, 2024 • 4

PrunaAI/shenzhi-wang-Llama3-8B-Chinese-Chat-HQQ-4bit-smashed

Text Generation • Updated Mar 29 • 5

PrunaAI/microsoft-Phi-3-mini-4k-instruct-HQQ-4bit-smashed

Text Generation • Updated Apr 4 • 11

PrunaAI/microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed

Text Generation • Updated Apr 4 • 9

webbigdata/C3TR-Adapter_hqq

Translation • Updated May 24, 2024 • 1

aspirina765/Daredevil-8B-abliterated-2bit-HQQ

Text Generation • Updated Jun 9, 2024 • 7 • 3

PrunaAI/Intel-neural-chat-7b-v3-1-HQQ-4bit-smashed

Text Generation • Updated Mar 30 • 4

PrunaAI/meta-llama-Llama-2-7b-chat-hf-HQQ-4bit-smashed

Text Generation • Updated Mar 30 • 9

PrunaAI/openchat-openchat_3.5-HQQ-4bit-smashed

Text Generation • Updated Apr 3 • 26

PrunaAI/01-ai-Yi-6B-HQQ-4bit-smashed

Text Generation • Updated Mar 1 • 14

PrunaAI/mistralai-Mistral-7B-v0.1-HQQ-4bit-smashed

Text Generation • Updated Apr 3 • 3

PrunaAI/microsoft-phi-1_5-HQQ-4bit-smashed

Text Generation • Updated Apr 4 • 9

PrunaAI/microsoft-phi-2-HQQ-4bit-smashed

Text Generation • Updated Apr 3 • 6

PrunaAI/NexaAIDev-Octopus-v2-HQQ-4bit-smashed

Text Generation • Updated Apr 3 • 21

PrunaAI/google-gemma-2-2b-it-HQQ-4bit-smashed

Updated Apr 3 • 1

nm-testing/Llama-3.2-1B-Instruct-HQQ

Updated Oct 30, 2024 • 43

alpindale/magnum-v4-123b-hqq-4bit

Updated Nov 3, 2024 • 1 • 1

PyrTools/Cydonia-22B-v1.2-HQQ-4bit

Updated Nov 3, 2024

fayez-siddiqui/Llama3_8b_HQQ-1bit

Text Generation • Updated Nov 6, 2024 • 7