Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

386

Full-text search

Active filters: hqq

mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 50 • 2

mobiuslabsgmbh/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 232 • 1

mobiuslabsgmbh/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 36 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 28 • 1

mobiuslabsgmbh/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 28 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 63 • 2

PrunaAI/facebook-MobileLLM-125M-HQQ-4bit-smashed

Updated 30 days ago • 9 • 1

PrunaAI/teknium-OpenHermes-2.5-Mistral-7B-HQQ-8bit-smashed

Updated 6 days ago • 3 • 1

mlabonne/AlphaMonarch-7B-2bit-HQQ

Text Generation • Updated Mar 28, 2024 • 11 • 7

speakleash/Bielik-7B-Instruct-v0.1-3bit-HQQ

Text Generation • Updated Apr 4, 2024 • 18 • 1

mayflowergmbh/occiglot-7b-de-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 4

mayflowergmbh/occiglot-7b-es-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 4

mayflowergmbh/occiglot-7b-eu5-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 4

mayflowergmbh/occiglot-7b-fr-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 6

mayflowergmbh/occiglot-7b-it-en-instruct-HQQ

Text Generation • Updated Apr 7, 2024 • 8

Chronal/Noromaid-v0.4-Mixtral-Instruct-8x7b-Zloss_attn-4bit-moe-2bit-metaoffload-HQQ

Text Generation • Updated Apr 15, 2024 • 5 • 1

mayflowergmbh/SauerkrautLM-7b-LaserChat-HQQ

Text Generation • Updated Apr 19, 2024 • 7

mayflowergmbh/Llama-3-SauerkrautLM-8b-Instruct-HQQ

Text Generation • Updated Apr 26, 2024 • 5

mayflowergmbh/Llama3_DiscoLM_German_8b_v0.1_experimental-HQQ

Text Generation • Updated Apr 26, 2024 • 4

PrunaAI/shenzhi-wang-Llama3-8B-Chinese-Chat-HQQ-4bit-smashed

Text Generation • Updated 27 days ago • 33

PrunaAI/microsoft-Phi-3-mini-4k-instruct-HQQ-4bit-smashed

Text Generation • Updated 6 days ago • 7

PrunaAI/microsoft-Phi-3-mini-128k-instruct-HQQ-4bit-smashed

Text Generation • Updated 6 days ago • 21

webbigdata/C3TR-Adapter_hqq

Translation • Updated May 24, 2024 • 9

aspirina765/Daredevil-8B-abliterated-2bit-HQQ

Text Generation • Updated Jun 9, 2024 • 10 • 3

PrunaAI/meta-llama-Llama-2-7b-chat-hf-HQQ-4bit-smashed

Text Generation • Updated 6 days ago • 10

PrunaAI/01-ai-Yi-6B-HQQ-4bit-smashed

Text Generation • Updated 27 days ago • 28

PrunaAI/mistralai-Mistral-7B-v0.1-HQQ-4bit-smashed

Text Generation • Updated 3 days ago • 10

PrunaAI/NexaAIDev-Octopus-v2-HQQ-4bit-smashed

Text Generation • Updated 2 days ago • 6

PrunaAI/google-gemma-2-2b-it-HQQ-4bit-smashed

Updated Feb 21 • 8

nm-testing/Llama-3.2-1B-Instruct-HQQ

Updated Oct 30, 2024 • 11