Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Models

419

Full-text search

Active filters: hqq

PrunaAI/Qwen-Qwen2-7B-HQQ-8bit-smashed

PrunaAI/stabilityai-StableBeluga-7B-HQQ-4bit-smashed

PrunaAI/cognitivecomputations-dolphin-2.0-mistral-7b-HQQ-8bit-smashed

PrunaAI/Qwen-Qwen1.5-0.5B-HQQ-8bit-smashed

PrunaAI/01-ai-Yi-6B-200K-HQQ-8bit-smashed

PrunaAI/LargeWorldModel-LWM-Text-Chat-1M-HQQ-4bit-smashed

PrunaAI/aifeifei798-DarkIdol-Llama-3.1-8B-Instruct-1.2-Uncensored-HQQ-8bit-smashed

PrunaAI/mlabonne-NeuralBeagle14-7B-HQQ-4bit-smashed

PrunaAI/mlabonne-NeuralHermes-2.5-Mistral-7B-HQQ-4bit-smashed

PrunaAI/nvidia-Nemotron-Mini-4B-Instruct-HQQ-8bit-smashed

PrunaAI/mlabonne-Meta-Llama-3.1-8B-Instruct-abliterated-HQQ-4bit-smashed

PrunaAI/Bllossom-llama-3.2-Korean-Bllossom-3B-HQQ-4bit-smashed

Updated Feb 27 • 1

PrunaAI/NexaAIDev-octo-net-HQQ-8bit-smashed

PrunaAI/Salesforce-codegen25-7b-multi_P-HQQ-8bit-smashed

Updated Feb 27 • 2

PrunaAI/NexaAIDev-octo-net-HQQ-4bit-smashed

PrunaAI/ckip-joint-bloom-1b1-zh-HQQ-8bit-smashed

Updated Feb 27 • 1

PrunaAI/Tap-M-Luna-AI-Llama2-Uncensored-HQQ-4bit-smashed

PrunaAI/allenai-Llama-3.1-Tulu-3-8B-HQQ-8bit-smashed

Updated Feb 27 • 1

PrunaAI/Qwen-Qwen2.5-3B-Instruct-HQQ-8bit-smashed

PrunaAI/Qwen-Qwen2.5-3B-Instruct-HQQ-4bit-smashed

PrunaAI/HuggingFaceTB-SmolLM-135M-HQQ-8bit-smashed

PrunaAI/HuggingFaceTB-SmolLM-135M-HQQ-4bit-smashed

PrunaAI/uer-gpt2-chinese-cluecorpussmall-HQQ-4bit-smashed

PrunaAI/arcee-ai-Llama-3.1-SuperNova-Lite-HQQ-8bit-smashed

PrunaAI/arcee-ai-Llama-3.1-SuperNova-Lite-HQQ-4bit-smashed

PrunaAI/microsoft-Phi-4-mini-instruct-HQQ-8bit-smashed

Updated Feb 28 • 7

PrunaAI/NousResearch-Hermes-2-Theta-Llama-3-8B-HQQ-4bit-smashed

PrunaAI/microsoft-Phi-4-mini-instruct-HQQ-4bit-smashed

Updated Feb 28 • 7

PrunaAI/teknium-Mistral-Trismegistus-7B-HQQ-8bit-smashed

PrunaAI/JosephusCheung-Guanaco-HQQ-4bit-smashed