Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,221

Full-text search

Active filters: quantized

MaziyarPanahi/Phi-4-mini-instruct-GGUF

Text Generation • Updated Mar 1 • 229k • 4

RedHatAI/phi-4-quantized.w4a16

Text Generation • Updated 10 days ago • 877 • 1

GainEnergy/ogai-8x7b-4bit

Text Generation • Updated Mar 5 • 1

MaziyarPanahi/QwQ-32B-GGUF

Text Generation • Updated Mar 7 • 229k • 3

MaziyarPanahi/Qwen-1M-DeepSeek-R1-14B-GGUF

Text Generation • Updated Mar 8 • 174 • 1

MaziyarPanahi/Glowing-Forest-12B-GGUF

Text Generation • Updated Mar 8 • 30 • 1

MaziyarPanahi/gemma-2-2b-fa-v2-GGUF

Text Generation • Updated Mar 9 • 49 • 1

MaziyarPanahi/Llama-3.1-8B-SuperNova-EtherealHermes-GGUF

Text Generation • Updated Mar 11 • 58 • 1

MaziyarPanahi/Peach-2.0-9B-8k-Roleplay-GGUF

Text Generation • Updated Mar 11 • 282 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-32B-GGUF

Text Generation • Updated Mar 11 • 424 • 1

MaziyarPanahi/Deductive-Reasoning-Qwen-14B-GGUF

Text Generation • Updated Mar 11 • 501 • 1

MaziyarPanahi/gemma-3-4b-it-GGUF

Text Generation • Updated Mar 12 • 248k • 6

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 240k • 6

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 239k • 4

MaziyarPanahi/c4ai-command-a-03-2025-GGUF

Text Generation • Updated Mar 15 • 828 • 1

ktoprakucar/bge-m3-custom-fr-Q8-GGUF

Updated Mar 14 • 34 • 1

MaziyarPanahi/OLMo-2-0325-32B-Instruct-GGUF

Text Generation • Updated Mar 15 • 167 • 1

MaziyarPanahi/mistral-small-3.1-24b-instruct-2503-hf-GGUF

Text Generation • Updated Mar 18 • 228k • 2

MaziyarPanahi/ByteCraft-GGUF

Text Generation • Updated Mar 20 • 90 • 1

MaziyarPanahi/AURORAV0.3-4B-GGUF

Text Generation • Updated Mar 23 • 111 • 1

MaziyarPanahi/MN-Hekate-Enodia-12B-GGUF

Text Generation • Updated Mar 23 • 132 • 1

MaziyarPanahi/Malaysian-orpheus-3b-0.1-ft-GGUF

Text Generation • Updated Mar 23 • 110 • 1

MaziyarPanahi/Dirty-Shirley-Writer-v0-abliterated-GGUF

Text Generation • Updated Mar 24 • 289 • 1

MaziyarPanahi/Qwen2.5-7B-sft-ultrachat-SPIN-gpt4o-GGUF

Text Generation • Updated Mar 24 • 274 • 1

MaziyarPanahi/MT-Merge9-gemma-2-9B-GGUF

Text Generation • Updated Mar 24 • 143 • 1

MaziyarPanahi/DeepSeek-V3-0324-GGUF

Text Generation • Updated Mar 25 • 232k • 19

mradermacher/TopicalStorm-Llama3.1-8b-GGUF

Updated Mar 26 • 98 • 2

mradermacher/TopicalStorm-Llama3.1-8b-i1-GGUF

Updated Mar 30 • 774 • 1

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Image-Text-to-Text • Updated about 18 hours ago • 2.72k • 6

JustJaro/gte-multilingual-reranker-base-onnx-op14-opt-gpu-int8

Sentence Similarity • Updated Mar 27 • 18 • 1