Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,215

Full-text search

Active filters: quantized

jedisct1/MiMo-7B-RL-GGUF

Updated 1 day ago • 3.36k • 6

RedHatAI/Llama-4-Scout-17B-16E-Instruct-quantized.w4a16

Image-Text-to-Text • Updated 3 days ago • 195 • 4

MaziyarPanahi/WizardLM-2-7B-GGUF

Text Generation • Updated Apr 15, 2024 • 253k • 80

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-FP8-dynamic

Image-Text-to-Text • Updated 15 days ago • 2.71k • 6

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • Updated 8 days ago • 1.12k • 3

MaziyarPanahi/Qwen3-4B-GGUF

Text Generation • Updated 3 days ago • 36.8k • 2

MaziyarPanahi/Qwen3-14B-GGUF

Text Generation • Updated 3 days ago • 36.1k • 2

MaziyarPanahi/Qwen3-32B-GGUF

Text Generation • Updated 3 days ago • 19.1k • 2

NextGenC/erynn-1-774m

Text Generation • Updated 2 days ago • 5 • 2

afrideva/TinyLlama-1.1B-alpaca-chat-v1.5-GGUF

Text Generation • Updated Nov 6, 2023 • 44 • 2

afrideva/GPT-NeoX-1.3B-viet-final-GGUF

Text Generation • Updated Nov 9, 2023 • 166 • 1

afrideva/TinyMistral-248M-GGUF

Text Generation • Updated Dec 11, 2023 • 10.6k • 5

afrideva/TinyLlama-1.1B-Chat-v0.4-GGUF

Text Generation • Updated Nov 16, 2023 • 64 • 4

afrideva/TinyLlama-1.1B-Chat-v0.6-GGUF

Text Generation • Updated Nov 20, 2023 • 141 • 9

afrideva/Tiny-Vicuna-1B-GGUF

Text Generation • Updated Nov 23, 2023 • 255k • 6

afrideva/phi-2-uncensored-GGUF

Text Generation • Updated Dec 21, 2023 • 1.37k • 11

afrideva/Astrea-RP-v1-3B-GGUF

Text Generation • Updated Dec 26, 2023 • 135 • 3

afrideva/Llama-68M-Chat-v1-GGUF

Text Generation • Updated Jan 17, 2024 • 90 • 2

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 75 • 3

MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 29, 2024 • 78 • 2

MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF

Text Generation • Updated Feb 4, 2024 • 117 • 1

MaziyarPanahi/rank_zephyr_7b_v1_full-GGUF

Text Ranking • Updated 29 days ago • 696 • 5

MaziyarPanahi/OPEN-SOLAR-KO-10.7B-GGUF

Text Generation • Updated Feb 4, 2024 • 85 • 1

MaziyarPanahi/miqu-1-70b-sf-GPTQ

Text Generation • Updated Feb 4, 2024 • 8 • 10

MaziyarPanahi/sqlcoder-7b-2-GGUF

Text Generation • Updated Feb 13, 2024 • 379 • 10

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19, 2024 • 1.05k • 51

MaziyarPanahi/gemma-2b-it-GGUF

Text Generation • Updated Feb 27, 2024 • 566 • 10

solidrust/Nous-Hermes-2-Mistral-7B-DPO-AWQ

Text Generation • Updated Sep 3, 2024 • 84 • 8

qualcomm/Stable-Diffusion

Unconditional Image Generation • Updated Apr 30, 2024 • 24

MaziyarPanahi/LongAlpaca-13B-GGUF

Text Generation • Updated Feb 26, 2024 • 279 • 3