Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,065

Full-text search

Active filters: 5-bit

ReadyArt/Qwen2.5-QwQ-RP-Draft-v0.2-1.5B_EXL2_5.0bpw_H8

Text Generation • Updated Mar 14

ReadyArt/QwQ-32B-Snowdrop-v0_EXL2_5.0bpw_H8

Text Generation • Updated Mar 14 • 6

LLMJapan/OlympicCoder-7B_exl2_5.0bpw

Text Generation • Updated Mar 15 • 1

ReadyArt/MN-2407-DSK-QwQify-v0.1-12B_EXL2_5.0bpw_H8

Text Generation • Updated Mar 18 • 2

ReadyArt/MS-2501-DPE-QwQify-v0.2-24B_EXL2_5.0bpw_H8

Text Generation • Updated Mar 18 • 4

ReadyArt/Forgotten-Abomination-22B-v4.0_EXL2_5.0bpw_H8

Updated Mar 20 • 2

ReadyArt/Forgotten-Abomination-24B-v4.0_EXL2_5.0bpw_H8

Updated Mar 20 • 4

ReadyArt/Mistral-Small-3.1-24B-Instruct-2503-HF-NOVISION_EXL2_5.0bpw_H8

Text Generation • Updated Mar 19 • 3

SicariusSicariiStuff/Fiendish_LLAMA_3B-5.0bpw

ArtusDev/Skyfall-36B-v2_EXL2_5.0bpw_H8

Text Generation • Updated Mar 20 • 1

MaziyarPanahi/amoral-gemma3-4B-GGUF

Text Generation • Updated Mar 20 • 73

MaziyarPanahi/DeepHermes-3-Llama-3-3B-Preview-abliterated-GGUF

Text Generation • Updated Mar 20 • 92

ArtusDev/Llama-3.3-70B-Vulpecula-r1_EXL2_5.0bpw_H8

Text Generation • Updated Mar 21 • 3

MaziyarPanahi/Ice0.101-20.03-RP-GGUF

Text Generation • Updated Mar 21 • 29

MaziyarPanahi/Qwen2.5-1.5B-YOYO-GGUF

Text Generation • Updated Mar 21 • 24

MaziyarPanahi/Qwen2.5-3B-YOYO-GGUF

Text Generation • Updated Mar 21 • 28

MaziyarPanahi/Qwen2.5-7B-YOYO-GGUF

Text Generation • Updated Mar 21 • 23

MaziyarPanahi/gemma-3-1b-it-abliterated-GGUF

Text Generation • Updated Mar 21 • 49

MaziyarPanahi/Qwen2.5-14B-YOYO-GGUF

Text Generation • Updated Mar 21 • 24

MaziyarPanahi/Qwen2.5-Coder-14B-YOYO-GGUF

Text Generation • Updated Mar 21 • 32

MaziyarPanahi/UnslopNemo-Mag-Mell_T-2-GGUF

Text Generation • Updated Mar 21 • 111

MaziyarPanahi/Glowing-Forest-2-12B-GGUF

Text Generation • Updated Mar 21 • 77

MaziyarPanahi/Qwen2.5-Coder-3B-YOYO-GGUF

Text Generation • Updated Mar 21 • 86

MaziyarPanahi/Qwen2.5-14B-YOYO-V2-GGUF

Text Generation • Updated Mar 21 • 20

MaziyarPanahi/Qwen2.5-14B-YOYO-V5-GGUF

Text Generation • Updated Mar 22 • 127

MaziyarPanahi/Helpingai3-raw-GGUF

Text Generation • Updated Mar 22 • 57

MaziyarPanahi/Community_Request-03-12B-GGUF

Text Generation • Updated Mar 22 • 63

MaziyarPanahi/Community_Request-01-12B-GGUF

Text Generation • Updated Mar 22 • 53

ReadyArt/Abomilectrasafemaster-70B_EXL2_5.0bpw_H8

Text Generation • Updated Mar 23

MaziyarPanahi/Qwen2.5-Taiwan-3B-Reason-SFT-GGUF

Text Generation • Updated Mar 23 • 124