Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

4-bit precision

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

255

Full-text search

Active filters: quantization

btaskel/wai-shuffle-noob-v20-GGUF

Text-to-Image • Updated Mar 26 • 22

exxocism/featherless-ai_Qwerky-72B-GGUF

Text Generation • Updated Apr 1 • 28

skatardude10/SnowDrogito-RpR-32B_IQ4-XS

Updated 4 days ago • 185

Uninformed/QwQ-32B-abliterated-exl2-5bpw-h8

Text Generation • Updated 13 days ago • 4

NoorNizar/Llama-3.2-3B-Instruct-WINT8

Text Generation • Updated 10 days ago • 75

NoorNizar/Meta-Llama-3-8B-Instruct-WFP8

Text Generation • Updated 13 days ago • 36

NoorNizar/Meta-Llama-3-8B-Instruct-WINT8

Text Generation • Updated 13 days ago • 40

agoor97/onnx-models

Updated 5 days ago

TechyCode/tinyllama-sciq-lora

Text Generation • Updated 10 days ago

Sumo10/Phi-4-mini-instruct-AWQ-4bit

Updated 8 days ago • 25

Sumo10/Llama-3.2-3B-Instruct-AWQ-4bit

Updated 9 days ago • 6

HatimF/LoL_Build-llama-3B

Text Generation • Updated 1 day ago

NoorNizar/Phi-4-mini-instruct-WINT4

Text Generation • Updated about 14 hours ago

NoorNizar/Meta-Llama-3-8B-Instruct-WINT4

Text Generation • Updated about 14 hours ago

NoorNizar/Llama-3.2-3B-Instruct-WINT4

Text Generation • Updated about 14 hours ago