Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

Models

1,222

Full-text search

Active filters: compressed-tensors

BigHuggyD/TheDrummer_Anubis-Pro-105B-v1-FP8-Dynamic

Updated Feb 6 • 70 • 1

saiscorelabsai/phi-4-W8A8-Dynamic-Per-Token-with-Smoothing

Text Generation • Updated Feb 7 • 18 • 1

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16

Text Generation • Updated Feb 27 • 1.25k • 4

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w4a16

Image-Text-to-Text • Updated about 1 month ago • 384 • 3

RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w4a16

Image-Text-to-Text • Updated about 1 month ago • 147 • 2

RedHatAI/Qwen2.5-VL-7B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated 30 days ago • 1.89k • 3

RedHatAI/Qwen2.5-VL-3B-Instruct-quantized.w8a8

Image-Text-to-Text • Updated 2 days ago • 436 • 2

RedHatAI/pixtral-12b-quantized.w8a8

Image-Text-to-Text • Updated Feb 25 • 329 • 1

noneUsername/Mistral-Small-24B-Instruct-2501-W8A8

Updated Feb 18 • 1.31k • 1

EliasOenal/Mistral-Small-24B-Instruct-2501-W8A8-dynamic

Text Generation • Updated Feb 12 • 67 • 2

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W4A16

Text Generation • Updated Feb 14 • 38 • 1

AtlaAI/Selene-1-Mini-Llama-3.1-8B-GPTQ-W8A8

Text Generation • Updated Feb 14 • 21 • 2

ExceedZhang/DeepSeek-R1-Distill-Qwen-32B-W4A16-G128

Updated Feb 15 • 5 • 1

nm-testing/whisper-large-v3.w4a16

Automatic Speech Recognition • Updated Feb 14 • 12 • 1

JKCHSTR/llama-joycaption-alpha-two-hf-llava-FP8-Dynamic

Image-Text-to-Text • Updated Feb 18 • 232 • 1

yeyaowei/L3.3-San-Mai-R1-70b-FP8-Dynamic

Updated Feb 20 • 3 • 1

yeyaowei/L3.3-Cu-Mai-R1-70b-FP8-Dynamic

Updated Feb 20 • 3 • 1

BigHuggyD/LatitudeGames_Wayfarer-Large-70B-Llama-3.3-FP8-Dynamic

Text Generation • Updated Feb 20 • 33 • 1

reinforce20001/SakuraLLM.Sakura-14B-Qwen2.5-v1.0-W8A8-Int8-V2

Updated Feb 22 • 306 • 4

SentientAGI/Dobby-Unhinged-Llama-3.3-70B-W8A8-Dynamic

Updated Feb 24 • 4 • 1

cortecs/r1-1776-distill-llama-70b-FP8-Dynamic

Text Generation • Updated Feb 27 • 12 • 2

RedHatAI/phi-4-quantized.w4a16

Text Generation • Updated 10 days ago • 877 • 1

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8

Updated Mar 4 • 63 • 1

RedHatAI/QwQ-32B-FP8-dynamic

Text Generation • Updated Mar 6 • 3.01k • 8

ig1/QwQ-32B-FP8-Dynamic

Updated Mar 6 • 59 • 1

cortecs/QwQ-32B-FP8-Dynamic

Updated Mar 7 • 100 • 1

ISTA-DASLab/DeepSeek-R1-GPTQ-4b-128g-experts

Text Generation • Updated 25 days ago • 238 • 1

SanXM1/Driftwood-12b-FP8

Updated Mar 8 • 4 • 1

leon-se/gemma-3-12b-it-FP8-Dynamic

Updated 25 days ago • 1.84k • 8

ospatch/QwQ-32B-INT8-W8A8

Text Generation • Updated Mar 13 • 781 • 5