Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

Models

1,222

Full-text search

Active filters: compressed-tensors

nintwentydo/pixtral-12b-FP8-dynamic-FP8-KV-cache

Image-Text-to-Text • Updated Jan 6 • 12 • 1

nintwentydo/pixtral-12b-2409-2of4-sparse

Image-Text-to-Text • Updated Jan 5 • 5 • 1

nintwentydo/pixtral-12b-2409-W4A16-G128

Image-Text-to-Text • Updated Jan 5 • 13 • 2

cortecs/phi-4-FP8-Dynamic

Updated Jan 14 • 2.17k • 5

zygi/Qwen2.5-72B-Instruct-abliterated-FP8-Dynamic

Updated Jan 13 • 4 • 1

stan-hua/Qwen2.5-32B-Instruct-LC-SmoothQuant-RTN-W4A16

Updated Jan 17 • 3 • 1

NeoChen1024/Ministral-8B-Instruct-2410-W8A8

Updated Jan 17 • 5 • 1

BigHuggyD/Steelskull_L3.3-MS-Nevoria-70b-FP8-Dynamic

Text Generation • Updated Jan 18 • 54 • 2

zumalabs/DeepSeek-R1-Distill-Qwen-32B-FP8

Updated Jan 20 • 27 • 3

RedHatAI/Llama-3.3-70B-Instruct-quantized.w8a8

Text Generation • Updated Jan 22 • 12.7k • 6

enferAI/DeepSeek-R1-Distill-Qwen-14B-FP8

Text Generation • Updated Jan 21 • 95 • 2

dwetzel/DeepSeek-R1-Distill-Qwen-14B-FP8-Dynamic

Text Generation • Updated Jan 23 • 22 • 1

cortecs/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Updated Jan 23 • 9 • 1

JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-14B-FP8-Dynamic

Text Generation • Updated Jan 29 • 370 • 1

JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-32B-FP8-Dynamic

Text Generation • Updated Jan 29 • 231k • 2

PygmalionAI/Eleusis-12B-FP8

Text Generation • Updated Feb 2 • 66 • 2

JamAndTeaStudios/DeepSeek-R1-Distill-Llama-8B-FP8-Dynamic

Text Generation • Updated Jan 29 • 59 • 1

JamAndTeaStudios/DeepSeek-R1-Distill-Qwen-7B-FP8-Dynamic

Text Generation • Updated Jan 29 • 54 • 1

CharGen/CharGen-v3-beta-269-s0-fp8

Updated Jan 30 • 3 • 1

chutesai/Llama-3.1-Tulu-3-405B-FP8-dynamic

Updated Jan 30 • 3 • 1

RedHatAI/Mistral-Small-24B-Instruct-2501-FP8-dynamic

Text Generation • Updated Jan 31 • 112k • 13

nm-testing/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 1 • 358 • 3

RedHatAI/DeepSeek-R1-Distill-Llama-70B-FP8-dynamic

Text Generation • Updated Feb 27 • 105k • 8

novita/DeepSeek-R1-Distill-Llama-70B-w8a8kv8-s888

Updated Feb 7 • 4 • 2

yeyaowei/L3.3-Damascus-R1-FP8-Dynamic

Updated Feb 6 • 3 • 1

cortecs/Mistral-Small-24B-Instruct-2501-FP8-Dynamic

Updated Feb 3 • 7 • 2

dwetzel/Mistral-Small-24B-Instruct-2501-GPTQ-INT4

Text Generation • Updated Feb 4 • 212 • 2

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • Updated Feb 27 • 695 • 2

dwetzel/DeepSeek-R1-Distill-Qwen-32B-GPTQ-INT4

Text Generation • Updated Feb 4 • 247 • 6

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 544 • 10