Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

compressed-tensors

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Misc with no match

4-bit precision

Models

1,222

Full-text search

Active filters: compressed-tensors

nytopop/Qwen3-4B-abliterated.w8a8

Text Generation • Updated 2 days ago

nytopop/Qwen3-8B-abliterated.w8a8

Text Generation • Updated 2 days ago

nytopop/Qwen3-14B-abliterated.w8a8

Text Generation • Updated 2 days ago • 12

enferAI/Rocinante-12B-v1.1-FP8-dynamic

Updated 3 days ago • 5

nytopop/Qwen3-30B-A3B-abliterated.w4a16

Text Generation • Updated 2 days ago • 12

cognitivecomputations/Qwen3-235B-A22B-FP8-W8A16

Updated 1 day ago

nm-testing/llama2.c-stories110M-FP4

Updated 2 days ago • 33

noneUsername/shisa-v2-mistral-small-24b-W8A8

Updated 1 day ago • 1

noneUsername/shisa-v2-unphi4-14b-W8A8

Updated 1 day ago

RedHatAI/Qwen3-4B-quantized.w4a16

Updated 1 day ago

RedHatAI/Qwen3-32B-FP8_dynamic

Text Generation • Updated about 17 hours ago

RedHatAI/Qwen3-0.6B-FP8_dynamic

Text Generation • Updated about 17 hours ago

RedHatAI/Qwen3-8B-FP8_dynamic

Text Generation • Updated about 17 hours ago

RedHatAI/Qwen3-4B-FP8_dynamic

Text Generation • Updated about 17 hours ago

RedHatAI/Qwen3-14B-FP8_dynamic

Text Generation • Updated about 17 hours ago

RedHatAI/Qwen3-1.7B-FP8_dynamic

Text Generation • Updated about 17 hours ago

RedHatAI/Qwen3-1.7B-quantized.w4a16

Updated about 19 hours ago

RedHatAI/Qwen3-0.6B-quantized.w4a16

Updated about 18 hours ago

NoorNizar/Phi-4-mini-instruct-WINT4

Text Generation • Updated about 12 hours ago

NoorNizar/Meta-Llama-3-8B-Instruct-WINT4

Text Generation • Updated about 12 hours ago

NoorNizar/Llama-3.2-3B-Instruct-WINT4

Text Generation • Updated about 12 hours ago

ai-and-society/mistral-7B-Instruct-v0.3-SQINT8

Text Generation • Updated 8 minutes ago