Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

8-bit precision

4-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

616

Full-text search

Active filters: vllm

mistralai/Mistral-Small-3.1-24B-Instruct-2503

Image-Text-to-Text • Updated 22 days ago • 78.1k • • 1.18k

mistralai/Mistral-Small-24B-Instruct-2501

Text Generation • Updated Feb 2 • 890k • • 904

mistralai/Mistral-Small-3.1-24B-Base-2503

Updated Mar 19 • 6.37k • 207

unsloth/Mistral-Small-3.1-24B-Instruct-2503-GGUF

Updated 6 days ago • 12.6k • 31

mistralai/Ministral-8B-Instruct-2410

Updated Dec 6, 2024 • 67.2k • 484

NousResearch/DeepHermes-3-Llama-3-8B-Preview

Text Generation • Updated 20 days ago • 48k • 316

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q6_K-GGUF

Image-Text-to-Text • Updated Mar 30 • 5.78k • 6

mistralai/Pixtral-12B-2409

Image-Text-to-Text • Updated Dec 26, 2024 • • 631

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q8_0-GGUF

Image-Text-to-Text • Updated Mar 30 • 3.07k • 6

openfree/Mistral-Small-3.1-24B-Instruct-2503-Q4_K_M-GGUF

Image-Text-to-Text • Updated Mar 30 • 2.77k • 6

mistralai/Mistral-Large-Instruct-2407

Updated Oct 16, 2024 • 7.56k • 829

mistralai/Pixtral-12B-Base-2409

Updated Feb 2 • 98

mistralai/Mistral-Large-Instruct-2411

Updated Nov 19, 2024 • 5.27k • 217

mistralai/Mistral-Small-24B-Base-2501

Text Generation • Updated Jan 30 • 11.5k • 244

Karsh-CAI/Mistral-Small-24B-Instruct-2501-Q8_0-GGUF

Updated Jan 30 • 37 • 2

RedHatAI/QwQ-32B-FP8-dynamic

Text Generation • Updated Mar 6 • 3.15k • 8

VinkuraAI/KunoRZN-Llama-3-3B

Text Generation • Updated 14 days ago • 9.41k • 4

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8

Image-Text-to-Text • Updated 6 days ago • 957 • 3

RedHatAI/DeepSeek-R1-quantized.w4a16

Text Generation • Updated 8 days ago • 119 • 4

RedHatAI/Meta-Llama-3-8B-Instruct-FP8-KV

Text Generation • Updated Jun 19, 2024 • 3.33k • 8

RedHatAI/Meta-Llama-3.1-70B-Instruct-FP8

Text Generation • Updated Mar 25 • 23.5k • 45

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 8.31k • 16

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16

Text Generation • Updated Dec 17, 2024 • 152k • 27

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w8a8

Text Generation • Updated Feb 11 • 30.7k • 20

RedHatAI/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated Oct 23, 2024 • 486 • 4

bprice9/Palmyra-Medical-70B-FP8

Text Generation • Updated Aug 21, 2024 • 5 • 1

RedHatAI/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9, 2024 • 154 • 1

mistralai/Mistral-Small-Instruct-2409

Updated Oct 16, 2024 • 6.58k • 384

mlx-community/Ministral-8B-Instruct-2410-4bit

Updated Oct 17, 2024 • 250 • 8

mistralai/Pixtral-Large-Instruct-2411

Image-Text-to-Text • Updated Mar 16 • 410