Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

104

Full-text search

Active filters: exllamav2

TheMelonGod/Dolphin3.0-Qwen2.5-3b-exl2

Text Generation • Updated Jan 10 • 1

TheMelonGod/Falcon3-1B-Instruct-exl2

Text Generation • Updated Jan 14

TheMelonGod/phi-4-exl2

Text Generation • Updated Jan 23 • 46 • 1

TheMelonGod/granite-3.1-8b-base-exl2

Text Generation • Updated Jan 29 • 3

altomek/RE-70B-AS3D-3.5bpw-EXL2

Updated Jan 29 • 1

altomek/RE-70B-AS3D-3.75bpw-EXL2

altomek/RE-70B-AS3D-4bpw-EXL2

altomek/RE-70B-AS3D-3bpw-EXL2

altomek/RE-70B-AS3D-4.25bpw-EXL2

TheMelonGod/granite-3.1-8b-instruct-exl2

Text Generation • Updated Feb 5

altomek/Mistral-Small-24B-Instruct-2501-8bpw-EXL2

Updated Feb 7 • 2

Alissonerdx/exllamav2-0.2.7-cu12.8.0.torch2.7.0-cp312-cp312-linux_x86_64

cgus/granite-3.2-8b-instruct-preview-exl2

Text Generation • Updated Feb 9

cgus/granite-guardian-3.1-8b-exl2

Text Generation • Updated Feb 26 • 2

TheMelonGod/AceInstruct-7B-exl2

Text Generation • Updated Feb 16 • 1

cgus/granite-3.2-2b-instruct-exl2

Text Generation • Updated Feb 26 • 5

cgus/granite-3.2-8b-instruct-exl2

Text Generation • Updated Feb 27 • 4

cgus/granite-guardian-3.2-5b-exl2

Text Generation • Updated Mar 2 • 1

cgus/granite-3.1-8b-Reasoning-exl2

Text Generation • Updated Mar 5 • 3

TheMelonGod/Captain-Eris_Violet-GRPO-v0.420-exl2

Text Generation • Updated Mar 10 • 4

cgus/granite-3.2-8b-instruct-abliterated-exl2

Text Generation • Updated Mar 10 • 5

TheMelonGod/Captain-Eris-BMO_Violent-GRPO-v0.420-exl2

Text Generation • Updated Mar 13 • 1

tokutsu/japanese-answer-13b-8bit

Updated 16 days ago • 17

TheMelonGod/14B-Qwen2.5-Freya-x1-exl2

Text Generation • Updated Mar 16 • 7

TheMelonGod/miscii-14b-0218-exl2

Text Generation • Updated Mar 21 • 5 • 1

cgus/Galactic-Qwen-14B-Exp2-exl2

Text Generation • Updated Mar 18 • 4

TheMelonGod/Qwen2.5-7B-Rebase-exl2

Text Generation • Updated Mar 26

TheMelonGod/lb-reranker-0.5B-v1.0-exl2

Text Generation • Updated 22 days ago

cgus/SAINEMO-reMIX-exl2

Updated 22 days ago • 7

cgus/NekoMix-12B-exl2

Updated 23 days ago • 5