Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

4-bit precision

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

104

Full-text search

Active filters: exllamav2

coryg89/Yi-34B-200K-DARE-merge-v7-4bpw-exl2

Text Generation • Updated Mar 17, 2024 • 11

coryg89/Yi-34B-200K-DARE-merge-v7-8bpw-exl2

Text Generation • Updated Mar 17, 2024 • 3

coryg89/Yi-34B-200K-DARE-merge-v7-3bpw-exl2

Text Generation • Updated Mar 18, 2024 • 2

JayhC/Yi-34B-200K-RPMerge-6bpw-h6-exl2

Text Generation • Updated Mar 26, 2024 • 11

matlok/lok-instruct-8b-llm3-exl2-8.0bpw

Text Generation • Updated Apr 20, 2024

Vikhrmodels/it-5.3-fp16-32k-EXL2

Updated Jun 13, 2024 • 1

backyardai/Yi-34B-200K-RPMerge-GGUF

Updated Jul 18, 2024 • 88 • 2

WaveCut/WoonaV1.2-9b-EXL2

Text Generation • Updated Sep 1, 2024 • 2

Anthonyg5005/Llama-Guard-3-1B-exl2

Text Generation • Updated Mar 12

llmixer/ExllamaV2-Control-Vectors

Updated Oct 31, 2024 • 4

mradermacher/Yi-34B-200K-RPMerge-GGUF

Updated Nov 12, 2024 • 138

mradermacher/Yi-34B-200K-RPMerge-i1-GGUF

Updated Nov 12, 2024 • 252

TheMelonGod/Llama-3.1-8B-ArliAI-RPMax-v1.3-exl2

Text Generation • Updated Dec 28, 2024 • 3

TheMelonGod/dolphin-2.9.4-llama3.1-8b-exl2

Text Generation • Updated Dec 28, 2024 • 5

TheMelonGod/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base-exl2

Text Generation • Updated Nov 23, 2024

TheMelonGod/NaturalLM-exl2

Text Generation • Updated Nov 24, 2024

TheMelonGod/dolphin-2.9.3-mistral-7B-32k-exl2

Text Generation • Updated Dec 17, 2024

TheMelonGod/MN-12B-Lyra-v4-exl2

Text Generation • Updated Dec 5, 2024 • 16

TheMelonGod/dolphin-2.9.4-gemma2-2b-exl2

Text Generation • Updated Dec 13, 2024 • 7

TheMelonGod/GRMR-2B-Instruct-exl2

Text Generation • Updated Dec 17, 2024

TheMelonGod/14B-Qwen2.5-Kunou-v1-exl2

Text Generation • Updated Dec 28, 2024 • 2

TheMelonGod/moxin-chat-7b-exl2

Text Generation • Updated Dec 31, 2024

TheMelonGod/moxin-llm-7b-exl2

Text Generation • Updated Dec 28, 2024 • 3

TheMelonGod/Captain-Eris_Twighlight-V0.420-12B-exl2

Text Generation • Updated Dec 31, 2024 • 6

gghfez/jukofyork_creative-writer-32b-preview-exl2-4.5bpw

Text Generation • Updated Dec 29, 2024 • 1

TheMelonGod/Falcon3-7B-Instruct-exl2

Text Generation • Updated Jan 4 • 8

TheMelonGod/Falcon3-1B-Base-exl2

Text Generation • Updated Jan 5 • 2

TheMelonGod/Dolphin3.0-Llama3.1-8B-exl2

Text Generation • Updated Jan 7

TheMelonGod/Dolphin3.0-Qwen2.5-0.5B-exl2

Text Generation • Updated Jan 8 • 7

TheMelonGod/Dolphin3.0-Qwen2.5-1.5B-exl2

Text Generation • Updated Jan 9 • 2