Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

5,767

Full-text search

Active filters: exl2

GralchemOz/gemma-3-12b-it-exl2-4_25bpw-h6

Updated Mar 15 • 32 • 2

MikeRoz/Qwen3-235B-A22B-exl2

Text Generation • Updated about 14 hours ago • 2

Natkituwu/Erosumika-7B-v3-7.1bpw-exl2

Text Generation • Updated Mar 26, 2024 • 24 • 1

LoneStriker/dolphin-2.9-llama3-70b-5.0bpw-h6-exl2

Text Generation • Updated Apr 25, 2024 • 25 • 3

DeusImperator/Midnight-Miqu-70B-v1.5_exl2_2.4bpw_rpcal

Text Generation • Updated May 19, 2024 • 29 • 1

Zoyd/mlabonne_NeuralDaredevil-8B-abliterated-8_0bpw_exl2

Text Generation • Updated May 28, 2024 • 11 • 2

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 13 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 10 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 10 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 18 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 11 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-3.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-4.0bpw-h6-exl2

Updated Aug 15, 2024 • 9 • 1

LoneStriker/Hermes-3-Llama-3.1-8B-5.0bpw-h6-exl2

Updated Aug 15, 2024 • 7 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-6.0bpw-h6-exl2

Updated Aug 15, 2024 • 5 • 2

LoneStriker/Hermes-3-Llama-3.1-8B-8.0bpw-h8-exl2

Updated Aug 15, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.4bpw-h6-exl2

Updated Aug 15, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-3.5bpw-h6-exl2

Updated Aug 16, 2024 • 7 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.0bpw-h6-exl2

Updated Aug 16, 2024 • 8 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-4.65bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-5.0bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-6.0bpw-h6-exl2

Updated Aug 16, 2024 • 6 • 1

LoneStriker/Hermes-3-Llama-3.1-70B-2.25bpw-h6-exl2

Updated Aug 16, 2024 • 5 • 1

Statuo/NemoMix-Unleashed-EXL2-8bpw

Text Generation • Updated Aug 23, 2024 • 109 • 5

Statuo/NemoMix-Unleashed-EXL2-6bpw

Text Generation • Updated Aug 23, 2024 • 21 • 4

FuturisticVibes/c4ai-command-r-plus-08-2024-6.0bpw-h8-exl2

Text Generation • Updated Sep 7, 2024 • 10 • 1

riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Updated Sep 9, 2024 • 11 • 3

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated Sep 26, 2024 • 79 • 26

NeoChen1024/gemma-2-9B-it-advanced-v2.1-exl2-6.0bpw-h8

Text Generation • Updated Sep 27, 2024 • 13 • 2

NeoChen1024/dolphin-2.9.3-mistral-nemo-12b-exl2-4.5bpw-h8

Updated Oct 3, 2024 • 4 • 1