Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

13

Full-text search

Active filters: 3.5-bit

ReadyArt/Abomilectrasafemaster-70B_EXL2_3.5bpw_H8

Text Generation • Updated Mar 23 • 3

ReadyArt/Legion-V2.2-LLaMa-70B_EXL2_3.5bpw_H8

Text Generation • Updated Mar 25 • 4

ReadyArt/Llama_3.x_70b_Hexagon_Purple_V2_EXL2_3.5bpw_H8

Text Generation • Updated Mar 26 • 3

ReadyArt/Scrivener-Base-V3-LLaMA-70B_EXL2_3.5bpw_H8

Text Generation • Updated Mar 27 • 4

ReadyArt/Anathema-V2-LLaMA-70B_EXL2_3.5bpw_H8

Text Generation • Updated Mar 27 • 4

Mawdistical/Feline-Clairvoyance-72B_EXL2_3.5bpw_H8

ReadyArt/Forgotten-Abomination-70B-v5.0_EXL2_3.5bpw_H8

Text Generation • Updated Mar 30 • 2

Mawdistical/Wanton-Wolf-70B_EXL2_3.5bpw_H8

Updated Mar 30 • 1

ReadyArt/Gaslight-24B-v1.0_EXL2_3.5bpw_H8

Text Generation • Updated Apr 2 • 2

ReadyArt/Gaslit-Transgression-24B-v1.0_EXL2_3.5bpw_H8

Text Generation • Updated Apr 2 • 2

Mawdistical/Draconic-Tease-70B_EXL2_3.5bpw_H8

Updated Apr 7 • 2

Mawdistical/Vulpine-Seduction-70B_EXL2_3.5bpw_H8

Updated Apr 9 • 3

ReadyArt/Retrograde-Omega-M-22B-v1.0_EXL2_3.5bpw_H8

Text Generation • Updated Apr 10 • 4