Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

arxiv: 2311.16502

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

199

Full-text search

Active filters: 2311.16502

unsloth/gemma-3-12b-it-qat-int4-GGUF

Image-Text-to-Text • Updated 14 days ago • 2.46k • 3

unsloth/gemma-3-4b-it-qat

Image-Text-to-Text • Updated 12 days ago • 609 • 1

unsloth/gemma-3-4b-it-qat-GGUF

Image-Text-to-Text • Updated 10 days ago • 4.7k • 4

unsloth/gemma-3-27b-it-qat-bnb-4bit

Image-Text-to-Text • Updated 12 days ago • 192 • 2

01-ai/Yi-6B

Text Generation • Updated Nov 11, 2024 • 17.7k • 371

01-ai/Yi-34B-200K

Text Generation • Updated Nov 11, 2024 • 40.8k • 317

01-ai/Yi-6B-200K

Text Generation • Updated Nov 11, 2024 • 5.6k • 172

LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 2

LoneStriker/Yi-6B-200K-4.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 2

LoneStriker/Yi-6B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 2

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 12 • 1

LoneStriker/Yi-6B-200K-8.0bpw-h8-exl2

Text Generation • Updated Mar 16, 2024 • 12 • 1

01-ai/Yi-34B-Chat-8bits

Text Generation • Updated Nov 11, 2024 • 86 • 28

01-ai/Yi-34B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 28 • 60

01-ai/Yi-6B-Chat-8bits

Text Generation • Updated Nov 11, 2024 • 42 • 9

01-ai/Yi-6B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 103 • 22

nold/Yi-34B-200K-GGUF

Text Generation • Updated Mar 9, 2024 • 26 • 1

cgus/Yi-9B-exl2

Text Generation • Updated Jun 24, 2024 • 4

TechxGenus/Yi-9B-AWQ

Text Generation • Updated Jun 27, 2024 • 5

TechxGenus/Yi-9B-GPTQ

Text Generation • Updated Jun 25, 2024 • 13

jmoney54378256438905/Yi-34B-200K-MAR2024-exl2-5bpw

Text Generation • Updated Mar 13, 2024 • 2

jmoney54378256438905/Yi-34B-200K-MAR2024-exl2-4bpw

Text Generation • Updated Mar 13, 2024 • 7 • 1

jmoney54378256438905/Yi-34B-200K-MAR2024-exl2-3.5bpw

Text Generation • Updated Mar 13, 2024 • 16

01-ai/Yi-9B-200K

Text Generation • Updated Nov 11, 2024 • 5.34k • 75

LoneStriker/Yi-9B-200K-GGUF

Text Generation • Updated Mar 16, 2024 • 39 • 8

LoneStriker/Yi-9B-200K-3.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 5 • 1

LoneStriker/Yi-9B-200K-4.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 2

LoneStriker/Yi-9B-200K-5.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 12

LoneStriker/Yi-9B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16, 2024 • 4 • 1

LoneStriker/Yi-9B-200K-8.0bpw-h8-exl2

Text Generation • Updated Mar 16, 2024 • 10