Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

AutoTrain Compatible

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

14,947

Full-text search

Active filters: imatrix

bartowski/dolphin-2.9.1-yi-1.5-34b-GGUF

Text Generation • Updated May 20, 2024 • 557 • 5

qwp4w3hyb/Yi-1.5-9B-Chat-16K-iMat-GGUF

Text Generation • Updated May 20, 2024 • 64

bartowski/Yi-1.5-34B-Chat-16K-GGUF

Text Generation • Updated May 20, 2024 • 581 • 6

mradermacher/Deep-Miqu-103B-i1-GGUF

Updated May 24, 2024 • 44 • 1

fluidapp/meta-llama-3-8b-instruct-gguf

Updated Jul 2, 2024 • 1

mradermacher/L3_SnowStorm_4x8B-i1-GGUF

Updated May 24, 2024 • 217 • 4

mradermacher/MAmmoTH2-8x7B-Plus-i1-GGUF

Updated May 24, 2024 • 130

duyntnet/HamSter-0.2-imatrix-GGUF

Text Generation • Updated May 21, 2024 • 54

mradermacher/MAmmoTH2-8x7B-i1-GGUF

Updated May 24, 2024 • 117

duyntnet/TenyxChat-7B-v1-imatrix-GGUF

Text Generation • Updated May 21, 2024 • 80

mradermacher/Llama-3-70Bx2-MOE-i1-GGUF

Updated May 24, 2024 • 36 • 1

shing3232/sakura-14b-qwen2beta-v0.9.2-IMX

Updated May 31, 2024 • 11 • 3

qwp4w3hyb/Phi-3-medium-128k-instruct-iMat-GGUF

Text Generation • Updated May 22, 2024 • 165 • 4

bartowski/Phi-3-medium-4k-instruct-GGUF

Text Generation • Updated Aug 9, 2024 • 2.08k • 37

bartowski/Phi-3-medium-128k-instruct-GGUF

Text Generation • Updated Aug 13, 2024 • 4.03k • 54

InferenceIllusionist/Llama3-ChatQA-1.5-8B-iMat-GGUF

Updated May 23, 2024 • 29

duyntnet/Phi-3-medium-4k-instruct-imatrix-GGUF

Text Generation • Updated May 22, 2024 • 67

mradermacher/HelpingAI-9B-i1-GGUF

Updated Dec 16, 2024 • 218

mradermacher/L3-8B-Stheno-v3.1-i1-GGUF

Updated May 24, 2024 • 125 • 1

mradermacher/FinalFintetuning-XVIII-v1.1-2x8B-i1-GGUF

Updated May 24, 2024 • 384 • 1

hermes42/Phi-3-medium-128k-instruct-imatrix-GGUF

Text Generation • Updated May 22, 2024 • 642 • 1

duyntnet/IceLatteRP-7b-imatrix-GGUF

Text Generation • Updated May 22, 2024 • 84 • 1

Lewdiculous/rogue-enchantress-32k-7B-GGUF-IQ-Imatrix

Updated May 22, 2024 • 61 • 5

SixOpen/Phi-3-mini-4k-instruct-IQ4_NL-imat.gguf

Text Generation • Updated May 22, 2024 • 5

mmnga/Phi-3-medium-128k-instruct-gguf

Updated May 22, 2024 • 1.91k • 5

duyntnet/Phi-SoSerious-Mini-V1-imatrix-GGUF

Text Generation • Updated May 22, 2024 • 90 • 2

mradermacher/Smaug-Llama-3-70B-Instruct-abliterated-v3-i1-GGUF

Updated May 24, 2024 • 178 • 5

hermes42/Mistral-7B-Instruct-v0.3-imatrix-GGUF

Text Generation • Updated May 22, 2024 • 267 • 4

duyntnet/Mistral-7B-Instruct-v0.3-imatrix-GGUF

Text Generation • Updated May 22, 2024 • 133

qwp4w3hyb/Phi-3-medium-4k-instruct-iMat-GGUF

Text Generation • Updated May 23, 2024 • 65