Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

AutoTrain Compatible

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

14,947

Full-text search

Active filters: imatrix

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imatrix

Text Generation • Updated Nov 14, 2024 • 543 • 9

mmnga/umiyuki-Umievo-itr012-Gleipnir-7B-gguf

Updated May 29, 2024 • 2.54k • 7

Lewdiculous/llama-3-Stheno-Mahou-8B-GGUF-IQ-Imatrix

Updated Dec 12, 2024 • 116 • 23

qwp4w3hyb/Codestral-22B-v0.1-iMat-GGUF

Text Generation • Updated Jun 1, 2024 • 345 • 3

Lewdiculous/Fimbulvetr-11B-v2-GGUF-IQ-Imatrix

Updated Oct 2, 2024 • 3.76k • 25

legraphista/dolphin-2.9.2-Phi-3-Medium-abliterated-IMat-GGUF

Text Generation • Updated Jun 3, 2024 • 1.68k • 1

Qwen/Qwen2-72B-Instruct-GGUF

Text Generation • Updated Jun 17, 2024 • 606 • 31

legraphista/Higgs-Llama-3-70B-IMat-GGUF

Text Generation • Updated Jun 6, 2024 • 8.46k • 8

Lewdiculous/Hathor-L3-8B-v.01-GGUF-IQ-Imatrix

Updated Jun 7, 2024 • 122 • 8

mradermacher/Llama-3-Luminurse-v0.2-OAS-8B-i1-GGUF

Updated Feb 7 • 352 • 1

mradermacher/Writing_Partner_Mistral_7B-i1-GGUF

Updated Aug 2, 2024 • 147 • 1

Lewdiculous/llama3-8B-aifeifei-1.3-GGUF-IQ-Imatrix

Updated Jun 12, 2024 • 28 • 4

BLURPLETESTS/Llama3-Toxic-8B-imat-Q5_K_M-GGUF

Updated Jun 14, 2024 • 29 • 1

InferenceIllusionist/L3-70B-Euryale-v2.1-iMat-GGUF

Updated Jun 15, 2024 • 2.07k • 2

DavidAU/Psyonic-Cetacean-Ultra-Quality-20b-GGUF-imat-plus2

Text Generation • Updated Nov 14, 2024 • 383 • 7

mradermacher/Eurstoria-106B-i1-GGUF

Updated Mar 5 • 92 • 1

bartowski/DeepSeek-Coder-V2-Lite-Instruct-GGUF

Text Generation • Updated Jun 20, 2024 • 36.3k • 106

CISCai/DeepSeek-Coder-V2-Lite-Instruct-SOTA-GGUF

Updated Jun 17, 2024 • 377 • 2

mradermacher/DeepSeek-Coder-V2-Lite-Base-i1-GGUF

Updated Aug 2, 2024 • 1.86k • 2

mradermacher/SuperQwen2-7B-Chat-i1-GGUF

Updated Aug 2, 2024 • 111 • 1

mradermacher/Tess-v2.5-Phi-3-medium-128k-14B-i1-GGUF

Updated Feb 21 • 259 • 3

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20, 2024 • 264k • 18

legraphista/glm-4-9b-chat-IMat-GGUF

Text Generation • Updated Jun 20, 2024 • 1.1k • 5

mradermacher/Hathor_Stable-L3-8B-v0.5-i1-GGUF

Updated 15 days ago • 124 • 1

legraphista/RoLlama3-8b-Instruct-IMat-GGUF

Text Generation • Updated Jun 23, 2024 • 732 • 3

DavidAU/Command-R-01-Ultra-NEO-V1-35B-IMATRIX-GGUF

Text Generation • Updated Nov 14, 2024 • 439 • 18

mradermacher/Qwen2-7B-Multilingual-RP-i1-GGUF

Updated Aug 2, 2024 • 711 • 3

DavidAU/TinyLlama-1.1B-Chat-v1.0-Ultra-NEO-V1-Imatrix-GGUF

Text Generation • Updated Nov 14, 2024 • 651 • 1

mradermacher/L3-8B-Lunaris-v1-i1-GGUF

Updated Aug 2, 2024 • 899 • 14

Undi95/MG-FinalMix-72B-GGUF

Updated Jun 26, 2024 • 24 • 2