Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

Mixture of Experts

AutoTrain Compatible

Misc with no match

text-generation-inference

text-embeddings-inference

Carbon Emissions

Models

20

Full-text search

Active filters: 16-bit

MaziyarPanahi/Mixtral-8x22B-v0.1-GGUF

Text Generation • Updated Apr 15, 2024 • 229k • 74

MaziyarPanahi/zephyr-orpo-141b-A35b-v0.1-GGUF

Text Generation • Updated Apr 12, 2024 • 9.92k • 29

MaziyarPanahi/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 14, 2024 • 18.8k • 168

MaziyarPanahi/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Apr 23, 2024 • 350k • 89

Green-Sky/bark-ggml

Updated Apr 22, 2024 • 6

ChristianAzinn/mixtral-8x22b-v0.1-imatrix

Text Generation • Updated Apr 12, 2024 • 521

MaziyarPanahi/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 9.44k • 32

impactframes/Mixtral-8x22B-Instruct-v0.1-GGUF

Text Generation • Updated Apr 18, 2024 • 134 • 1

jburmeister/Meta-Llama-3-70B-Instruct-GGUF

Text Generation • Updated May 30, 2024 • 28

MaziyarPanahi/calme-2.1-qwen2-72b-GGUF

Text Generation • Updated Aug 2, 2024 • 266 • 13

ruslanmv/instructLab-granite-7b-lab-text-to-sql

Updated Jul 19, 2024 • 13

MaziyarPanahi/calme-2.2-qwen2-72b-GGUF

Text Generation • Updated Aug 6, 2024 • 80 • 2

jburmeister/Meta-Llama-3-8B-Instruct-GGUF

Text Generation • Updated Aug 22, 2024 • 52

prithivMLmods/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • Updated Nov 12, 2024 • 85 • 2

prithivMLmods/Qwen2.5-Coder-7B-GGUF

Text Generation • Updated Nov 12, 2024 • 141 • 3

prithivMLmods/Qwen2.5-Coder-3B-GGUF

Text Generation • Updated Nov 12, 2024 • 146 • 2

prithivMLmods/Qwen2.5-Coder-1.5B-GGUF

Text Generation • Updated Nov 12, 2024 • 203 • 3

prithivMLmods/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • Updated Nov 18, 2024 • 39 • 3

prithivMLmods/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • Updated Nov 13, 2024 • 43 • 4

prithivMLmods/Llama-3.2-3B-GGUF

Text Generation • Updated Nov 18, 2024 • 97 • 2