Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

2,607

Full-text search

Active filters: 3-bit

MaziyarPanahi/Mistral-Nemo-VICIOUS_MESH-12B-2407-GGUF

Text Generation • Updated Dec 26, 2024 • 162 • 1

MaziyarPanahi/VICIOUS_MESH-12B-OMEGA-GGUF

Text Generation • Updated Dec 26, 2024 • 175 • 1

MaziyarPanahi/VICIOUS_MESH-12B-BETA-GGUF

Text Generation • Updated Dec 26, 2024 • 101 • 1

MaziyarPanahi/Captain_BMO-0.420-Magnum-12B-GGUF

Text Generation • Updated Dec 26, 2024 • 139 • 1

MaziyarPanahi/Captain-Eris_Twighlight-V0.420-12B-GGUF

Text Generation • Updated Dec 28, 2024 • 44 • 1

MaziyarPanahi/LongWriter-Qwen2.5-7B-Instruct-GGUF

Text Generation • Updated Jan 4 • 54 • 1

mlx-community/DeepSeek-V3-3bit

Updated Jan 5 • 163 • 3

MaziyarPanahi/WiNGPT-Babel-GGUF

Text Generation • Updated Jan 5 • 38 • 1

mlx-community/Qwen2.5-Coder-32B-Instruct-abliterated-3bit

Text Generation • Updated Jan 6 • 28 • 1

MaziyarPanahi/Qwen2.5-Coder-0.5B-QwQ-draft-GGUF

Text Generation • Updated Jan 7 • 101 • 3

MaziyarPanahi/phi-4-GGUF

Text Generation • Updated Jan 8 • 235k • 4

mlx-community/DeepSeek-R1-3bit

Updated Feb 26 • 104 • 15

mlx-community/DeepSeek-R1-Distill-Qwen-32B-3bit

Updated Feb 26 • 106 • 4

mlx-community/DeepSeek-R1-Distill-Llama-70B-3bit

Text Generation • Updated Feb 26 • 121 • 4

ReadyArt/L3.3-Nevoria-R1-70b_EXL2_3.0bpw_H8

Text Generation • Updated Jan 26 • 9 • 2

roleplaiapp/Qwen2.5-14B-DeepSeek-R1-1M-Uncensored-Q3_K_L-GGUF

Text Generation • Updated Jan 29 • 15 • 1

mlx-community/Mistral-Small-24B-Instruct-2501-3bit

Updated Jan 30 • 83 • 2

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 224k • 3

roleplaiapp/Mistral-Small-24B-Instruct-2501-Q3_K_M-GGUF

Text Generation • Updated Jan 31 • 18 • 1

MaziyarPanahi/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • Updated Feb 2 • 132 • 2

MaziyarPanahi/Qwen2.5-14B-Instruct-1M-GGUF

Text Generation • Updated Feb 8 • 104 • 2

MaziyarPanahi/Captain-Eris_Violet_Toxic-Magnum-12B-GGUF

Text Generation • Updated Feb 10 • 93 • 1

MaziyarPanahi/DarkIdol-LongWriter-8B-Uncensored-1048k-GGUF

Text Generation • Updated Feb 12 • 109 • 1

MaziyarPanahi/german-r1-GGUF

Text Generation • Updated Feb 12 • 85 • 1

MaziyarPanahi/MT-Merge6-gemma-2-9B-GGUF

Text Generation • Updated Feb 14 • 98 • 1

MaziyarPanahi/To-the-end-of-this-earth-MN-12B-GGUF

Text Generation • Updated Feb 14 • 17 • 1

MaziyarPanahi/UIGEN-7B-16bit-GGUF

Text Generation • Updated Feb 16 • 89 • 1

MaziyarPanahi/Ayla-Light-12B-v2-GGUF

Text Generation • Updated Feb 16 • 83 • 2

MaziyarPanahi/Ayla-Light-12B-Stock-GGUF

Text Generation • Updated Feb 18 • 44 • 1

mlx-community/Wayfarer-Large-70B-Llama-3.3-3bit

Text Generation • Updated Feb 20 • 7 • 1