Edit Models filters

Inference Providers

Misc

8-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Carbon Emissions

Models

28,022

Full-text search

Active filters: 8-bit

NeuML/fasttext-quantized

NeuML/glove-6B-quantized

NeuML/word2vec-quantized

mlx-community/Qwen2.5-7B-Instruct-1M-8bit

Text Generation • Updated Jan 26 • 97 • 3

mlx-community/Qwen2.5-14B-Instruct-1M-8bit

Text Generation • Updated Jan 26 • 179 • 7

m-i/Qwen2.5-14B-DeepSeek-R1-1M-Q8-mlx

Updated Jan 27 • 6 • 2

mlx-community/DeepSeek-R1-Distill-Qwen-32B-Japanese-8bit

Text Generation • Updated Jan 27 • 26 • 2

roleplaiapp/DeepSeek-R1-Distill-Qwen-32B-Uncensored-Q8_0-GGUF

Text Generation • Updated Jan 28 • 1.93k • 5

Alissonerdx/YuE-s1-7B-anneal-en-cot-int8

Updated Feb 3 • 137 • 1

Alissonerdx/YuE-s2-1B-general-int8

Updated Feb 3 • 96 • 1

mlx-community/Mistral-Small-24B-Instruct-2501-8bit

Updated Jan 30 • 73 • 3

MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF

Text Generation • Updated Jan 30 • 224k • 3

mlx-community/Virtuoso-Medium-v2-8bit

Text Generation • Updated Jan 31 • 29 • 1

roleplaiapp/DeepSeek-R1-Distill-Llama-70B-Uncensored-v2-Q8_0-GGUF

Text Generation • Updated Jan 31 • 1

Zoont/faster-whisper-large-v3-turbo-int8-ct2

Automatic Speech Recognition • Updated Jan 31 • 131 • 4

MaziyarPanahi/Qwen2.5-Coder-3B-Instruct-abliterated-GGUF

Text Generation • Updated Feb 2 • 132 • 2

roleplaiapp/Janus-Pro-7B-LM-Q8_0-GGUF

Text Generation • Updated Feb 2 • 76 • 1

ReadyArt/L3.3-Damascus-R1_EXl2_8.0bpw_H8

Text Generation • Updated Feb 2 • 16 • 2

BuiDGr8/DeepSeek-R1-Math-114k

Text Generation • Updated Feb 3 • 12 • 1

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w8a8

Text Generation • Updated Feb 27 • 695 • 2

mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 9 • 2

mobiuslabsgmbh/Llama-3.1-8B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 32 • 1

mobiuslabsgmbh/Llama-3.2-3B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 11 • 1

mobiuslabsgmbh/Qwen2.5-7B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 12 • 1

mobiuslabsgmbh/Qwen2.5-14B-Instruct-1M_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 13 • 1

RedHatAI/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8

Text Generation • Updated Feb 27 • 544 • 10

mobiuslabsgmbh/Qwen2.5-7B-Instruct_4bitgs64_hqq_hf

Text Generation • Updated Feb 6 • 35 • 2