-
-
-
-
-
-
Inference Providers
Active filters:
8-bit
meituan/DeepSeek-R1-Block-INT8
Text Generation
•
Updated
•
3.76k
•
36
mlx-community/QwQ-32B-8bit
Text Generation
•
Updated
•
2.12k
•
11
MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF
Text Generation
•
Updated
•
2.61M
•
85
nvidia/Llama-3.3-70B-Instruct-FP4
Updated
•
8.43k
•
11
MaziyarPanahi/gemma-3-1b-it-GGUF
Text Generation
•
Updated
•
174k
•
3
HF1BitLLM/Llama3-8B-1.58-100B-tokens
Text Generation
•
Updated
•
1.5k
•
173
MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation
•
Updated
•
1.13M
•
2
Vikhrmodels/QVikhr-2.5-1.5B-Instruct-SMPO_MLX-8bit
Text Generation
•
Updated
•
281
•
2
neuralmagic/DeepSeek-R1-Distill-Qwen-32B-quantized.w8a8
Text Generation
•
Updated
•
3.8k
•
7
mlx-community/Phi-4-mini-instruct-8bit
Text Generation
•
Updated
•
1.02k
•
2
MaziyarPanahi/gemma-3-4b-it-GGUF
Text Generation
•
Updated
•
171k
•
2
mlx-community/qwq-bakeneko-32b-8bit
Text Generation
•
Updated
•
52
•
2
Norod78/gpt-fluentui-flat-svg
Text Generation
•
Updated
•
249
•
20
CyberNative/CyberBase-13b
Text Generation
•
Updated
•
215
•
27
viai957/CodeLlama_34b-SQL
Text Generation
•
Updated
•
44
•
1
Qwen/Qwen-7B-Chat-Int8
Text Generation
•
Updated
•
384
•
8
Qwen/Qwen-14B-Chat-Int8
Text Generation
•
Updated
•
105
•
6
Qwen/Qwen-1_8B-Chat-Int8
Text Generation
•
Updated
•
143
•
5
Qwen/Qwen-72B-Chat-Int8
Text Generation
•
Updated
•
26
•
17
MaziyarPanahi/SauerkrautLM-7b-HerO-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
•
Updated
•
896
•
2
MaziyarPanahi/Mixtral-8x7B-v0.1-GGUF
Text Generation
•
Updated
•
999
•
1
Qwen/Qwen1.5-72B-Chat-GPTQ-Int8
Text Generation
•
Updated
•
87
•
7
Qwen/Qwen1.5-7B-Chat-GPTQ-Int8
Text Generation
•
Updated
•
129
•
26
Qwen/Qwen1.5-4B-Chat-GPTQ-Int8
Text Generation
•
Updated
•
39
•
5
Qwen/Qwen1.5-1.8B-Chat-GPTQ-Int8
Text Generation
•
Updated
•
60
•
2
Qwen/Qwen1.5-0.5B-Chat-GPTQ-Int8
Text Generation
•
Updated
•
198
•
4
MaziyarPanahi/sqlcoder-7b-2-GGUF
Text Generation
•
Updated
•
298
•
9
MaziyarPanahi/BioMistral-7B-GGUF
Text Generation
•
Updated
•
965
•
52
MaziyarPanahi/LongAlpaca-13B-GGUF
Text Generation
•
Updated
•
282
•
3
MaziyarPanahi/Mistral-7B-Instruct-Aya-101-GGUF
Text Generation
•
Updated
•
1.58k
•
8