-
-
-
-
-
-
Inference Providers
Active filters:
fp8
anyisalin/lzlv_70b_fp16_hf-FP8-D
Text Generation
•
Updated
•
12
anyisalin/Meta-Llama-3-70B-Instruct-FP8-D
Text Generation
•
Updated
•
12
anyisalin/Mixtral-8x7B-Instruct-v0.1-FP8-D
Text Generation
•
Updated
•
6
nm-testing/llama-3-instruct-fp8-static-shared-scales
Text Generation
•
Updated
•
7
nm-testing/llama-3-instruct-fp8-dynamic-shared-scales
Text Generation
•
Updated
•
11
pcmoritz/Mixtral-8x7B-v0.1-fp8-act-scale
Text Generation
•
Updated
•
5
anyisalin/Meta-Llama-3-70B-Instruct-FP8
Text Generation
•
Updated
•
9
comaniac/Meta-Llama-3-8B-Instruct-FP8-v1
Text Generation
•
Updated
•
8
comaniac/Mixtral-8x22B-Instruct-v0.1-FP8-v1
Text Generation
•
Updated
•
8
neuralmagic/Meta-Llama-3-70B-Instruct-FP8
Text Generation
•
Updated
•
40.3k
•
11
comaniac/Meta-Llama-3-70B-Instruct-FP8-v1
Text Generation
•
Updated
•
11
comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v1
Text Generation
•
Updated
•
8
comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v2
Text Generation
•
Updated
•
8
Skywork/Skywork-MoE-Base-FP8
Text Generation
•
Updated
•
9
•
6
comaniac/Meta-Llama-3-70B-Instruct-FP8-v2
Text Generation
•
Updated
•
14
comaniac/Mixtral-8x7B-Instruct-v0.1-FP8-v3
Text Generation
•
Updated
•
12
comaniac/Mixtral-8x22B-Instruct-v0.1-FP8-v2
Text Generation
•
Updated
•
6
neuralmagic/Mixtral-8x22B-Instruct-v0.1-AutoFP8
Text Generation
•
Updated
•
297
•
3
nm-testing/granite-20b-code-base-FP8
Text Generation
•
Updated
•
7
nm-testing/granite-3b-code-base-FP8
Text Generation
•
Updated
•
6
fr00000/dolp-fp8
Text Generation
•
Updated
•
9
nm-testing/opt-125m-fp8-static-kv
Text Generation
•
Updated
•
8
neuralmagic/Qwen2-1.5B-Instruct-FP8
Text Generation
•
Updated
•
5.46k
neuralmagic/Qwen2-7B-Instruct-FP8
Text Generation
•
Updated
•
5.21k
•
1
anyisalin/L3-70B-Euryale-v2.1-FP8
Text Generation
•
Updated
•
7
nm-testing/Qwen2-0.5B-Instruct-FP8-KV
Text Generation
•
Updated
•
6
yentinglin/Llama-3-Taiwan-70B-Instruct-FP8
Text Generation
•
Updated
•
17
kuotient/llama3-instrucTrans-enko-8b-FP8
Text Generation
•
Updated
•
11
•
2
nm-testing/SparseLlama-3-8B-pruned_50.2of4-FP8
Text Generation
•
Updated
•
20
FlorianJc/Hermes-2-Pro-Mistral-7B-vllm-fp8
Text Generation
•
Updated
•
110