Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

neural-compressor

Inference Endpoints

AutoTrain Compatible

text-generation-inference

8-bit precision

Misc with no match

4-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

56

Full-text search

Active filters: neural-compressor

Intel/distilbert-base-uncased-MRPC-int8-static-inc

Text Classification • Updated Mar 22, 2024 • 5

Intel/albert-base-v2-MRPC-int8-inc

Text Classification • Updated Mar 22, 2024 • 5

Intel/deberta-v3-base-mrpc-int8-static-inc

Text Classification • Updated May 25, 2023 • 6

Intel/deberta-v3-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 6

Intel/whisper-small-int8-dynamic-inc

Automatic Speech Recognition • Updated Jul 7, 2023 • 7

Intel/whisper-small-int8-static-inc

Automatic Speech Recognition • Updated Jul 7, 2023 • 2

Intel/whisper-medium-int8-static-inc

Automatic Speech Recognition • Updated Jul 12, 2023 • 3 • 1

Intel/whisper-medium-int8-dynamic-inc

Automatic Speech Recognition • Updated Jul 12, 2023 • 2

Intel/whisper-tiny-int8-static-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 3

Intel/whisper-tiny-int8-dynamic-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 7 • 2

Intel/whisper-base-int8-static-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 9

Intel/whisper-base-int8-dynamic-inc

Automatic Speech Recognition • Updated Aug 25, 2023 • 4 • 1

Intel/whisper-large-v2-int8-dynamic-inc

Automatic Speech Recognition • Updated Sep 1, 2023 • 5 • 1

Intel/whisper-tiny-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 6 • 6

Intel/whisper-base-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 1 • 9

Intel/whisper-small-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 4 • 2

Intel/whisper-medium-onnx-int4-inc

Automatic Speech Recognition • Updated Oct 16, 2023 • 1 • 1

Intel/table-transformer-int8-static-inc

Updated Dec 27, 2023 • 3

fbaldassarri/meta-llama_Llama-3.2-1B-TEQ-int4-gs128-asym

Text Generation • Updated about 20 hours ago

fbaldassarri/meta-llama_Llama-3.2-1B-TEQ-int4-gs128-sym

Text Generation • Updated about 19 hours ago

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-asym

Text Generation • Updated about 19 hours ago

fbaldassarri/meta-llama_Llama-3.2-1B-Instruct-TEQ-int4-gs128-sym

Text Generation • Updated about 19 hours ago

fbaldassarri/meta-llama_Llama-3.2-3B-TEQ-int4-gs128-asym

Text Generation • Updated about 19 hours ago

fbaldassarri/meta-llama_Llama-3.2-3B-TEQ-int4-gs128-sym

Text Generation • Updated about 18 hours ago

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-asym

Text Generation • Updated about 18 hours ago

fbaldassarri/meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-sym

Text Generation • Updated about 18 hours ago