Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Misc with no match

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

7

Full-text search

Active filters: QUiP

keyfan/Mixtral-8x7B-Instruct-2bit

Text Generation • Updated Dec 31, 2023 • 6 • 4

keyfan/Qwen-72B-Chat-2bit

Text Generation • Updated Jan 7, 2024 • 10 • 7

keyfan/Qwen1.5-72B-Chat-2bit

Text Generation • Updated Mar 20, 2024 • 3

Minami-su/Qwen1.5-32B-Chat-quip-3bit

Text Generation • Updated Jun 10, 2024 • 5 • 1

kharinaev/Mistral-7B-Instruct-v0.2-quip-sharp-4bit

Updated Aug 13, 2024

kharinaev/Llama-3.1-8B-Instruct-quip-sharp-2bit

Updated Sep 8, 2024 • 1

kharinaev/Mistral-7B-Instruct-v0.2-quip-sharp-2bit

Updated Sep 8, 2024