Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

31,084

Full-text search

Active filters: 4-bit

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-high-rank-cuda-118

Text Generation • Updated Nov 22, 2023 • 4

un-model-runs/prep-coarse-relevancy-meta-llamaLlama-2-7b-hf-1000-ai-00-reddit-train-data-PWiR

Text Generation • Updated Nov 21, 2023 • 2

TheBloke/openinstruct-mistral-7B-AWQ

Text Generation • Updated Nov 26, 2023 • 3

TheBloke/openinstruct-mistral-7B-GPTQ

Text Generation • Updated Nov 26, 2023 • 4 • 3

Chat-Error/Testing_orca

Text Generation • Updated Nov 24, 2023 • 4 • 1

LoftQ/Mistral-7B-v0.1-4bit-64rank

Text Generation • Updated Apr 18, 2024 • 33 • 2

csdc-atl/buffer-baichuan2-13B-rag-4bits

Text Generation • Updated Dec 5, 2023 • 5

flozi00/Mistral-7B-german-assistant-v5-4bit-autogptq

Text Generation • Updated Nov 22, 2023 • 4 • 1

TheBloke/MythoMist-7B-AWQ

Text Generation • Updated Nov 22, 2023 • 7 • 4

TheBloke/MythoMist-7B-GPTQ

Text Generation • Updated Nov 22, 2023 • 85 • 4

TheBloke/Tess-M-v1.1-GPTQ

Text Generation • Updated Nov 22, 2023 • 4 • 1

TheBloke/Tess-M-v1.1-AWQ

Text Generation • Updated Nov 22, 2023 • 15 • 1

01-ai/Yi-6B-Chat-4bits

Text Generation • Updated Nov 11, 2024 • 103 • 22

sharkMeow/results

Updated Nov 25, 2023

TheBloke/OrionStar-Yi-34B-Chat-Llama-GPTQ

Text Generation • Updated Nov 22, 2023 • 12 • 4

TheBloke/OrionStar-Yi-34B-Chat-Llama-AWQ

Text Generation • Updated Nov 22, 2023 • 8 • 3

EnzoVeltri/tableLlama-4bit

Text Generation • Updated Nov 22, 2023 • 2

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy

Text Generation • Updated Nov 23, 2023 • 3

TheBloke/rocket-3B-GPTQ

Text Generation • Updated Nov 22, 2023 • 41

florentgbelidji/leoLM-13b-sft-lora-oa

Text Generation • Updated Nov 23, 2023 • 4 • 1

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-low-rank

Text Generation • Updated Nov 22, 2023 • 8

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-tiny-mixed-real-data-heavy-tiny-rank

Text Generation • Updated Nov 24, 2023 • 2

TheBloke/Tess-XS-Creative-v1.0-GPTQ

Text Generation • Updated Nov 22, 2023 • 9 • 1

TheBloke/Tess-XS-Creative-v1.0-AWQ

Text Generation • Updated Nov 22, 2023 • 4 • 1

TheBloke/Tess-XS-v1.1-GPTQ

Text Generation • Updated Nov 22, 2023 • 4 • 1

TheBloke/Tess-XS-v1.1-AWQ

Text Generation • Updated Nov 22, 2023 • 4 • 1

TheBloke/Chupacabra-7B-v2-AWQ

Text Generation • Updated Nov 23, 2023 • 4 • 1

TheBloke/Chupacabra-7B-v2-GPTQ

Text Generation • Updated Nov 23, 2023 • 4 • 1

TheBloke/Ferret_7B-GPTQ

Text Generation • Updated Nov 23, 2023 • 4 • 2

TheBloke/Ferret_7B-AWQ

Text Generation • Updated Nov 23, 2023 • 4 • 1