Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

30,636

Full-text search

Active filters: 4-bit

TheBloke/Venus-120b-v1.0-AWQ

Text Generation • Updated Nov 29, 2023 • 11 • 2

unsloth/llama-2-7b-bnb-4bit

Text Generation • Updated Sep 3, 2024 • 74.9k • 10

Sujan42024/dlite-v2-355m-bi4tQuantization

Text Generation • Updated Nov 29, 2023

TheBloke/psyonic-cetacean-20B-AWQ

Text Generation • Updated Nov 29, 2023 • 8

Ferrxni/finetuned_gw_mistral_GPTQ

Updated Nov 29, 2023

TheBloke/Open-Hermes-2.5-neural-chat-3.1-frankenmerge-11b-GPTQ

Text Generation • Updated Nov 30, 2023 • 3 • 1

TheBloke/psyonic-cetacean-20B-GPTQ

Text Generation • Updated Nov 29, 2023 • 6

TheBloke/SauerkrautLM-7B-HerO-GPTQ

Text Generation • Updated Nov 29, 2023 • 5 • 1

TheBloke/tigerbot-70B-chat-v2-AWQ

Text Generation • Updated Nov 30, 2023 • 2 • 2

TheBloke/deepseek-llm-67b-chat-AWQ

Text Generation • Updated Nov 29, 2023 • 136 • 4

NobodyExistsOnTheInternet/mistral-7b-airoboros-chatml

Updated Dec 1, 2023

TheBloke/Iambe-20B-DARE-AWQ

Text Generation • Updated Nov 29, 2023 • 2 • 1

nicher92/ai_sweden_356-4bit-gptq

Text Generation • Updated Nov 29, 2023 • 5

vachonni/falcon-1b-tech-level-fr

Text Generation • Updated Nov 29, 2023 • 5

TheBloke/deepseek-llm-67b-base-AWQ

Text Generation • Updated Nov 29, 2023 • 25 • 2

TheBloke/deepseek-llm-67b-base-GPTQ

Text Generation • Updated Nov 29, 2023 • 9 • 1

TheBloke/LLaMA2-13B-Psyfighter2-AWQ

Text Generation • Updated Nov 30, 2023 • 41 • 4

TheBloke/Iambe-20B-DARE-GPTQ

Text Generation • Updated Nov 29, 2023 • 6 • 1

TheBloke/NeuralHermes-2.5-Mistral-7B-AWQ

Text Generation • Updated Nov 30, 2023 • 5 • 7

TheBloke/deepseek-llm-7B-base-GPTQ

Text Generation • Updated Nov 29, 2023 • 753 • 2

TheBloke/open-llama-3b-v2-wizard-evol-instuct-v2-196k-GPTQ

Text Generation • Updated Nov 30, 2023 • 878 • 2

TheBloke/LLaMA2-13B-Psyfighter2-GPTQ

Text Generation • Updated Nov 30, 2023 • 43 • 16

TheBloke/NeuralHermes-2.5-Mistral-7B-GPTQ

Text Generation • Updated Nov 30, 2023 • 14 • 8

TheBloke/SG-Raccoon-Yi-55B-GPTQ

Text Generation • Updated Nov 30, 2023 • 7 • 1

TheBloke/SG-Raccoon-Yi-55B-AWQ

Text Generation • Updated Nov 30, 2023 • 2 • 2

TheBloke/tigerbot-70B-chat-v2-GPTQ

Text Generation • Updated Nov 30, 2023 • 2 • 5

vivid-studios/step.one-mistral-7b

Text Generation • Updated Dec 2, 2023 • 17

mhenrichsen/context-aware-splitter-mistral-eng

Text Generation • Updated Nov 30, 2023 • 2 • 9

TheBloke/Chronomaid-Storytelling-13B-GPTQ

Text Generation • Updated Dec 4, 2023 • 30 • 8

TheBloke/Chronomaid-Storytelling-13B-AWQ

Text Generation • Updated Dec 4, 2023 • 30 • 4