Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

31,083

Full-text search

Active filters: 4-bit

TheBloke/Free_Sydney_V2_Mistral_7b-AWQ

Text Generation • Updated Nov 20, 2023 • 5 • 1

TheBloke/Generate_Question_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 16 • 2

TheBloke/Free_Sydney_V2_Mistral_7b-GPTQ

Text Generation • Updated Nov 20, 2023 • 5 • 1

TheBloke/Writing_Partner_Mistral_7B-AWQ

Text Generation • Updated Nov 20, 2023 • 5

TheBloke/Generate_Question_Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 21 • 3

TheBloke/Writing_Partner_Mistral_7B-GPTQ

Text Generation • Updated Nov 20, 2023 • 9

TheBloke/llama2_7b_merge_orcafamily-AWQ

Text Generation • Updated Nov 20, 2023 • 4

TheBloke/llama2_7b_merge_orcafamily-GPTQ

Text Generation • Updated Nov 20, 2023 • 2

TheBloke/mistral_7b_norobots-GPTQ

Updated Nov 20, 2023

TheBloke/mistral_7b_norobots-AWQ

Updated Nov 20, 2023

TheBloke/zephyr_7b_norobots-AWQ

Updated Nov 20, 2023 • 1

TheBloke/zephyr_7b_norobots-GPTQ

Updated Nov 20, 2023 • 1

gustavovm/neural-chat-7b-pt-br-quant

Text Generation • Updated Nov 20, 2023 • 2

TheBloke/Yarn-Llama-2-70B-32k-AWQ

Text Generation • Updated Nov 21, 2023 • 5 • 2

TheBloke/Yarn-Llama-2-70B-32k-GPTQ

Text Generation • Updated Nov 21, 2023 • 5

LoftQ/Llama-2-7b-hf-4bit-64rank

Text Generation • Updated May 3, 2024 • 289 • 1

TheBloke/Orca-2-13B-GPTQ

Text Generation • Updated Nov 21, 2023 • 10 • 27

TheBloke/Orca-2-7B-AWQ

Text Generation • Updated Nov 21, 2023 • 4 • 1

TheBloke/Orca-2-13B-AWQ

Text Generation • Updated Nov 21, 2023 • 16 • 7

TheBloke/Orca-2-7B-GPTQ

Text Generation • Updated Nov 21, 2023 • 14 • 4

TheBloke/Qwen-7B-Chat-GPTQ

Text Generation • Updated Nov 21, 2023 • 256 • 2

TheBloke/Qwen-14B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 82 • 11

marcchew/TinyLLaMA-1.1B-OrcaPlatty-GPTQ-4bit

Text Generation • Updated Nov 21, 2023 • 4

Eichhof/Llama-2-13b-chat-hf-Einstein-GPTQ-C4

Text Generation • Updated Dec 3, 2023

cshulby/phi_1_5_KelmTiny

Text Generation • Updated Nov 21, 2023 • 3

BradClem/chess-chat-1.0-3b-Q4

Text Generation • Updated Nov 21, 2023 • 7

un-model-runs/prep-coarse-relevancy-meta-llamaLlama-2-7b-hf-1000-ai-00-reddit-train-data-IO5B

Text Generation • Updated Nov 21, 2023 • 2

TheBloke/gorilla-openfunctions-v1-AWQ

Text Generation • Updated Nov 21, 2023 • 5

TheBloke/gorilla-openfunctions-v1-GPTQ

Text Generation • Updated Nov 21, 2023 • 10 • 5

un-model-runs/coarse-relevancy-multi-label-llama-2-7B-4k-all-data-high-rank-cuda-118

Text Generation • Updated Nov 22, 2023 • 4