Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

AutoTrain Compatible

text-generation-inference

Inference Endpoints

8-bit precision

Mixture of Experts

text-embeddings-inference

Carbon Emissions

Models

30,737

Full-text search

Active filters: 4-bit

Silence-mj/OPT-6.7B-AWQ-4-128

Text Generation • Updated Nov 23, 2023 • 5

sharkMeow/results-2

Text Generation • Updated Nov 24, 2023

TheBloke/Noromaid-20B-v0.1.1-AWQ

Text Generation • Updated Nov 23, 2023 • 10 • 4

TheBloke/Noromaid-20B-v0.1.1-GPTQ

Text Generation • Updated Nov 23, 2023 • 18 • 8

Mousaicv/selfrag-lora

Text Generation • Updated Nov 23, 2023 • 6 • 1

abc7431/customModel

Text Generation • Updated Nov 23, 2023 • 5

TheBloke/digital-socrates-13B-AWQ

Text Generation • Updated Nov 23, 2023 • 2

TheBloke/digital-socrates-13B-GPTQ

Text Generation • Updated Nov 23, 2023 • 4

TheBloke/digital-socrates-7B-GPTQ

Text Generation • Updated Nov 23, 2023 • 5

TheBloke/digital-socrates-7B-AWQ

Text Generation • Updated Nov 23, 2023

TheBloke/llama-polyglot-13B-GPTQ

Text Generation • Updated Nov 23, 2023 • 7 • 1

TheBloke/llama-polyglot-13B-AWQ

Text Generation • Updated Nov 23, 2023 • 1

TheBloke/koOpenChat-sft-GPTQ

Text Generation • Updated Nov 23, 2023 • 7

TheBloke/koOpenChat-sft-AWQ

Text Generation • Updated Nov 23, 2023 • 18

TheBloke/Synatra-7B-v0.3-dpo-GPTQ

Text Generation • Updated Nov 23, 2023 • 10

TheBloke/Synatra-7B-v0.3-dpo-AWQ

Text Generation • Updated Nov 23, 2023 • 2

TheBloke/Synatra-RP-Orca-2-7B-v0.1-AWQ

Text Generation • Updated Nov 23, 2023

TheBloke/Synatra-RP-Orca-2-7B-v0.1-GPTQ

Text Generation • Updated Nov 23, 2023 • 4 • 2

TheBloke/Yi-34B-Chat-AWQ

Text Generation • Updated Nov 23, 2023 • 14 • 13

TheBloke/Synatra-V0.1-7B-Instruct-GPTQ

Text Generation • Updated Nov 23, 2023 • 12

TheBloke/Synatra-V0.1-7B-Instruct-AWQ

Text Generation • Updated Nov 23, 2023

TheBloke/Yi-34B-Chat-GPTQ

Text Generation • Updated Nov 23, 2023 • 63 • 16

Sk4467/axolotl

Text Generation • Updated Nov 25, 2023

TheBloke/Synatra-7B-v0.3-base-GPTQ

Text Generation • Updated Nov 23, 2023

TheBloke/Synatra-7B-v0.3-base-AWQ

Text Generation • Updated Nov 23, 2023

TheBloke/cockatrice-7B-v0.1-AWQ

Text Generation • Updated Nov 23, 2023 • 4 • 1

TheBloke/Tess-M-v1.2-AWQ

Text Generation • Updated Nov 24, 2023 • 2 • 1

TheBloke/Tess-M-v1.2-GPTQ

Text Generation • Updated Nov 24, 2023 • 7 • 2

TheBloke/tulu-2-13B-GPTQ

Text Generation • Updated Nov 24, 2023 • 4

TheBloke/tulu-2-13B-AWQ

Text Generation • Updated Nov 24, 2023 • 14