Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

38,960

Full-text search

Active filters: bitsandbytes

lakkeo/stable-cypher-instruct-3b

Text Generation • Updated Oct 3, 2024 • 878 • 26

rootxhacker/CodeAstra-7B

Text Generation • Updated Jul 3, 2024 • 373 • 12

cattoroboto/gemma-2-9b-CharacterCodex-qlora

Updated Jul 2, 2024 • 1

mac999/Llama3-8B-BIM

Text Generation • Updated Jul 11, 2024 • 19 • 1

the1ullneversee/Restful-Llama-3-7b

Text Generation • Updated Jul 11, 2024 • 17 • 1

robinhad/UAlpaca-2.0-Mistral-7B

Text Generation • Updated Jul 14, 2024 • 3 • 1

Svngoku/kongostral

Text Generation • Updated Jul 23, 2024 • 8 • 3

meta-llama/Llama-Guard-3-8B-INT8

Text Generation • Updated Aug 7, 2024 • 2.72k • 36

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8, 2024 • 46 • 1

unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit

Text Generation • Updated Feb 15 • 234k • 69

ToastyPigeon/SpringDragon-NeMo-Instruct-QLoRA-ep1

Updated Sep 16, 2024 • 2

ashishkgpian/BioLlama3

Text Generation • Updated Jul 30, 2024 • 13 • 1

HelpMumHQ/MamaBot-Llama

Text Generation • Updated Sep 10, 2024 • 234 • 3

openbmb/MiniCPM-V-2_6-int4

Image-Text-to-Text • Updated Feb 27 • 121k • 79

mlconvexai/jais-13b-chat_bitsandbytes_8bit

Text Generation • Updated Oct 27, 2024 • 25 • 1

Sergei6000/Qwen2-Audio-7B-Instruct-Int4

Updated Aug 10, 2024 • 650 • 6

informatiker/Hermes-3-Llama-3.1-8B-4bit

Updated Aug 15, 2024 • 5 • 2

alicekyting/Qwen2-Audio-7B-Instruct-4bit

Text2Text Generation • Updated Aug 22, 2024 • 1.45k • 6

ms57rd/Llama-3.1-8B-quantized-EEG-TimeLLM

Updated Aug 25, 2024 • 11 • 11

sayakpaul/flux.1-dev-nf4-with-bnb-integration

Updated Sep 1, 2024 • 82 • 17

watsonchua/hansard-gemma-2-9b-lora

Updated Sep 2, 2024 • 1

illuin/llama-3-grouse

Text Generation • Updated Sep 17, 2024 • 5 • 1

Stratos-Kakalis/complete-SPARQL-tuned-mistral

Text Generation • Updated Sep 4, 2024 • 18 • 1

axolotl-quants/DeepSeek-V2.5-bnb-nf4-bf16

Updated Sep 12, 2024 • 213 • 2

Salmamoori/llava-bddx-finetuned

Updated Sep 16, 2024 • 1

sanjaymk/jain_project_custom_llama

Text Generation • Updated Sep 17, 2024 • 9 • 1

ToastyPigeon/Meta-Llama-3.1-8B-Adventure-QLoRA

Updated Sep 19, 2024 • 1

unsloth/Qwen2.5-1.5B-Instruct-bnb-4bit

Text Generation • Updated Feb 6 • 4.88k • 3

unsloth/Qwen2.5-32B-Instruct-bnb-4bit

Text Generation • Updated 5 days ago • 19.5k • 13

nroggendorff/mistral-pro-quantized

Text Generation • Updated Sep 22, 2024 • 15 • 1