Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

8-bit precision

4-bit precision

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

Mixture of Experts

Carbon Emissions

Models

38,907

Full-text search

Active filters: bitsandbytes

fantos/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 20 • 175 • 6

unsloth/Qwen3-30B-A3B-bnb-4bit

Updated about 14 hours ago • 3.68k • 5

unsloth/Qwen3-32B-bnb-4bit

Updated about 21 hours ago • 751 • 4

unsloth/Qwen3-0.6B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 1.74k • 4

unsloth/Phi-4-mini-reasoning-unsloth-bnb-4bit

Text Generation • Updated 2 days ago • 337 • 4

unsloth/gemma-3-4b-it-unsloth-bnb-4bit

Image-Text-to-Text • Updated 8 days ago • 282k • 14

unsloth/Qwen3-32B-unsloth-bnb-4bit

Text Generation • Updated about 21 hours ago • 1.39k • 3

onekq-ai/QwQ-32B-bnb-4bit

Text Generation • Updated Mar 5 • 153 • 2

infinitestack/tinyllama-sugarcane

Updated Mar 24 • 64 • 3

unsloth/Qwen2.5-VL-32B-Instruct-unsloth-bnb-4bit

Image-Text-to-Text • Updated Mar 27 • 5.73k • 9

unsloth/GLM-4-32B-0414-unsloth-bnb-4bit

Text Generation • Updated 2 days ago • 190 • 2

unsloth/GLM-4-32B-0414-bnb-4bit

Text Generation • Updated 2 days ago • 124 • 2

unsloth/gemma-3-27b-it-qat-bnb-4bit

Image-Text-to-Text • Updated 8 days ago • 123 • 2

unsloth/Qwen3-4B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 3.55k • 2

unsloth/Qwen3-1.7B-unsloth-bnb-4bit

Text Generation • Updated 4 days ago • 922 • 2

CyberNative/CyberBase-13b

Text Generation • Updated May 16, 2024 • 45 • 29

asas-ai/jais_13B_8bit

Text Generation • Updated Oct 25, 2023 • 81 • 9

viai957/CodeLlama_34b-SQL

Text Generation • Updated May 4, 2024 • 59 • 1

KnutJaegersberg/nllb-moe-54b-4bit

Translation • Updated Dec 16, 2023 • 78 • 5

Flurin17/whisper-large-v3-peft-swiss-german

Updated Feb 26, 2024 • 396 • 5

herisan/Mistral-7b-bnb-4bit_mental_health_counseling_conversations

Text Generation • Updated Jan 13, 2024 • 79 • 2

rahuldshetty/tinyllama-python

Text Generation • Updated Jan 19, 2024 • 53 • 2

AISimplyExplained/Vakil-7B

Text Generation • Updated Jan 23, 2024 • 144 • 3

alnrg2arg/blockchainlabs_7B_merged_test2_4_prune_sft_4bit_DPO_orca

Text Generation • Updated Jan 26, 2024 • 23 • 2

erfanvaredi/jais-7b-chat

Text Generation • Updated Feb 22, 2024 • 101 • 5

Tann-dev/sex-chat-dirty-girlfriend

Text Generation • Updated Feb 17, 2024 • 660 • 36

pavankumarbalijepalli/phi2-nl2sql-lora

Text Generation • Updated Feb 28 • 53 • 1

Lightricks/T5-XXL-8bit

Updated Feb 29, 2024 • 87 • 7

datatab/Yugo55A-4bit

Text Generation • Updated Oct 1, 2024 • 54 • 1

Sahi19/Gemma2bLegalChatbot

Text Generation • Updated Mar 25, 2024 • 1