GPTQ Quants - a thesven Collection

thesven 's Collections

GPTQ Quants

updated Sep 13, 2024

thesven/Mistral-7B-Instruct-v0.3-GPTQ

Text Generation • Updated Sep 11, 2024 • 4.79k • 1
thesven/Phi-3.5-mini-instruct-GPTQ-4bit

Text Generation • Updated Aug 29, 2024 • 172
thesven/Phi-nut-Butter-Codebagel-v1-GPTQ

Text Generation • Updated May 26, 2024 • 8
thesven/Aether-Qwen2-0.5B-SFT-v0.0.2-GPTQ

Text Generation • Updated Jun 13, 2024 • 14
thesven/microsoft_WizardLM-2-7B-GPTQ

Text Generation • Updated May 25, 2024 • 5
thesven/prometheus-7b-v2.0-GPTQ

Text2Text Generation • Updated May 31, 2024 • 8
thesven/Meta-Llama-3.1-8B-Instruct-GPTQ

Text Generation • Updated Jul 23, 2024 • 34
thesven/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 16, 2024 • 5
thesven/Mistral-7B-v0.3-GPTQ

Text Generation • Updated May 25, 2024 • 12
thesven/openchat-3.6-8b-20240522-GPTQ

Text Generation • Updated May 25, 2024 • 3
thesven/Llama-3-8B-GPTQ-4bit

Text Generation • Updated May 13, 2024 • 2.06k
thesven/microsoft_WizardLM-2-7B-GPTQ-98k

Text Generation • Updated May 25, 2024 • 3
thesven/Mistral-7B-Instruct-v0.3-GPTQ-4bit

Text Generation • Updated Aug 2, 2024 • 29
thesven/falcon-11B-GPTQ-4bit

Text Generation • Updated May 14, 2024 • 6