Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
Qwen2.5-1.5B-Instruct-GGUF
like
5
Text Generation
Transformers
GGUF
13 languages
chat
imatrix
conversational
arxiv:
2407.10671
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
1
Train
Deploy
Use this model
ce70f68
Qwen2.5-1.5B-Instruct-GGUF
Ctrl+K
Ctrl+K
2 contributors
History:
24 commits
Mungert
Upload Qwen2.5-1.5B-Instruct-q4_1.gguf with huggingface_hub
ce70f68
verified
2 months ago
.gitattributes
3.06 kB
Upload Qwen2.5-1.5B-Instruct-q4_1.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-bf16-q6_k.gguf
1.55 GB
xet
Upload Qwen2.5-1.5B-Instruct-bf16-q6_k.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-bf16-q8_0.gguf
1.87 GB
xet
Upload Qwen2.5-1.5B-Instruct-bf16-q8_0.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-f16-q4_k.gguf
1.26 GB
xet
Upload Qwen2.5-1.5B-Instruct-f16-q4_k.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-f16-q6_k.gguf
1.55 GB
xet
Upload Qwen2.5-1.5B-Instruct-f16-q6_k.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-f16-q8_0.gguf
1.87 GB
xet
Upload Qwen2.5-1.5B-Instruct-f16-q8_0.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-iq3_xs.gguf
732 MB
xet
Upload Qwen2.5-1.5B-Instruct-iq3_xs.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-iq4_nl.gguf
936 MB
xet
Upload Qwen2.5-1.5B-Instruct-iq4_nl.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-iq4_xs.gguf
896 MB
xet
Upload Qwen2.5-1.5B-Instruct-iq4_xs.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q2_k_l.gguf
733 MB
xet
Upload Qwen2.5-1.5B-Instruct-q2_k_l.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q3_k_l.gguf
881 MB
xet
Upload Qwen2.5-1.5B-Instruct-q3_k_l.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q3_k_m.gguf
824 MB
xet
Upload Qwen2.5-1.5B-Instruct-q3_k_m.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q3_k_s.gguf
761 MB
xet
Upload Qwen2.5-1.5B-Instruct-q3_k_s.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q4_0.gguf
991 MB
xet
Upload Qwen2.5-1.5B-Instruct-q4_0.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q4_1.gguf
Safe
1.07 GB
xet
Upload Qwen2.5-1.5B-Instruct-q4_1.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q4_k_l.gguf
1.04 GB
xet
Upload Qwen2.5-1.5B-Instruct-q4_k_l.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q4_k_s.gguf
940 MB
xet
Upload Qwen2.5-1.5B-Instruct-q4_k_s.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q5_k_m.gguf
1.13 GB
xet
Upload Qwen2.5-1.5B-Instruct-q5_k_m.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q5_k_s.gguf
1.1 GB
xet
Upload Qwen2.5-1.5B-Instruct-q5_k_s.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q6_k_l.gguf
1.33 GB
xet
Upload Qwen2.5-1.5B-Instruct-q6_k_l.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q6_k_m.gguf
1.27 GB
xet
Upload Qwen2.5-1.5B-Instruct-q6_k_m.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct-q8_0.gguf
1.65 GB
xet
Upload Qwen2.5-1.5B-Instruct-q8_0.gguf with huggingface_hub
2 months ago
Qwen2.5-1.5B-Instruct.imatrix
Safe
2.04 MB
xet
Upload Qwen2.5-1.5B-Instruct.imatrix with huggingface_hub
2 months ago
README.md
11.2 kB
Upload README.md with huggingface_hub
2 months ago
