Upload folder using huggingface_hub
Browse files- .gitattributes +3 -0
- README.md +36 -0
- base.gguf +3 -0
- q2_k.gguf +3 -0
- q3_k_m.gguf +3 -0
.gitattributes
CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
33 |
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
base.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
q2_k.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
ADDED
@@ -0,0 +1,36 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
<div align="center">
|
2 |
+
<img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/>
|
3 |
+
</div>
|
4 |
+
</br>
|
5 |
+
<div align="center">
|
6 |
+
|
7 |
+
# 🚀 bloomvn-0.5b-ppo-GGUF
|
8 |
+
|
9 |
+
### Optimized quantized models for efficient inference
|
10 |
+
|
11 |
+
</div>
|
12 |
+
|
13 |
+
## 📋 Overview
|
14 |
+
|
15 |
+
A collection of optimized GGUF quantized models derived from [BlossomsAI/BloomVN-0.5B-ppo](https://huggingface.co/BlossomsAI/BloomVN-0.5B-ppo), providing various performance-quality tradeoffs.
|
16 |
+
|
17 |
+
<div style="width: 50%; text-align: left; margin-left: 0;">
|
18 |
+
|
19 |
+
## 💎 Model Variants
|
20 |
+
|
21 |
+
| Variant | Description | Size |
|
22 |
+
|---------|-------------|------|
|
23 |
+
| base | Base model in FP16 format | 948.1MB |
|
24 |
+
| q2_k | 2-bit quantized, extreme compression, suitable for constrained environments | 322.9MB |
|
25 |
+
| q3_k_m | 3-bit quantized, very compressed, good for memory-limited devices | 339.0MB |
|
26 |
+
|
27 |
+
|
28 |
+
## 🤝 Contributors
|
29 |
+
|
30 |
+
Developed with ❤️ by [Vuanhngo11](https://huggingface.co/Vuanhngo11)
|
31 |
+
|
32 |
+
---
|
33 |
+
|
34 |
+
<div align="center">
|
35 |
+
<sub>Star ⭐️ this repo if you find it valuable!</sub>
|
36 |
+
</div>
|
base.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:436c378a2362740d7ae07a2c646eff2c5341cc1ce7ffff9630f4332ae1b3ccdb
|
3 |
+
size 994156256
|
q2_k.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:10be951e9d6e43bc6030bae9d456c03848edac754173f5d43831d1b77f6e3b05
|
3 |
+
size 338606816
|
q3_k_m.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f6044ca073d4ee7335c3e1c13c27e65f13d3658b6364c8a6e3af7992086a5568
|
3 |
+
size 355465952
|