Vuanhngo11 commited on
Commit
a74455e
·
verified ·
1 Parent(s): 5e398e2

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. .gitattributes +3 -0
  2. README.md +36 -0
  3. base.gguf +3 -0
  4. q2_k.gguf +3 -0
  5. q3_k_m.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ base.gguf filter=lfs diff=lfs merge=lfs -text
37
+ q2_k.gguf filter=lfs diff=lfs merge=lfs -text
38
+ q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,36 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ <div align="center">
2
+ <img src="https://github.com/bloomifycafe/blossomsAI/blob/main/assets/logo.png?raw=true" alt="Logo"/>
3
+ </div>
4
+ </br>
5
+ <div align="center">
6
+
7
+ # 🚀 bloomvn-0.5b-ppo-GGUF
8
+
9
+ ### Optimized quantized models for efficient inference
10
+
11
+ </div>
12
+
13
+ ## 📋 Overview
14
+
15
+ A collection of optimized GGUF quantized models derived from [BlossomsAI/BloomVN-0.5B-ppo](https://huggingface.co/BlossomsAI/BloomVN-0.5B-ppo), providing various performance-quality tradeoffs.
16
+
17
+ <div style="width: 50%; text-align: left; margin-left: 0;">
18
+
19
+ ## 💎 Model Variants
20
+
21
+ | Variant | Description | Size |
22
+ |---------|-------------|------|
23
+ | base | Base model in FP16 format | 948.1MB |
24
+ | q2_k | 2-bit quantized, extreme compression, suitable for constrained environments | 322.9MB |
25
+ | q3_k_m | 3-bit quantized, very compressed, good for memory-limited devices | 339.0MB |
26
+
27
+
28
+ ## 🤝 Contributors
29
+
30
+ Developed with ❤️ by [Vuanhngo11](https://huggingface.co/Vuanhngo11)
31
+
32
+ ---
33
+
34
+ <div align="center">
35
+ <sub>Star ⭐️ this repo if you find it valuable!</sub>
36
+ </div>
base.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:436c378a2362740d7ae07a2c646eff2c5341cc1ce7ffff9630f4332ae1b3ccdb
3
+ size 994156256
q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10be951e9d6e43bc6030bae9d456c03848edac754173f5d43831d1b77f6e3b05
3
+ size 338606816
q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6044ca073d4ee7335c3e1c13c27e65f13d3658b6364c8a6e3af7992086a5568
3
+ size 355465952