Hugging Face's logo

SpongeEngine
/
patricide-12B-Unslop-Mell-i1-GGUF

GGUF
English
SpongeQuant
i1-GGUF
Inference Endpoints
imatrix
Model card Files Community
dclipca commited on
Commit
85a6524
·
verified ·
1 Parent(s): c75d676

Upload folder using huggingface_hub

Browse files
Files changed (22) hide show
  1. .gitattributes +20 -0
  2. README.md +26 -0
  3. patricide-12B-Unslop-Mell.imatrix.dat +3 -0
  4. patricide-12b-unslop-mell-i1-IQ2_M.gguf +3 -0
  5. patricide-12b-unslop-mell-i1-IQ2_S.gguf +3 -0
  6. patricide-12b-unslop-mell-i1-IQ2_XS.gguf +3 -0
  7. patricide-12b-unslop-mell-i1-IQ2_XXS.gguf +3 -0
  8. patricide-12b-unslop-mell-i1-IQ3_M.gguf +3 -0
  9. patricide-12b-unslop-mell-i1-IQ3_S.gguf +3 -0
  10. patricide-12b-unslop-mell-i1-IQ3_XS.gguf +3 -0
  11. patricide-12b-unslop-mell-i1-IQ3_XXS.gguf +3 -0
  12. patricide-12b-unslop-mell-i1-IQ4_NL.gguf +3 -0
  13. patricide-12b-unslop-mell-i1-IQ4_XS.gguf +3 -0
  14. patricide-12b-unslop-mell-i1-Q2_K.gguf +3 -0
  15. patricide-12b-unslop-mell-i1-Q3_K_L.gguf +3 -0
  16. patricide-12b-unslop-mell-i1-Q3_K_M.gguf +3 -0
  17. patricide-12b-unslop-mell-i1-Q3_K_S.gguf +3 -0
  18. patricide-12b-unslop-mell-i1-Q4_K_M.gguf +3 -0
  19. patricide-12b-unslop-mell-i1-Q4_K_S.gguf +3 -0
  20. patricide-12b-unslop-mell-i1-Q5_K_M.gguf +3 -0
  21. patricide-12b-unslop-mell-i1-Q5_K_S.gguf +3 -0
  22. patricide-12b-unslop-mell-i1-Q6_K.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,23 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ patricide-12B-Unslop-Mell.imatrix.dat filter=lfs diff=lfs merge=lfs -text
37
+ patricide-12b-unslop-mell-i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ patricide-12b-unslop-mell-i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ patricide-12b-unslop-mell-i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
40
+ patricide-12b-unslop-mell-i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
41
+ patricide-12b-unslop-mell-i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ patricide-12b-unslop-mell-i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ patricide-12b-unslop-mell-i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
44
+ patricide-12b-unslop-mell-i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
45
+ patricide-12b-unslop-mell-i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
46
+ patricide-12b-unslop-mell-i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ patricide-12b-unslop-mell-i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
48
+ patricide-12b-unslop-mell-i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
49
+ patricide-12b-unslop-mell-i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
50
+ patricide-12b-unslop-mell-i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ patricide-12b-unslop-mell-i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
52
+ patricide-12b-unslop-mell-i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
53
+ patricide-12b-unslop-mell-i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
54
+ patricide-12b-unslop-mell-i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
55
+ patricide-12b-unslop-mell-i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,26 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: redrix/patricide-12B-Unslop-Mell
3
+ language:
4
+ - en
5
+ license: mit
6
+ quantized_by: SpongeQuant
7
+ tags:
8
+ - SpongeQuant
9
+ - i1-GGUF
10
+ ---
11
+
12
+
13
+ Quantized to `i1-GGUF` using [SpongeQuant](https://github.com/SpongeEngine/SpongeQuant), the Oobabooga of LLM quantization. Chat & support at [Sponge Engine](https://discord.gg/azNmr2Gdgy).
14
+
15
+ <figure>
16
+ <img src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/102.png" alt="102. Rush hour traffic, India">
17
+ <figcaption>102. Rush hour traffic, India</figcaption>
18
+ </figure>
19
+
20
+ <figure>
21
+ <audio controls>
22
+ <source src="https://huggingface.co/spaces/SpongeEngine/README/resolve/main/017.mp3" type="audio/mp3">
23
+ Your browser does not support the audio element.
24
+ </audio>
25
+ <figcaption>17. Roncadoras and Drums – Musicians from Ancash</figcaption>
26
+ </figure>
patricide-12B-Unslop-Mell.imatrix.dat ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8c22ca35e7d80961dd79c2bf7b9044e437db32b87b5865f67112cfe7832f898c
3
+ size 7054409
patricide-12b-unslop-mell-i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b5e342fcc6fe8db42e5c4e95a0f1261231f9dd722a80a60d6403b8310315140
3
+ size 4435023328
patricide-12b-unslop-mell-i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab7372dc1b4b6240f574a1b7427270d4884e56aa84b25306d1648c864f01a27f
3
+ size 4138472928
patricide-12b-unslop-mell-i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eeebfb10f68c0bb0452a361f24848c05e15d29a1a016f4f85cb03ea01bbb3ec8
3
+ size 3915077088
patricide-12b-unslop-mell-i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:384125e7ea2caa867223378e24de4aa5f02de0c68d5afde686b90ad3d7a4cce2
3
+ size 3592312288
patricide-12b-unslop-mell-i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6514ed633f635803eb902f9ad3e02fb5c5d5cccd1df0c014c297947fd3fdd5e1
3
+ size 5722232288
patricide-12b-unslop-mell-i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d60baa08b7c367ad370cca5c55c4f84c59c27a1c6f2a1bc425298dce26be6c40
3
+ size 5562078688
patricide-12b-unslop-mell-i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a98090175990db8e107f79dce1fb80258757c2b0a63a62e0432b7ff39363ed91
3
+ size 5306488288
patricide-12b-unslop-mell-i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bbfeb4baedf3978108e2c631b52ffc63925392838201e78751af7608ba3230a5
3
+ size 4945384928
patricide-12b-unslop-mell-i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd13dbe47b80fd53d453d31a5ebcec5617c4fd2c582676179ed1290fc942acdc
3
+ size 7097914848
patricide-12b-unslop-mell-i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eb5c0f3c9288c3b5fd4a16462843767233f26c1e54cf07de5e41312576fbf1fd
3
+ size 6742709728
patricide-12b-unslop-mell-i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:105e9096ae99bbe016a2a02cb072953d6ab9996c0ee2d6f7c8f13903ec8bb61b
3
+ size 4791047648
patricide-12b-unslop-mell-i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e722944df6af5528e4cb275df89e9dc5cfc32c7add3a40cfcdafa4a167908ffe
3
+ size 6561502688
patricide-12b-unslop-mell-i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:013fef5e8057e521b2e3ce9b354ba2880bd4b65f979465e61d6ed8c185bea12f
3
+ size 6083089888
patricide-12b-unslop-mell-i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8090b945d1324c61ca31ed9cbcfc5589d7b63c590775de451264477d2ac6c9f8
3
+ size 5534225888
patricide-12b-unslop-mell-i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ccb8db30d574a954c1710b0affbe4fa7baaf36af95c6094fe9ee57cfecf481d6
3
+ size 7477204448
patricide-12b-unslop-mell-i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8972510e003083a426a9b4ac05ec95af1e8d4d352a0f5a4bf4e890940849a385
3
+ size 7120197088
patricide-12b-unslop-mell-i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f39b33a3f971675f498905ca60a4a6f461673b8cf5cf98625f8717e5df72e485
3
+ size 8727631328
patricide-12b-unslop-mell-i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7e74a31f2571279bbcba180460952b10404ed0d9bcefd655cf30883ab7ce658c
3
+ size 8518735328
patricide-12b-unslop-mell-i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37268634320f43557c9ee858aab339aee6b19e07864cde2360bba571251a34e3
3
+ size 10056209888