Upload perplexity.md
Browse files- perplexity.md +27 -27
perplexity.md
CHANGED
|
@@ -1,30 +1,30 @@
|
|
| 1 |
| Quant | Size (MB) | PPL | Size (%) | Accuracy (%) | PPL error rate |
|
| 2 |
| ------------------------------------------------------------------------------------------------------------ | --------- | ------- | -------- | ------------ | -------------- |
|
| 3 |
-
| [IQ1_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 4 |
-
| [IQ1_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 5 |
-
| [IQ2_XXS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 6 |
-
| [IQ2_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 7 |
-
| [IQ2_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 8 |
-
| [IQ2_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 9 |
-
| [Q2_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 10 |
-
| [Q2_K](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 11 |
-
| [IQ3_XXS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 12 |
-
| [IQ3_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 13 |
-
| [Q3_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 14 |
-
| [IQ3_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 15 |
-
| [IQ3_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 16 |
-
| [Q3_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 17 |
-
| [Q3_K_L](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 18 |
-
| [IQ4_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 19 |
-
| [IQ4_NL](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 20 |
-
| [Q4_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 21 |
-
| [Q4_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 22 |
-
| [Q4_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 23 |
-
| [Q4_1](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 24 |
-
| [Q5_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 25 |
-
| [Q5_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 26 |
-
| [Q5_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 27 |
-
| [Q5_1](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 28 |
-
| [Q6_K](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 29 |
-
| [Q8_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/
|
| 30 |
| [F16](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/tree/main/QwQ-32B-Preview-F16) | 62499 | 5.8574 | 100 | 100 | 0.08 |
|
|
|
|
| 1 |
| Quant | Size (MB) | PPL | Size (%) | Accuracy (%) | PPL error rate |
|
| 2 |
| ------------------------------------------------------------------------------------------------------------ | --------- | ------- | -------- | ------------ | -------------- |
|
| 3 |
+
| [IQ1_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ1_S.gguf) | 6937 | 10.7622 | 11.10 | 54.42 | 0.15 |
|
| 4 |
+
| [IQ1_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ1_M.gguf) | 7564 | 9.2039 | 12.10 | 63.64 | 0.13 |
|
| 5 |
+
| [IQ2_XXS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_XXS.gguf) | 8610 | 7.5917 | 13.78 | 77.15 | 0.11 |
|
| 6 |
+
| [IQ2_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_XS.gguf) | 9496 | 7.1233 | 15.19 | 82.23 | 0.10 |
|
| 7 |
+
| [IQ2_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_S.gguf) | 9906 | 7.0558 | 15.85 | 83.01 | 0.10 |
|
| 8 |
+
| [IQ2_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_M.gguf) | 10742 | 6.7367 | 17.19 | 86.95 | 0.09 |
|
| 9 |
+
| [Q2_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q2_K_S.gguf) | 10955 | 6.9707 | 17.53 | 84.03 | 0.10 |
|
| 10 |
+
| [Q2_K](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q2_K.gguf) | 11742 | 6.7073 | 18.79 | 87.33 | 0.09 |
|
| 11 |
+
| [IQ3_XXS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_XXS.gguf) | 12244 | 6.3673 | 19.59 | 91.99 | 0.09 |
|
| 12 |
+
| [IQ3_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_XS.gguf) | 13070 | 6.2584 | 20.91 | 93.59 | 0.08 |
|
| 13 |
+
| [Q3_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q3_K_S.gguf) | 13725 | 6.2372 | 21.96 | 93.91 | 0.08 |
|
| 14 |
+
| [IQ3_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_S.gguf) | 13768 | 6.1756 | 22.03 | 94.85 | 0.08 |
|
| 15 |
+
| [IQ3_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_M.gguf) | 14124 | 6.1781 | 22.60 | 94.81 | 0.08 |
|
| 16 |
+
| [Q3_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q3_K_M.gguf) | 15196 | 6.0711 | 24.31 | 96.48 | 0.08 |
|
| 17 |
+
| [Q3_K_L](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q3_K_L.gguf) | 16448 | 6.0467 | 26.32 | 96.87 | 0.08 |
|
| 18 |
+
| [IQ4_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ4_XS.gguf) | 16873 | 5.9536 | 27.00 | 98.38 | 0.08 |
|
| 19 |
+
| [IQ4_NL](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ4_NL.gguf) | 17816 | 5.9556 | 28.51 | 98.35 | 0.08 |
|
| 20 |
+
| [Q4_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_0.gguf) | 17844 | 5.9980 | 28.55 | 97.65 | 0.08 |
|
| 21 |
+
| [Q4_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_K_S.gguf) | 17914 | 5.9378 | 28.66 | 98.64 | 0.08 |
|
| 22 |
+
| [Q4_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_K_M.gguf) | 18931 | 5.9273 | 30.29 | 98.82 | 0.08 |
|
| 23 |
+
| [Q4_1](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_1.gguf) | 19683 | 5.9349 | 31.49 | 98.69 | 0.08 |
|
| 24 |
+
| [Q5_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_K_S.gguf) | 21589 | 5.8895 | 34.54 | 99.45 | 0.08 |
|
| 25 |
+
| [Q5_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_0.gguf) | 21657 | 5.9057 | 34.65 | 99.18 | 0.08 |
|
| 26 |
+
| [Q5_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_K_M.gguf) | 22184 | 5.8872 | 35.49 | 99.49 | 0.08 |
|
| 27 |
+
| [Q5_1](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_1.gguf) | 23495 | 5.8896 | 37.59 | 99.45 | 0.08 |
|
| 28 |
+
| [Q6_K](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q6_K.gguf) | 25640 | 5.8667 | 41.02 | 99.84 | 0.08 |
|
| 29 |
+
| [Q8_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q8_0.gguf) | 33207 | 5.8646 | 53.13 | 99.88 | 0.08 |
|
| 30 |
| [F16](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/tree/main/QwQ-32B-Preview-F16) | 62499 | 5.8574 | 100 | 100 | 0.08 |
|