| Quant                                                                                                        | Size (MB) | PPL     | Size (%) | Accuracy (%) | PPL error rate |
| ------------------------------------------------------------------------------------------------------------ | --------- | ------- | -------- | ------------ | -------------- |
| [IQ1_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ1_S.gguf)     | 6937      | 10.7622 | 11.10    | 54.42        | 0.15           |
| [IQ1_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ1_M.gguf)     | 7564      | 9.2039  | 12.10    | 63.64        | 0.13           |
| [IQ2_XXS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_XXS.gguf) | 8610      | 7.5917  | 13.78    | 77.15        | 0.11           |
| [IQ2_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_XS.gguf)   | 9496      | 7.1233  | 15.19    | 82.23        | 0.10           |
| [IQ2_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_S.gguf)     | 9906      | 7.0558  | 15.85    | 83.01        | 0.10           |
| [IQ2_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ2_M.gguf)     | 10742     | 6.7367  | 17.19    | 86.95        | 0.09           |
| [Q2_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q2_K_S.gguf)   | 10955     | 6.9707  | 17.53    | 84.03        | 0.10           |
| [Q2_K](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q2_K.gguf)       | 11742     | 6.7073  | 18.79    | 87.33        | 0.09           |
| [IQ3_XXS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_XXS.gguf) | 12244     | 6.3673  | 19.59    | 91.99        | 0.09           |
| [IQ3_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_XS.gguf)   | 13070     | 6.2584  | 20.91    | 93.59        | 0.08           |
| [Q3_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q3_K_S.gguf)   | 13725     | 6.2372  | 21.96    | 93.91        | 0.08           |
| [IQ3_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_S.gguf)     | 13768     | 6.1756  | 22.03    | 94.85        | 0.08           |
| [IQ3_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ3_M.gguf)     | 14124     | 6.1781  | 22.60    | 94.81        | 0.08           |
| [Q3_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q3_K_M.gguf)   | 15196     | 6.0711  | 24.31    | 96.48        | 0.08           |
| [Q3_K_L](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q3_K_L.gguf)   | 16448     | 6.0467  | 26.32    | 96.87        | 0.08           |
| [IQ4_XS](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ4_XS.gguf)   | 16873     | 5.9536  | 27.00    | 98.38        | 0.08           |
| [IQ4_NL](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-IQ4_NL.gguf)   | 17816     | 5.9556  | 28.51    | 98.35        | 0.08           |
| [Q4_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_0.gguf)       | 17844     | 5.9980  | 28.55    | 97.65        | 0.08           |
| [Q4_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_K_S.gguf)   | 17914     | 5.9378  | 28.66    | 98.64        | 0.08           |
| [Q4_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_K_M.gguf)   | 18931     | 5.9273  | 30.29    | 98.82        | 0.08           |
| [Q4_1](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q4_1.gguf)       | 19683     | 5.9349  | 31.49    | 98.69        | 0.08           |
| [Q5_K_S](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_K_S.gguf)   | 21589     | 5.8895  | 34.54    | 99.45        | 0.08           |
| [Q5_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_0.gguf)       | 21657     | 5.9057  | 34.65    | 99.18        | 0.08           |
| [Q5_K_M](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_K_M.gguf)   | 22184     | 5.8872  | 35.49    | 99.49        | 0.08           |
| [Q5_1](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q5_1.gguf)       | 23495     | 5.8896  | 37.59    | 99.45        | 0.08           |
| [Q6_K](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q6_K.gguf)       | 25640     | 5.8667  | 41.02    | 99.84        | 0.08           |
| [Q8_0](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/blob/main/QwQ-32B-Preview-Q8_0.gguf)       | 33207     | 5.8646  | 53.13    | 99.88        | 0.08           |
| [F16](https://huggingface.co/ThomasBaruzier/QwQ-32B-Preview-GGUF/tree/main/QwQ-32B-Preview-F16)              | 62499     | 5.8574  | 100      | 100          | 0.08           |