Adding AWQ Quant (#3)
Browse files- Adding AWQ Quant (3cf097b068114e9c920f3b3596d559800d1e8242)
Co-authored-by: ParmyJack <[email protected]>
README.md
CHANGED
|
@@ -42,6 +42,8 @@ ExLlamaV2: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-exl2
|
|
| 42 |
|
| 43 |
GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
|
| 44 |
|
|
|
|
|
|
|
| 45 |
## Evaluation Results
|
| 46 |
0-shot AGIEval
|
| 47 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|
|
|
|
| 42 |
|
| 43 |
GGUF: https://huggingface.co/bartowski/Hyperion-2.0-Mistral-7B-GGUF
|
| 44 |
|
| 45 |
+
AWQ: https://huggingface.co/solidrust/Hyperion-2.0-Mistral-7B-AWQ
|
| 46 |
+
|
| 47 |
## Evaluation Results
|
| 48 |
0-shot AGIEval
|
| 49 |
| Tasks |Version|Filter|n-shot| Metric |Value | |Stderr|
|