Update README.md
Browse files
README.md
CHANGED
|
@@ -35,8 +35,9 @@ Quatizations provided by [TheBloke](https://huggingface.co/TheBloke/laser-dolphi
|
|
| 35 |
- Q4_K_M
|
| 36 |
- Q5_K_M
|
| 37 |
|
| 38 |
-
|
| 39 |
-
|
|
|
|
| 40 |
|
| 41 |
## Code Example
|
| 42 |
Switch the commented model definition to use in 4-bit. Should work with 9GB and still exceed the single 7B model by 5-6 points roughly
|
|
|
|
| 35 |
- Q4_K_M
|
| 36 |
- Q5_K_M
|
| 37 |
|
| 38 |
+
## HF Spaces
|
| 39 |
+
+ GGUF chat available [here](https://huggingface.co/spaces/macadeliccc/laser-dolphin-mixtral-chat-GGUF)
|
| 40 |
+
+ 4-bit bnb chat available [here](https://huggingface.co/spaces/macadeliccc/laser-dolphin-mixtral-chat)
|
| 41 |
|
| 42 |
## Code Example
|
| 43 |
Switch the commented model definition to use in 4-bit. Should work with 9GB and still exceed the single 7B model by 5-6 points roughly
|