Quant-Cartel
/

Phainesthesia-8x7B-iMat-GGUF

Not-For-All-Audiences

Model card Files Files and versions Community

InferenceIllusionist commited on Mar 21, 2024

Commit

e6458fa

·

verified ·

1 Parent(s): e45f3ef

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -28,7 +28,7 @@ PROUDLY PRESENTS
 # Phainesthesia-8x7B-iMat-GGUF
 Quantized from fp16 with love.
-* Quantizations made possible using .imatrix file from [this](https://huggingface.co/datasets/ikawrakow/imatrix-from-wiki-train) repo (special thanks to [ikawrakow](https://huggingface.co/ikawrakow) again)
 For a brief rundown of iMatrix quant performance please see this [PR](https://github.com/ggerganov/llama.cpp/pull/5747)

 # Phainesthesia-8x7B-iMat-GGUF
 Quantized from fp16 with love.
+* Quantizations made possible using mixtral-8x7b-instruct-v0.1.imatrix file from [this](https://huggingface.co/datasets/ikawrakow/imatrix-from-wiki-train) repo (special thanks to [ikawrakow](https://huggingface.co/ikawrakow) again)
 For a brief rundown of iMatrix quant performance please see this [PR](https://github.com/ggerganov/llama.cpp/pull/5747)