Joseph717171 commited on
Commit
47e6e7a
·
verified ·
1 Parent(s): 5ba3b58

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -11,10 +11,10 @@ author: Joseph717171 & froggeric (https://huggingface.co/datasets/froggeric/imat
11
 
12
  # Just download the imatrix for your chosen LLM (Large Language Model), and quantize to your preferred QuantType. (Note the following example already assumes you converted your model to GGUF)
13
 
14
- # Note: If you need detailed steps to convert your Large Language Model to GGUF, please scroll to the bottom of the page and check out the section: How to convert (Supported) LLMs (Large Language Model) to GGUF format
15
  ```
16
  llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
17
  ```
 
18
 
19
  # Input files for generating the Importance Matrix
20
 
 
11
 
12
  # Just download the imatrix for your chosen LLM (Large Language Model), and quantize to your preferred QuantType. (Note the following example already assumes you converted your model to GGUF)
13
 
 
14
  ```
15
  llama.cpp % ./quantize --imatrix path_to_imatrix path_to_model/ggml-model-f16.gguf model_name-QuantType.gguf QuantType
16
  ```
17
+ # Note: If you need detailed steps to convert your Large Language Model to GGUF, please scroll to the bottom of this page and check out the section: How to convert (Supported) LLMs (Large Language Model) to GGUF format
18
 
19
  # Input files for generating the Importance Matrix
20