Ctrl+K

1 contributor

History: 75 commits

eaddario

Update README.md

1314ed4 verified 19 days ago

imatrix
Regenerate importance matrices about 2 months ago
logits
Generate base model logits 3 months ago
scores
Add GGUF internal file structure 25 days ago
.gitattributes

1.65 kB

Update .gitattributes 3 months ago
.gitignore

6.78 kB

Add .gitignore 3 months ago
DeepSeek-R1-Distill-Llama-8B-F16.gguf

16.1 GB
LFS

Convert to GGUF @ F16 3 months ago
DeepSeek-R1-Distill-Llama-8B-IQ3_M.gguf

3.69 GB
LFS

Layer-wise quantization IQ3_M 25 days ago
DeepSeek-R1-Distill-Llama-8B-IQ3_S.gguf

3.43 GB
LFS

Layer-wise quantization IQ3_S 25 days ago
DeepSeek-R1-Distill-Llama-8B-IQ4_NL.gguf

4.39 GB
LFS

Layer-wise quantization IQ4_NL 25 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_L.gguf

3.76 GB
LFS

Layer-wise quantization Q3_K_L 25 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_M.gguf

3.56 GB
LFS

Layer-wise quantization Q3_K_M 25 days ago
DeepSeek-R1-Distill-Llama-8B-Q3_K_S.gguf

3.31 GB
LFS

Layer-wise quantization Q3_K_S 25 days ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_M.gguf

4.41 GB
LFS

Layer-wise quantization Q4_K_M 26 days ago
DeepSeek-R1-Distill-Llama-8B-Q4_K_S.gguf

4.28 GB
LFS

Layer-wise quantization Q4_K_S 26 days ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_M.gguf

5.38 GB
LFS

Layer-wise quantization Q5_K_M 26 days ago
DeepSeek-R1-Distill-Llama-8B-Q5_K_S.gguf

5.24 GB
LFS

Layer-wise quantization Q5_K_S 26 days ago
DeepSeek-R1-Distill-Llama-8B-Q6_K.gguf

6.57 GB
LFS

Layer-wise quantization Q6_K 26 days ago
DeepSeek-R1-Distill-Llama-8B-Q8_0.gguf

7.73 GB
LFS

Layer-wise quantization Q8_0 26 days ago
README.md

19.3 kB

Update README.md 19 days ago