Quantizations of https://huggingface.co/icefog72/IceLatteRP-7b

From original readme

IceLatteRP-7b

image/png

This is a merge of pre-trained language models created using mergekit.

Merge Details

I'm preaty satisfied with this result.

Downloads last month
62
GGUF
Model size
7.24B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support