Llamacpp imatrix Quantizations of Qwerky-72B by featherless-ai

Quantization after https://github.com/ggml-org/llama.cpp/pull/12667 fix

Downloads last month
19
GGUF
Model size
79.3B params
Architecture
rwkv6qwen2
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for exxocism/featherless-ai_Qwerky-72B-GGUF

Quantized
(4)
this model