MLX quantized

#7
by shaowlnkngfu - opened

Just fyi, MLX community already has a 4-bit for those who have apple :
https://huggingface.co/mlx-community/c4ai-command-r-plus-4bit

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment