Num KV heads changed from 16 to 8?
#21
by
keremturgutlu
- opened
This is a breaking change!
Can you please provide more info about it and also host the previous model weights before this change. We have multiple finetuned models which are now not compatible.
Thanks,
Kerem - Answer.AI
You can get the old files in the git history.