Any chance of creating these with RoPE/Yarn for a context size larger than 32k?
5
#2 opened 9 days ago
by
smcleod
SOTA score
🔥
2
#1 opened 16 days ago
by
oobabooga