Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Paper
•
2504.20966
•
Published
•
17
Edd
Erland
AI & ML interests
None yet
Recent Activity
authored
a paper
about 23 hours ago
Softpick: No Attention Sink, No Massive Activations with Rectified
Softmax
updated
a model
1 day ago
Erland/gemma_without_embedding
published
a model
1 day ago
Erland/gemma_without_embedding
Organizations
Erland's activity
authored
a
paper
about 23 hours ago
updated
a
model
1 day ago
published
a
model
1 day ago
updated
a
model
1 day ago
published
a
model
1 day ago
upvoted
a
paper
2 days ago
liked
a
model
3 days ago
upvoted
a
paper
4 days ago
liked
a
model
4 days ago
updated
a
model
6 days ago
published
a
model
6 days ago
updated
a
model
8 days ago
updated
a
model
9 days ago
published
a
model
9 days ago
updated
a
model
9 days ago
published
a
model
9 days ago
updated
a
model
9 days ago
published
a
model
9 days ago
updated
a
model
9 days ago
published
a
model
9 days ago