🔥 flame - a fla-hub Collection

fla-hub 's Collections

GSA

HGRN2

GLA

RWKV6

RetNet

Mamba

HGRN

Qwen2.5

🔥 flame

updated about 15 hours ago

A collection of baselines trained by 🔥 flame

fla-hub/transformer-340M-4K-0.5B-20480-lr3e-4-cosine

Updated 5 days ago • 2 • 1
fla-hub/transformer-340M-4K-0.5B-20480-lr3e-4-decay0.1-sqrt

Updated 5 days ago • 2