Mixtral of Experts
Paper
•
2401.04088
•
Published
•
159
model architecture
-
-
MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts
Paper • 2401.04081 • Published • 71 -
TinyLlama: An Open-Source Small Language Model
Paper • 2401.02385 • Published • 95 -
LLaMA Pro: Progressive LLaMA with Block Expansion
Paper • 2401.02415 • Published • 54 -
LLaVA-φ: Efficient Multi-Modal Assistant with Small Language Model
Paper • 2401.02330 • Published • 17