LLM Pretraining - a QPHutu Collection

QPHutu 's Collections

LLM Pretraining

Pipeline Parallelism

LLM Pretraining

updated 7 days ago

MiniMax-01: Scaling Foundation Models with Lightning Attention

Paper • 2501.08313 • Published Jan 14 • 293
Parallel Scaling Law for Language Models

Paper • 2505.10475 • Published 19 days ago • 77
Qwen3 Technical Report

Paper • 2505.09388 • Published 20 days ago • 175