Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters
Paper
•
2408.03314
•
Published
•
63
Scaling Literature
Collection of Scaling Law Papers
-
-
Training Compute-Optimal Large Language Models
Paper • 2203.15556 • Published • 10 -
Scaling Laws for Precision
Paper • 2411.04330 • Published • 8 -
Transcending Scaling Laws with 0.1% Extra Compute
Paper • 2210.11399 • Published -
Scaling Vision Transformers
Paper • 2106.04560 • Published -
Emergent Abilities of Large Language Models
Paper • 2206.07682 • Published • 3 -
Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling
Paper • 2502.06703 • Published • 152 -
Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws
Paper • 2401.00448 • Published • 31