SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs
Paper
•
2412.08347
•
Published
•
4
SmolTulu
A collection of models that use SmolLM2 as the pretrained base in conjunction with AllenAI's Tulu 3 post training pipeline.
-
-
SultanR/SmolTulu-1.7b-Reinforced
Text Generation • Updated • 46 • 5 -
SultanR/SmolTulu-1.7b-Instruct
Text Generation • Updated • 80 • 13 -
SultanR/SmolTulu-1.7b-RM
Text Classification • Updated • 29 • 2 -
SultanR/SmolTulu-1.7b-Instruct-GGUF
Text Generation • Updated • 6 • 2 -
SultanR/SmolTulu-1.7b-Reinforced-GGUF
Text Generation • Updated • 3 • 1