Zyphra/Zyda-2
Viewer
•
Updated
•
1.62B
•
90.6k
•
81
Interesting Pre-Training Datasets
Note Look at the preprocessing code: https://github.com/Zyphra/Zyda_processing
-
HuggingFaceTB/dclm-edu
Viewer • Updated • 1B • 17.9k • 25 -
HuggingFaceFW/fineweb-edu
Viewer • Updated • 3.3B • 253k • 668 -
HuggingFaceTB/stack-edu
Viewer • Updated • 167M • 2.19k • 32 -
HuggingFaceTB/finemath
Viewer • Updated • 48.3M • 16.2k • 307 -
bigcode/the-stack
Viewer • Updated • 546M • 7.34k • 796 -
bigcode/the-stack-v2
Viewer • Updated • 5.45B • 3.04k • 360 -
HuggingFaceTB/smollm-corpus
Viewer • Updated • 237M • 9.98k • 329 -
mlfoundations/dclm-baseline-1.0
Preview • Updated • 1.07M • 218