Should VLMs be Pre-trained with Image Data?
Paper
•
2503.07603
•
Published
•
3
huggingPartyParis
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
HuggingPartyParis's activity
ivas-tri
authored
a
paper
5 days ago
PierreColombo
authored
a
paper
7 days ago
RedTachyon
authored
a
paper
about 1 month ago
loubnabnl
authored
a
paper
about 1 month ago
Eladlev
authored
a
paper
about 2 months ago
Post
3078
Making SmolLM2 reproducible: open-sourcing our training & evaluation toolkit 🛠️ https://github.com/huggingface/smollm/
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
- Pre-training code with nanotron
- Evaluation suite with lighteval
- Synthetic data generation using distilabel (powers our new SFT dataset HuggingFaceTB/smoltalk)
- Post-training scripts with TRL & the alignment handbook
- On-device tools with llama.cpp for summarization, rewriting & agents
Apache 2.0 licensed. V2 pre-training data mix coming soon!
Which other tools should we add next?
SaylorTwift
posted
an
update
4 months ago
Post
594
How do I test an LLM for my unique needs?
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
If you work in finance, law, or medicine, generic benchmarks are not enough.
This blog post uses Argilla, Distilllabel and 🌤️Lighteval to generate evaluation dataset and evaluate models.
https://github.com/argilla-io/argilla-cookbook/blob/main/domain-eval/README.md
PierreColombo
authored
a
paper
5 months ago
lukasHoel
authored
4
papers
6 months ago
3DGS-LM: Faster Gaussian-Splatting Optimization with Levenberg-Marquardt
Paper
•
2409.12892
•
Published
•
5
ViewDiff: 3D-Consistent Image Generation with Text-to-Image Models
Paper
•
2403.01807
•
Published
•
9
ControlRoom3D: Room Generation using Semantic Proxy Rooms
Paper
•
2312.05208
•
Published
•
8
Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Models
Paper
•
2303.11989
•
Published
ragavsachdeva
authored
a
paper
6 months ago
ragavsachdeva
authored
a
paper
8 months ago
PierreColombo
authored
a
paper
8 months ago
loubnabnl
authored
a
paper
9 months ago
ivas-tri
authored
a
paper
9 months ago
altndrr
authored
a
paper
9 months ago
andreamaduzzi
authored
a
paper
9 months ago
Parm1990
authored
a
paper
9 months ago