Chronoboros
💬
chronoboros chat test
Hugging Face Discord Community
community
AI & ML interests
Collaborating towards Good ML!
Recent Activity
View all activity
discord-community's activity
lunarflu
updated
a
Space
about 13 hours ago
lunarflu
updated
a
Space
1 day ago
Work expereince via Hgging Face?
1
#35 opened 4 days ago
by
DecadeOfData
[BUG] Channels with emoji names break hyperlinks
1
#7 opened 17 days ago
by
christopher
Fix emoji in hyperlink bug
#8 opened 17 days ago
by
christopher
Post
6267
An assembly of 18 European companies, labs, and universities have banded together to launch 🇪🇺 EuroBERT! It's a state-of-the-art multilingual encoder for 15 European languages, designed to be finetuned for retrieval, classification, etc.
🇪🇺 15 Languages: English, French, German, Spanish, Chinese, Italian, Russian, Polish, Portuguese, Japanese, Vietnamese, Dutch, Arabic, Turkish, Hindi
3️⃣ 3 model sizes: 210M, 610M, and 2.1B parameters - very very useful sizes in my opinion
➡️ Sequence length of 8192 tokens! Nice to see these higher sequence lengths for encoders becoming more common.
⚙️ Architecture based on Llama, but with bi-directional (non-causal) attention to turn it into an encoder. Flash Attention 2 is supported.
🔥 A new Pareto frontier (stronger *and* smaller) for multilingual encoder models
📊 Evaluated against mDeBERTa, mGTE, XLM-RoBERTa for Retrieval, Classification, and Regression (after finetuning for each task separately): EuroBERT punches way above its weight.
📝 Detailed paper with all details, incl. data: FineWeb for English and CulturaX for multilingual data, The Stack v2 and Proof-Pile-2 for code.
Check out the release blogpost here: https://huggingface.co/blog/EuroBERT/release
* EuroBERT/EuroBERT-210m
* EuroBERT/EuroBERT-610m
* EuroBERT/EuroBERT-2.1B
The next step is for researchers to build upon the 3 EuroBERT base models and publish strong retrieval, zero-shot classification, etc. models for all to use. I'm very much looking forward to it!
🇪🇺 15 Languages: English, French, German, Spanish, Chinese, Italian, Russian, Polish, Portuguese, Japanese, Vietnamese, Dutch, Arabic, Turkish, Hindi
3️⃣ 3 model sizes: 210M, 610M, and 2.1B parameters - very very useful sizes in my opinion
➡️ Sequence length of 8192 tokens! Nice to see these higher sequence lengths for encoders becoming more common.
⚙️ Architecture based on Llama, but with bi-directional (non-causal) attention to turn it into an encoder. Flash Attention 2 is supported.
🔥 A new Pareto frontier (stronger *and* smaller) for multilingual encoder models
📊 Evaluated against mDeBERTa, mGTE, XLM-RoBERTa for Retrieval, Classification, and Regression (after finetuning for each task separately): EuroBERT punches way above its weight.
📝 Detailed paper with all details, incl. data: FineWeb for English and CulturaX for multilingual data, The Stack v2 and Proof-Pile-2 for code.
Check out the release blogpost here: https://huggingface.co/blog/EuroBERT/release
* EuroBERT/EuroBERT-210m
* EuroBERT/EuroBERT-610m
* EuroBERT/EuroBERT-2.1B
The next step is for researchers to build upon the 3 EuroBERT base models and publish strong retrieval, zero-shot classification, etc. models for all to use. I'm very much looking forward to it!
- 1 reply
I am not redirected after login
16
#29 opened 2 months ago
by
eduardoworrel
christopher
updated
a
Space
17 days ago
Fix emoji in hyperlink bug
#8 opened 17 days ago
by
christopher
I am not redirected after login
16
#29 opened 2 months ago
by
eduardoworrel
I am not redirected after login
16
#29 opened 2 months ago
by
eduardoworrel
Read this if your auth isn't working, if your login doesn't work, or if you're redirected too many times.
14
#31 opened about 2 months ago
by
JosephCatrambone
Verify Your Email
3
#30 opened about 2 months ago
by
vsanchezn
Read this if your auth isn't working, if your login doesn't work, or if you're redirected too many times.
14
#31 opened about 2 months ago
by
JosephCatrambone
lunarflu
updated
a
Space
21 days ago
Read this if your auth isn't working, if your login doesn't work, or if you're redirected too many times.
14
#31 opened about 2 months ago
by
JosephCatrambone
Read this if your auth isn't working, if your login doesn't work, or if you're redirected too many times.
14
#31 opened about 2 months ago
by
JosephCatrambone
Read this if your auth isn't working, if your login doesn't work, or if you're redirected too many times.
14
#31 opened about 2 months ago
by
JosephCatrambone
tomaarsen
authored
a
paper
23 days ago
Add strings to forbidden_strings
1
#6 opened 24 days ago
by
christopher