Hugging Face's logo
Ash C's picture
23 2 98

Ash C PRO

ashercn97
21world's profile picture Maaz66's profile picture Illia56's profile picture
·

AI & ML interests

None yet

Recent Activity

replied to burtenshaw's post 2 days ago
The open LLM leaderboard is completed, retired, dead, ‘ascended to a higher plane’. And in its shadow we have an amazing range of leaderboards built and maintained by the community. In this post, I just want to list some of those great leaderboards that you should bookmark for staying up to date: - Chatbot Arena LLM Leaderboard is the first port of call for checking out the best model. It’s not the fastest because humans will need to use the models to get scores, but it’s worth the wait. https://huggingface.co/spaces/lmarena-ai/chatbot-arena-leaderboard - OpenVLM Leaderboard is great for getting scores on vision language models https://huggingface.co/spaces/opencompass/open_vlm_leaderboard - Ai2 are doing a great job on RewardBench and I hope they keep it up because reward models are the unsexy workhorse of the field. https://huggingface.co/spaces/allenai/reward-bench - The GAIA leaderboard is great for evaluating agent applications. https://huggingface.co/spaces/gaia-benchmark/leaderboard 🤩 This seems like such a sustainable way of building for the long term, where rather than leaning on a single company to evaluate all LLMs, we share the load.
new activity 2 days ago
mixedbread-ai/mxbai-rerank-base-v2:v2 embeddings... when?!
liked a model 4 days ago
ai-forever/FRIDA
View all activity

Organizations

None yet

Posts 1

view post
Post
3135
does anyone know what the SOTA in text embedding is? Specifically for like sentence similarity and clustering?

I think that the MTEB leaderboard is super complex. I feel lost looking at it (what metric should I judge by?)