Alan Akbik

alanakbik

AI & ML interests

None yet

Recent Activity

updated a model about 2 months ago
flair/ner-multi
new activity about 2 months ago
flair/upos-multi:Upload pytorch_model.bin
new activity about 2 months ago
flair/ner-multi:Fix PosixPath error on Windows
View all activity

Organizations

flair's profile picture BigScience Workshop's profile picture

alanakbik's activity

New activity in flair/upos-multi about 2 months ago

Upload pytorch_model.bin

1
#4 opened about 2 months ago by
alanakbik
New activity in flair/ner-multi about 2 months ago

Fix PosixPath error on Windows

#2 opened about 2 months ago by
alanakbik
New activity in flair/ner-english 5 months ago
reacted to PatrickHaller's post with 🔥 12 months ago
view post
Post
1972
How Robust Is Your Model in Complex Code Generation Tasks? 🤔

We've launched the PECC benchmark to challenge chat models in code generation, drawing from the Advent of Code for programming tasks and the Euler Project for math-heavy challenges. This new task tests models with problems presented in both detailed prose and concise "leet code" styles, evaluating their ability to understand and solve complex coding issues and math problem in chat-based interactions.

It seems that the Claude 3 models outperforme ChatGPT:
Model / Avg. (pass@3)
Claude 3 Haiku / 27.67
GPT-3.5-Turbo / 23.75
Mixtral-8x22B-Instruct-v0.1 / 8.35

Read our Preprint📃: PECC: Problem Extraction and Coding Challenges (2404.18766)
Look at the dataset🔎: PatrickHaller/pecc

We also got accepted at LREC-COLING '24 🎉
New activity in flair/upos-multi about 1 year ago

Update Model

3
#3 opened about 1 year ago by
stefan-it
New activity in flair/pos-english over 1 year ago

What tokenizer is best?

1
#2 opened over 1 year ago by
turian
New activity in flair/ner-english-ontonotes-large over 1 year ago

Error

8
#2 opened over 1 year ago by
vpkprasanna