Pietro Lesci PRO
pietrolesci
AI & ML interests
I like developing and applying causal methods to study the effect of training choices on models’ behaviour, including memorisation, shortcut learning, and tokenisation.
Recent Activity
updated
a collection
12 days ago
The Pile Companion
updated
a collection
12 days ago
The Pile Companion
updated
a dataset
12 days ago
InfoTokenizers/finewebedu-20B
Organizations
pietrolesci's activity
Domain and provenance annotation
9
#1 opened over 1 year ago
by
haukur
Trapezoidal scheduler with cooldown phase
1
3
#4 opened 10 months ago
by
maveriq

Tokenizer `merges.txt` files
3
#5 opened about 1 year ago
by
pietrolesci

Sequence "packing" logic
2
2
#2 opened over 1 year ago
by
pietrolesci

Pad-only sequences from mmap'ed dataset after a certain index
#1 opened over 1 year ago
by
pietrolesci

Add full sequences (beyond the first 64 tokens)
3
#1 opened over 1 year ago
by
pietrolesci

Add full sequences (beyond the first 64 tokens)
3
#1 opened over 1 year ago
by
pietrolesci

Domain and provenance annotation
9
#1 opened over 1 year ago
by
haukur