lm-evaluation-harness tasks?
#3
by
dipta007
- opened
In the paper, it was mentioned that lm-evaluation-harness was used to evaluate.
Did you guys add the task in the lm-evaluation-harness repo or do you have any fork of the repo, so that we can use the same (prompt, scoring) in our paper for fair comparison?
Thanks
Yes, here is the fork repo that contains the task.
https://github.com/hishab-nlp/lm-evaluation-harness/tree/main