Spaces:
Running
Running
What is the testing prompt?
#23
by
zhiminy
- opened
To ensure all results are reproducible to some extent...Is that this one?
https://github.com/huggingface/optimum-benchmark/blob/f75d9f93bb14ed56058f4c70ae4670b6cf3a8ed1/examples/running-llamas/README.md
yes since we're only measuring latency, throughput, etc, the only information about the input that's necessary for reproduction is shape and number of generated tokens.
IlyasMoutawwakil
changed discussion status to
closed