How to use 3 MTPs?

#4
by Yi30 - opened

May I know how to use 3 MTPs?
I tried it with num_speculative_tokens=3, but failed.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment