max_sequence_length for onnx models

#3
by snarain7 - opened

What is the max sequence length for these deepseek-r1-distill onnx models?
At conversion time to ONNX, were the max sequence tokens set to 2048 or 4096?

and how is this max sequence tokens difference than max_length present in genai_config.json?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment