new-not-entertainment / added_tokens.json
ahebbar69's picture
Upload tokenizer
1923acd verified
raw
history blame contribute delete
21 Bytes
{
"<pad>": 32000
}