cerebras-gpt-111m_med_tw / added_tokens.json
Sheng08's picture
Upload tokenizer
cf18d7e
raw
history blame contribute delete
51 Bytes
{
"<|pad|>": 50258,
"<|startoftext|>": 50257
}