File size: 173 Bytes
99641d5
 
 
91f8c04
 
99641d5
1
2
3
4
5
6
7
{
  "bos_token": "<|rwkv_tokenizer_end_of_text|>",
  "eos_token": "\n\n",
  "unk_token": "<|rwkv_tokenizer_end_of_text|>",
  "pad_token": "<|rwkv_tokenizer_end_of_text|>"
}