Hugging Face's logo

baichuan-inc
/
Baichuan2-13B-Chat

Text Generation
Transformers
PyTorch
English
Chinese
baichuan
custom_code
text-generation-inference
Inference Endpoints
Model card Files Community
41

update modeling_baichuan.py for torchscript mode with past_kv

#30
by changwangss - opened
base: refs/heads/main
←
from: refs/pr/30
Discussion Files changed
+4
-2
changwangss

to enable model inference with use_cache and return_dict from model.config.

update modeling_baichuan.py for torchscript mode with past_kvec80a0ad
Ready to merge
This branch is ready to get merged automatically.
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment