Scripts to quantize the model

by mohitsha HF staff - opened May 29, 2024

May 29, 2024

•

@wangfangyuan @zhengrongzhang could you please share the scripts to quantise the model. I would like to quantize other models similarly.

mohitsha changed discussion status to closed May 29, 2024

mohitsha changed discussion status to open May 29, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment