float32 please!!!!

#3
by ctranslate2-4you - opened

Hello,

The original Exaone models are uploaded in float32. Can you upload all of the "deep" models also in float32, either just float32 or in addition to bfloat16?

The reason I ask is because if a person's GPU doesn't support bfloat16, and let's assume that they specify float16, there is a noticeable loss in accuracy.

Basically, converting from float32 to float16 is BETTER than converting from bfloat16 to float16.

If not on here, can you provide me another download link to float32 versions of these great "deep" models?

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment