Consolidated safetensors

#60

by Aktsvigun - opened 24 days ago

24 days ago

Hi @patrickvonplaten , could you please tell me how you saved the model into consolidated.safetensors? My vllm==0.8.3 can only load the model if saved to consolidated.safetensors - it cannot load this model from shared checkpoints.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment