unsloth

/

gemma-3-4b-it-bnb-4bit

like 6

Follow

Unsloth AI 5.37k

I am trying to deploy this model into a sagemaker endpoint and I have run into the following error:
AssertionError: [5242880, 1] != [4096, 2560]

I think this is due to some reshaping of the matrices inside the model.
What would be a fix on my side? or on your side