runtime error
Exit code: 1. Reason: .model.layers.31.self_attn.v_proj.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn( /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2397: UserWarning: for base_model.model.model.layers.31.self_attn.dense.lora_A.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn( /usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py:2397: UserWarning: for base_model.model.model.layers.31.self_attn.dense.lora_B.default.weight: copying from a non-meta parameter in the checkpoint to a meta parameter in the current model, which is a no-op. (Did you mean to pass `assign=True` to assign items in the state dictionary to their corresponding key in the module instead of copying them in place?) warnings.warn( Traceback (most recent call last): File "/home/user/app/app.py", line 287, in <module> interface = create_interface() File "/home/user/app/app.py", line 190, in create_interface model = VLMInference() File "/home/user/app/app.py", line 49, in __init__ self.language_model = PeftModel.from_pretrained( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 541, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1327, in load_adapter self._update_offload(offload_index, adapters_weights) File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1151, in _update_offload safe_module = dict(self.named_modules())[extended_prefix] KeyError: 'base_model.model.model.model.embed_tokens'
Container logs:
Fetching error logs...