Error when using in KTransformers

by orca-zhang - opened 5 days ago

5 days ago

•

Exception: can't find blk.0.attn_kv_b.weight in GGUF file!

blk.0.attn_kv_b.weight exists in previous UD-Q2_K_XL

that separates into k_b v_b in UD 2.0

Unsloth AI org 2 days ago

@orca-zhang we reuploaded them. Can you check if it works now?

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment