Elfsong's picture
Upload merged Qwen2.5-3B-Instruct with DPO fine-tuned LoRA
aa6d099 verified