Qwen2.5-7B-ko-quant-merge-v2 / mergekit_config.yml
vitus9988's picture
Upload folder using huggingface_hub
4f6be5a verified
raw
history blame contribute delete
356 Bytes
models:
- model: Qwen2.5-7B-merge-it-lora
parameters:
density: 1
weight: 1
- model: Qwen/Qwen2.5-7B-Instruct
parameters:
density: 1
weight: 1
merge_method: ties
base_model: Qwen/Qwen2.5-7B
parameters:
int8_mask: true
nomalize: true
weight: 1
density: 1
tokenizer_source: Qwen2.5-7B-merge-it-lora
dtype: bfloat16