Configuration Parsing
Warning:
In config.json: "quantization_config.bits" must be an integer
Qwen2.5-Coder-0.5B-QwQ-draft
A draft model trained for Qwen/QwQ-32B-Preview
- vocabulary size of 152064, same as QwQ-32B-Preview (can be used in VLLM directly without any hack)
- trained from Qwen/Qwen2.5-Coder-0.5B-Instruct
- on PowerInfer/QWQ-LONGCOT-500K 2 epochs
- draft acceptance rate above 0.8
- up to x2.5 token speed in math problems (33 toks/s vs. 85 toks/s)
- Downloads last month
- 2
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for async0x42/Qwen2.5-Coder-0.5B-QwQ-draft-exl2_4.65bpw
Base model
Qwen/Qwen2.5-0.5B
Finetuned
Qwen/Qwen2.5-Coder-0.5B
Finetuned
Qwen/Qwen2.5-Coder-0.5B-Instruct