metadata
language:
- en
license: apache-2.0
tags:
- autoround
- quantized
- 4bit
AutoRound 4-bit Quantized Model
This is a 4-bit quantized version of jjeccles/combined-filtercompressedthink-documentnohours-merged created using AutoRound.
Quantization Parameters
- Bits: 4
- Group Size: 128
- Symmetric: False
- Samples: 512
- Iterations: 1000