README.md

metadata

library_name: ExLlama2
pipeline_tag: text-generation
base_model: google/shieldgemma-2b
base_model_relation: quantized

Exl2 quants for shieldgemma-2b

Automatically quantized using the auto quant script from hf-scripts

BPW:

4.25
5.0
6.0
6.5
8.0
measurement.json