Exl2 quants for shieldgemma-2b
Automatically quantized using the auto quant script from hf-scripts
BPW:
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The HF Inference API does not support text-generation models for ExLlama2 library.
Model tree for Anthonyg5005/shieldgemma-2b-exl2
Base model
google/shieldgemma-2b