Hugging Face's logo

Anthonyg5005
/
shieldgemma-2b-exl2

Text Generation
ExLlama2
Model card Files Community
Anthonyg5005 commited on
Commit
5874f07
·
verified ·
1 Parent(s): 1c29c33

Add generated README

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md ADDED
@@ -0,0 +1,19 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: ExLlama2
3
+ pipeline_tag: text-generation
4
+ base_model: google/shieldgemma-2b
5
+ base_model_relation: quantized
6
+ ---
7
+
8
+ # Exl2 quants for [shieldgemma-2b](https://huggingface.co/google/shieldgemma-2b)
9
+
10
+ ## Automatically quantized using the auto quant script from [hf-scripts](https://huggingface.co/anthonyg5005/hf-scripts)
11
+
12
+ ### BPW:
13
+
14
+ [4.25](https://huggingface.co/Anthonyg5005/shieldgemma-2b-exl2/tree/4.25bpw)\
15
+ [5.0](https://huggingface.co/Anthonyg5005/shieldgemma-2b-exl2/tree/5.0bpw)\
16
+ [6.0](https://huggingface.co/Anthonyg5005/shieldgemma-2b-exl2/tree/6.0bpw)\
17
+ [6.5](https://huggingface.co/Anthonyg5005/shieldgemma-2b-exl2/tree/6.5bpw)\
18
+ [8.0](https://huggingface.co/Anthonyg5005/shieldgemma-2b-exl2/tree/8.0bpw)\
19
+ [measurement.json](https://huggingface.co/Anthonyg5005/shieldgemma-2b-exl2/blob/main/measurement.json)