Hugging Face's logo

YokaiKoibito
/
falcon-40b-GGML

Transformers
falcon
text-generation-inference
Model card Files Community
root commited on
Commit
529186c
·
1 Parent(s): c5f5685

Quantized files

Browse files
Files changed (4) hide show
  1. falcon-40b-GGML.ggccv1.q4_k.bin +3 -0
  2. falcon-40b-GGML.ggccv1.q5_k.bin +3 -0
  3. falcon-40b-GGML.ggccv1.q6_k.bin +3 -0
  4. falcon-40b-GGML.ggccv1.q8_0.bin +3 -0
falcon-40b-GGML.ggccv1.q4_k.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd87aaa2cd069fa8e00a5b57952a2f9cba6445494acf4bf58600481c5ecf4131
3
+ size 23541488384
falcon-40b-GGML.ggccv1.q5_k.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:109b869d50e1bc58853022dac28a49c7bc9cf790fb443e41e5231be55ef76143
3
+ size 28770736896
falcon-40b-GGML.ggccv1.q6_k.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c351e23e3d88ba0ebbeb6fffd742e94b4879ef1d34153b57948db5a6262ad15
3
+ size 34326813440
falcon-40b-GGML.ggccv1.q8_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed33f6b0f6fa901820a6122532c3814fc156b7c5ba5005c6e236d8b3859a13fd
3
+ size 44458482432