fbaldassarri
/

meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-sym

Text Generation

intel-neural-compressor

neural-compressor

Model card Files Files and versions Community

meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-sym

Ctrl+K

Ctrl+K

1 contributor

History: 2 commits

fbaldassarri's picture

Initial Upload

85091c5 verified 4 days ago

.gitattributes

1.52 kB

initial commit 4 days ago
LICENSE.md

7.67 kB

Initial Upload 4 days ago
README.md

2.15 kB

Initial Upload 4 days ago
meta-llama_Llama-3.2-3B-Instruct-TEQ-int4-gs128-sym.py

13.5 kB

Initial Upload 4 days ago
qconfig.json

128 kB

Initial Upload 4 days ago
quantized_weight.pt
Detected Pickle imports (5)
- "torch.IntStorage",
- "torch.FloatStorage",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
3.25 GB
LFS

Initial Upload 4 days ago
requirements_conda_neural-compressor-3.3.1.txt

3.98 kB

Initial Upload 4 days ago