ISTA-DASLab
's Collections
Extreme Compression of Large Language Models via Additive Quantization
Paper
•
2401.06118
•
Published
•
12
ISTA-DASLab/Meta-Llama-3-70B-Instruct-AQLM-2Bit-1x16
Text Generation
•
Updated
•
150
•
20
ISTA-DASLab/Meta-Llama-3-70B-AQLM-2Bit-1x16
Text Generation
•
Updated
•
36
•
14
ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16
Text Generation
•
Updated
•
270
•
12
ISTA-DASLab/Meta-Llama-3-8B-AQLM-2Bit-1x16
Text Generation
•
Updated
•
806
•
7
ISTA-DASLab/c4ai-command-r-v01-AQLM-2Bit-1x16
Text Generation
•
Updated
•
19
•
10
ISTA-DASLab/c4ai-command-r-plus-AQLM-2Bit-1x16
Text Generation
•
Updated
•
19
•
10
ISTA-DASLab/Mixtral-8x7B-Instruct-v0_1-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
58
•
18
ISTA-DASLab/Mixtral-8x7b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
57
•
23
ISTA-DASLab/Mistral-7B-Instruct-v0.2-AQLM-2Bit-2x8
Text Generation
•
Updated
•
20
•
3
ISTA-DASLab/Mistral-7B-v0.1-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
23
•
2
ISTA-DASLab/gemma-2b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
34
•
6
ISTA-DASLab/gemma-2b-AQLM-2Bit-2x8-hf
Text Generation
•
Updated
•
33
•
4
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
9.8k
•
5
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-2x8-hf
Text Generation
•
Updated
•
36
•
2
ISTA-DASLab/Llama-2-7b-AQLM-2Bit-8x8-hf
Text Generation
•
Updated
•
29
ISTA-DASLab/Llama-2-13b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
27
ISTA-DASLab/Llama-2-13b-AQLM-4Bit-2x16-hf
Text Generation
•
Updated
•
14
ISTA-DASLab/Llama-2-70b-AQLM-2Bit-1x16-hf
Text Generation
•
Updated
•
27
•
6
ISTA-DASLab/Llama-2-70b-AQLM-2Bit-2x8-hf
Text Generation
•
Updated
•
21
•
1
ISTA-DASLab/Llama-2-70b-AQLM-4Bit-2x16-hf
Text Generation
•
Updated
•
8