Article
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
By
and 8 others
•
•
11Haihao Shen
Haihao
ilovesushiandkimchiandmalaxiangguo's profile picture
Agnuxo's profile picture
Cay0516's profile picture
·
AI & ML interests
LLM quantization, sparsity, and acceleration
Recent Activity
upvoted
an
article
about 20 hours ago
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
published
an
article
1 day ago
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
liked
a model
about 1 month ago
OPEA/gemma-3-27b-it-int4-AutoRound
Organizations
Haihao's activity
upvoted
an
article
about 20 hours ago
published
an
article
1 day ago
Article
Introducing AutoRound: Intel’s Advanced Quantization for LLMs and VLMs
By
and 8 others
•
•
11
liked
2
models
about 1 month ago
upvoted
a
paper
about 1 month ago
authored
a
paper
about 1 month ago
upvoted
a
collection
2 months ago
liked
a
model
2 months ago
liked
5
models
3 months ago
upvoted
a
paper
3 months ago
liked
a
model
4 months ago
reacted to
wenhuach's
post with 🚀
4 months ago
Post
345
This week, OPEA Space released several new INT4 models, including:
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
allenai/OLMo-2-1124-13B-Instruct
THUDM/glm-4v-9b
AIDC-AI/Marco-o1
and several others.
Let us know which models you'd like prioritized for quantization, and we'll do our best to make it happen!
OPEA
nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
allenai/OLMo-2-1124-13B-Instruct
THUDM/glm-4v-9b
AIDC-AI/Marco-o1
and several others.
Let us know which models you'd like prioritized for quantization, and we'll do our best to make it happen!
OPEA
- 3 replies
authored
a
paper
5 months ago
upvoted
a
paper
5 months ago
commented
a
paper
5 months ago
liked
a
model
5 months ago