machi's picture

15

machi

pkumc

·

AI & ML interests

None yet

Recent Activity

new activity 23 days ago

meituan/DeepSeek-R1-Channel-INT8:Difference with Block-wise Int8?

new activity 23 days ago

meituan/DeepSeek-R1-Block-INT8:How about deepseek v3 model?

new activity 23 days ago

meituan/DeepSeek-R1-Block-INT8:sglang和vllm运行目前不支持blockwise_int8

View all activity

Organizations

pkumc's activity

New activity in meituan/DeepSeek-R1-Channel-INT8 23 days ago

Difference with Block-wise Int8?

#1 opened about 1 month ago by

New activity in meituan/DeepSeek-R1-Block-INT8 23 days ago

How about deepseek v3 model?

#15 opened 27 days ago by

sglang和vllm运行目前不支持blockwise_int8

#12 opened about 1 month ago by

量化类型

#11 opened about 1 month ago by

Why hasn't the model file size changed?

#9 opened about 1 month ago by

New activity in meituan/DeepSeek-R1-Block-INT8 about 1 month ago

Update README.md

#10 opened about 1 month ago by

New activity in meituan/DeepSeek-R1-Channel-INT8 about 1 month ago

Update README.md

#2 opened about 1 month ago by

New activity in meituan/DeepSeek-R1-Block-INT8 about 1 month ago

Update README.md

#8 opened about 1 month ago by

Update inference/bf16_cast_block_int8.py

#7 opened about 1 month ago by

Update README.md

#6 opened about 1 month ago by

Update README.md

#5 opened about 1 month ago by

Update README.md

#3 opened about 1 month ago by

Update README.md

#2 opened about 1 month ago by

Update README.md

#1 opened about 1 month ago by

New activity in Qwen/Qwen1.5-MoE-A2.7B 12 months ago

Why is there only one shared expert in the code?

#4 opened about 1 year ago by