LServe: Efficient Long-sequence LLM Serving with Unified Sparse Attention
Paper
•
2502.14866
•
Published
•
13
Shang Yang
Shangy
AI & ML interests
None yet
Recent Activity
updated
a dataset
28 days ago
mit-han-lab/awq-model-zoo
authored
a paper
3 months ago
AWQ: Activation-aware Weight Quantization for LLM Compression and
Acceleration
authored
a paper
3 months ago
QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM
Serving
Organizations
