6 5 8

Kai Chen

KaiChen1998

https://kaichen1998.github.io/

AI & ML interests

Omni-modal Large Language Models & Controllable Visual World Modeling & Autonomous Driving

Recent Activity

liked a model about 4 hours ago

Emova-ollm/emova_speech_tokenizer_hf

liked a model about 4 hours ago

Emova-ollm/emova-qwen-2-5-72b-hf

liked a model about 4 hours ago

Emova-ollm/emova-qwen-2-5-72b

View all activity

Organizations

KaiChen1998's activity

liked 7 models about 4 hours ago

upvoted 2 collections about 9 hours ago

EMOVA-Datasets

Collection

A collection of EMOVA datasets (https://emova-ollm.github.io/) • 6 items • Updated 2 days ago • 2

EMOVA-Models

Collection

A collection of EMOVA models (https://emova-ollm.github.io/) • 11 items • Updated 2 days ago • 2

posted an update 1 day ago

Post

1479

📢 Our EMOVA paper has been accepted by CVPR 2025, and we are glad to release all resources, including code (training & inference), datasets (training & evaluation), and checkpoints (EMOVA-3B/7B/72B)!

🤗 EMOVA is a novel end-to-end omni-modal LLM that can see, hear and speak. Given omni-modal (i.e., textual, visual and speech) inputs, EMOVA can generate both textual and speech responses with vivid emotional controls by utilizing the speech decoder and a style controller.

✨ EMOVA Highlights
✅ State-of-the-art omni-modality: EMOVA achieves SoTA comparable results on both vision-language and speech benchmarks simultaneously.
✅ Device adaptation: our codebase supports training/inference on both NVIDIA GPUs (e.g., A800 & H20) and Ascend NPUs (e.g., 910B3)!
✅ Modular design: we integrate multiple implementations of vision encoder, vision projector, and language model, even including the most recent DeepSeekMoE-tiny!

🔥 You are all welcome to try and star!
- Project page: https://emova-ollm.github.io/
- Github: https://github.com/emova-ollm/EMOVA
- Demo: Emova-ollm/EMOVA-demo