Within the Dynamic Context: Inertia-aware 3D Human Modeling with Pose
  Sequence
Yutong Chen Yifan Zhan Zhihang Zhong Wei Wang Xiao Sun Yu Qiao Yinqiang Zheng
Neural rendering techniques have significantly advanced 3D human body
modeling. However, previous approaches often overlook dynamics induced by
factors such as motion inertia, leading to challenges in scenarios like abrupt
stops after rotation, where the pose remains static while the appearance
changes. This limitation arises from reliance on a single pose as conditional
input, resulting in ambiguity in mapping one pose to multiple appearances. In
this study, we elucidate that variations in human appearance depend not only on
the current frame's pose condition but also on past pose states. Therefore, we
introduce Dyco, a novel method utilizing the delta pose sequence representation
for non-rigid deformations and canonical space to effectively model temporal
appearance variations. To prevent a decrease in the model's generalization
ability to novel poses, we further propose low-dimensional global context to
reduce unnecessary inter-body part dependencies and a quantization operation to
mitigate overfitting of the delta pose sequence by the model. To validate the
effectiveness of our approach, we collected a novel dataset named I3D-Human,
with a focus on capturing temporal changes in clothing appearance under
approximate poses. Through extensive experiments on both I3D-Human and existing
datasets, our approach demonstrates superior qualitative and quantitative
performance. In addition, our inertia-aware 3D human method can unprecedentedly
simulate appearance changes caused by inertia at different velocities.