Neural Implicit Field Editing Considering Object-environment Interaction
Zhihong Zeng Zongji Wang Yuanben Zhang Weinan Cai Zehao Cao Lili Zhang Yan Guo Yanhong Zhang Junyi Liu
The 3D scene editing method based on neural implicit field has gained wide
attention. It has achieved excellent results in 3D editing tasks. However,
existing methods often blend the interaction between objects and scene
environment. The change of scene appearance like shadows is failed to be
displayed in the rendering view. In this paper, we propose an Object and Scene
environment Interaction aware (OSI-aware) system, which is a novel two-stream
neural rendering system considering object and scene environment interaction.
To obtain illuminating conditions from the mixture soup, the system
successfully separates the interaction between objects and scene environment by
intrinsic decomposition method. To study the corresponding changes to the scene
appearance from object-level editing tasks, we introduce a depth map guided
scene inpainting method and shadow rendering method by point matching strategy.
Extensive experiments demonstrate that our novel pipeline produce reasonable
appearance changes in scene editing tasks. It also achieve competitive
performance for the rendering quality in novel-view synthesis tasks.