Low-latency Space-time Supersampling for Real-time Rendering
Ruian He Shili Zhou Yuqi Sun Ri Cheng Weimin Tan Bo Yan
With the rise of real-time rendering and the evolution of display devices,
there is a growing demand for post-processing methods that offer
high-resolution content in a high frame rate. Existing techniques often suffer
from quality and latency issues due to the disjointed treatment of frame
supersampling and extrapolation. In this paper, we recognize the shared context
and mechanisms between frame supersampling and extrapolation, and present a
novel framework, Space-time Supersampling (STSS). By integrating them into a
unified framework, STSS can improve the overall quality with lower latency. To
implement an efficient architecture, we treat the aliasing and warping holes
unified as reshading regions and put forth two key components to compensate the
regions, namely Random Reshading Masking (RRM) and Efficient Reshading Module
(ERM). Extensive experiments demonstrate that our approach achieves superior
visual fidelity compared to state-of-the-art (SOTA) methods. Notably, the
performance is achieved within only 4ms, saving up to 75\% of time against the
conventional two-stage pipeline that necessitates 17ms.