Vision-Assisted Digital Twin Creation for mmWave Beam Management
Maximilian Arnold Bence Major Fabio Valerio Massoli Joseph B. Soriaga Arash Behboodi
In the context of communication networks, digital twin technology provides a
means to replicate the radio frequency (RF) propagation environment as well as
the system behaviour, allowing for a way to optimize the performance of a
deployed system based on simulations. One of the key challenges in the
application of Digital Twin technology to mmWave systems is the prevalent
channel simulators' stringent requirements on the accuracy of the 3D Digital
Twin, reducing the feasibility of the technology in real applications. We
propose a practical Digital Twin creation pipeline and a channel simulator,
that relies only on a single mounted camera and position information. We
demonstrate the performance benefits compared to methods that do not explicitly
model the 3D environment, on downstream sub-tasks in beam acquisition, using
the real-world dataset of the DeepSense6G challenge