CityGen: Infinite and Controllable 3D City Layout Generation
Jie Deng Wenhao Chai Jianshu Guo Qixuan Huang Wenhao Hu Jenq-Neng Hwang Gaoang Wang
City layout generation has recently gained significant attention. The goal of
this task is to automatically generate the layout of a city scene, including
elements such as roads, buildings, vegetation, as well as other urban
infrastructures. Previous methods using VAEs or GANs for 3D city layout
generation offer limited diversity and constrained interactivity, only allowing
users to selectively regenerate parts of the layout, which greatly limits
customization. In this paper, we propose CityGen, a novel end-to-end framework
for infinite, diverse and controllable 3D city layout generation.First, we
propose an outpainting pipeline to extend the local layout to an infinite city
layout. Then, we utilize a multi-scale diffusion model to generate diverse and
controllable local semantic layout patches. The extensive experiments show that
CityGen achieves state-of-the-art (SOTA) performance under FID and KID in
generating an infinite and controllable 3D city layout. CityGen demonstrates
promising applicability in fields like smart cities, urban planning, and
digital simulation.