DOrA: 3D Visual Grounding with Order-Aware Referring
Tung-Yu Wu Sheng-Yu Huang Yu-Chiang Frank Wang
3D visual grounding aims to identify the target object within a 3D point
cloud scene referred to by a natural language description. While previous works
attempt to exploit the verbo-visual relation with proposed cross-modal
transformers, unstructured natural utterances and scattered objects might lead
to undesirable performances. In this paper, we introduce DOrA, a novel 3D
visual grounding framework with Order-Aware referring. DOrA is designed to
leverage Large Language Models (LLMs) to parse language description, suggesting
a referential order of anchor objects. Such ordered anchor objects allow DOrA
to update visual features and locate the target object during the grounding
process. Experimental results on the NR3D and ScanRefer datasets demonstrate
our superiority in both low-resource and full-data scenarios. In particular,
DOrA surpasses current state-of-the-art frameworks by 9.3% and 7.8% grounding
accuracy under 1% data and 10% data settings, respectively.