English
Related papers

Related papers: MA3DSG: Multi-Agent 3D Scene Graph Generation for …

200 papers

Compositional 3D scene synthesis has diverse applications across a spectrum of industries such as robotics, films, and video games, as it closely mirrors the complexity of real-world multi-object environments. Conventional works typically…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Yao Wei , Martin Renqiang Min , George Vosselman , Li Erran Li , Michael Ying Yang

Aligning 3D scene graphs is a crucial initial step for several applications in robot navigation and embodied perception. Current methods in 3D scene graph alignment often rely on single-modality point cloud data and struggle with incomplete…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Binod Singh , Sayan Deb Sarkar , Iro Armeni

Methods that synthesize indoor 3D scenes from text prompts have wide-ranging applications in film production, interior design, video games, virtual reality, and synthetic data generation for training embodied agents. Existing approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Antonio Ruiz , Tao Wu , Andrew Melnik , Qing Cheng , Xuqin Wang , Lu Liu , Yongliang Wang , Yanfeng Zhang , Helge Ritter

Creating high-fidelity 3D models of indoor environments is essential for applications in design, virtual reality, and robotics. However, manual 3D modeling remains time-consuming and labor-intensive. While recent advances in generative AI…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Chuan Fang , Heng Li , Yixun Liang , Jia Zheng , Yongsen Mao , Yuan Liu , Rui Tang , Zihan Zhou , Ping Tan

This paper investigates an open research challenge of reconstructing high-quality, large 3D open scenes from images. It is observed existing methods have various limitations, such as requiring precise camera poses for input and dense…

Computer Vision and Pattern Recognition · Computer Science 2025-02-25 Chong Cheng , Gaochao Song , Yiyang Yao , Qinzheng Zhou , Gangjian Zhang , Hao Wang

This paper presents a novel generative approach that outputs 3D indoor environments solely from a textual description of the scene. Current methods often treat scene synthesis as a mere layout prediction task, leading to rooms with…

Machine Learning · Computer Science 2025-02-12 Yao Wei , Matteo Toso , Pietro Morerio , Michael Ying Yang , Alessio Del Bue

Controllable 3D scene generation has extensive applications in virtual reality and interior design, where the generated scenes should exhibit high levels of realism and controllability in terms of geometry. Scene graphs provide a suitable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Zhifei Yang , Keyang Lu , Chao Zhang , Jiaxing Qi , Hanqi Jiang , Ruifei Ma , Shenglin Yin , Yifan Xu , Mingzhe Xing , Zhen Xiao , Jieyi Long , Guangyao Zhai

Recent advances in Large Language Models (LLMs) have helped facilitate exciting progress for robotic planning in real, open-world environments. 3D scene graphs (3DSGs) offer a promising environment representation for grounding such…

Robotics · Computer Science 2024-11-01 Meghan Booker , Grayson Byrd , Bethany Kemp , Aurora Schmidt , Corban Rivera

Open-vocabulary 3D Scene Graph (3DSG) can enhance various downstream tasks in robotics by leveraging structured semantic representations, yet current 3DSG construction methods suffer from semantic inconsistencies caused by noisy cross-image…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Yue Chang , Rufeng Chen , Zhaofan Zhang , Yi Chen , Yifan Tian , Sihong Xie

We investigate multi-agent navigation tasks, where multiple agents need to reach initially unassigned goals in a limited time. Classical planning-based methods suffer from expensive computation overhead at each step and offer limited…

Machine Learning · Computer Science 2024-12-03 Xinyi Yang , Xinting Yang , Chao Yu , Jiayu Chen , Wenbo Ding , Huazhong Yang , Yu Wang

Synthesizing realistic and diverse indoor 3D scene layouts in a controllable fashion opens up applications in simulated navigation and virtual reality. As concise and robust representations of a scene, scene graphs have proven to be…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Pietro Bonazzi , Mengqi Wang , Diego Martin Arroyo , Fabian Manhardt , Nico Messikomer , Federico Tombari , Davide Scaramuzza

Scene understanding has been of high interest in computer vision. It encompasses not only identifying objects in a scene, but also their relationships within the given context. With this goal, a recent line of works tackles 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Johanna Wald , Helisa Dhamo , Nassir Navab , Federico Tombari

Generating realistic and controllable traffic scenes from natural language can greatly enhance the development and evaluation of autonomous driving systems. However, this task poses unique challenges: (1) grounding free-form text into…

Robotics · Computer Science 2026-03-27 Bo-Kai Ruan , Hao-Tang Tsui , Yung-Hui Li , Hong-Han Shuai

Scene graph alignment establishes object correspondences between two 3D scene graphs constructed from partially overlapping observations. This enables efficient scene understanding and object-level relocalization when a robot revisits a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Gang Chen , Sebastián Barbas Laina , Stefan Leutenegger , Javier Alonso-Mora

Generating 3D scenes from human motion sequences supports numerous applications, including virtual reality and architectural design. However, previous auto-regression-based human-aware 3D scene generation methods have struggled to…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xiaolin Hong , Hongwei Yi , Fazhi He , Qiong Cao

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges…

Machine Learning · Computer Science 2021-02-24 Ngoc Duy Nguyen , Thanh Thi Nguyen , Doug Creighton , Saeid Nahavandi

Recent advances in 3D scene generation produce visually appealing output, but current representations hinder artists' workflows that require modifiable 3D textured mesh scenes for visual effects and game development. Despite significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Tobias Sautter , Jan-Niklas Dihlmann , Hendrik P. A. Lensch

Ranking is a fundamental and widely studied problem in scenarios such as search, advertising, and recommendation. However, joint optimization for multi-scenario ranking, which aims to improve the overall performance of several ranking…

Artificial Intelligence · Computer Science 2018-09-18 Jun Feng , Heng Li , Minlie Huang , Shichen Liu , Wenwu Ou , Zhirong Wang , Xiaoyan Zhu

Understanding 3D scenes in open-world settings poses fundamental challenges for vision and robotics, particularly due to the limitations of closed-vocabulary supervision and static annotations. To address this, we propose a unified…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Fei Yu , Quan Deng , Shengeng Tang , Yuehua Li , Lechao Cheng

As an agent-level reasoning and coordination paradigm, Multi-Agent Debate (MAD) orchestrates multiple agents through structured debate to improve answer quality and support complex reasoning. However, existing research on MAD suffers from…

Artificial Intelligence · Computer Science 2026-01-07 Ao Li , Jinghui Zhang , Luyu Li , Yuxiang Duan , Lang Gao , Mingcai Chen , Weijun Qin , Shaopeng Li , Fengxian Ji , Ning Liu , Lizhen Cui , Xiuying Chen , Yuntao Du