English
Related papers

Related papers: Collaborative Dynamic 3D Scene Graphs for Open-Voc…

200 papers

For a multi-robot team that collaboratively explores an unknown environment, it is of vital importance that collected information is efficiently shared among robots in order to support exploration and navigation tasks. Practical constraints…

Robotics · Computer Science 2025-02-11 Yun Chang , Luca Ballotta , Luca Carlone

We propose Graph2Nav, a real-time 3D object-relation graph generation framework, for autonomous navigation in the real world. Our framework fully generates and exploits both 3D objects and a rich set of semantic relationships among objects…

Robotics · Computer Science 2025-04-24 Tixiao Shan , Abhinav Rajvanshi , Niluthpol Mithun , Han-Pang Chiu

The capability for open vocabulary perception represents a significant advancement in autonomous driving systems, facilitating the comprehension and interpretation of a wide array of textual inputs in real-time. Despite extensive research…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Xinlong Cheng , Lei Li

A fundamental aspect for building intelligent autonomous robots that can assist humans in their daily lives is the construction of rich environmental representations. While advances in semantic scene representations have enriched robotic…

Robotics · Computer Science 2026-02-17 Phuoc Nguyen , Francesco Verdoja , Ville Kyrki

We present a novel approach called Optimized Directed Roadmap Graph (ODRM). It is a method to build a directed roadmap graph that allows for collision avoidance in multi-robot navigation. This is a highly relevant problem, for example for…

Robotics · Computer Science 2025-04-25 Christian Henkel , Marc Toussaint

The development of embodied agents that can communicate with humans in natural language has gained increasing interest over the last years, as it facilitates the diffusion of robotic platforms in human-populated environments. As a step…

Robotics · Computer Science 2024-04-16 Roberto Bigazzi , Marcella Cornia , Silvia Cascianelli , Lorenzo Baraldi , Rita Cucchiara

We present an efficient neural 3D scene representation for novel-view synthesis (NVS) in large-scale, dynamic urban areas. Existing works are not well suited for applications like mixed-reality or closed-loop simulation due to their limited…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tobias Fischer , Jonas Kulhanek , Samuel Rota Bulò , Lorenzo Porzi , Marc Pollefeys , Peter Kontschieder

In daily domestic settings, frequently used objects like cups often have unfixed positions and multiple instances within the same category, and their carriers frequently change as well. As a result, it becomes challenging for a robot to…

Robotics · Computer Science 2025-01-09 Yujie Tang , Meiling Wang , Yinan Deng , Zibo Zheng , Jingchuan Deng , Yufeng Yue

The connection between our 3D surroundings and the descriptive language that characterizes them would be well-suited for localizing and generating human motion in context but for one problem. The complexity introduced by multiple modalities…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Zoltán Á. Milacski , Koichiro Niinuma , Ryosuke Kawamura , Fernando de la Torre , László A. Jeni

Understanding driving scenes and communicating automated vehicle decisions are key requirements for trustworthy automated driving. In this article, we introduce the Qualitative Explainable Graph (QXG), which is a unified symbolic and…

Artificial Intelligence · Computer Science 2024-03-26 Nassim Belmecheri , Arnaud Gotlieb , Nadjib Lazaar , Helge Spieker

A comprehensive semantic understanding of a scene is important for many applications - but in what space should diverse semantic information (e.g., objects, scene categories, material types, texture, etc.) be grounded and what should be its…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Iro Armeni , Zhi-Yang He , JunYoung Gwak , Amir R. Zamir , Martin Fischer , Jitendra Malik , Silvio Savarese

Open-vocabulary scene understanding using 3D Gaussian (3DGS) representations has garnered considerable attention. However, existing methods mostly lift knowledge from large 2D vision models into 3DGS on a scene-by-scene basis, restricting…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Runnan Chen , Xiangyu Sun , Zhaoqing Wang , Youquan Liu , Jiepeng Wang , Lingdong Kong , Jiankang Deng , Mingming Gong , Liang Pan , Wenping Wang , Tongliang Liu

Reconstructing dynamic scenes from Vehicle-to-Infrastructure Cooperative Autonomous Driving (VICAD) data is fundamentally complicated by temporal asynchrony: vehicle and infrastructure cameras operate on independent clocks, capturing the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yulong Chen , Xiaoyun Dong , Haoyu Zhang , Zongxian Yang , Lewei Xie , Xinke Li , Yifan Zhang , Kai Wang , Jianping Wang

We present FRUC, a feed-forward 3D Gaussian splatting framework for dynamic scene reconstruction from uncalibrated collaborative driving views. Existing multi-agent reconstruction frameworks are often hindered by rigid prerequisites,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihang Tao , Yu Guo , Zhengru Fang , Haonan An , Yuguang Fang

In dynamic scenes, both localization and mapping in visual SLAM face significant challenges. In recent years, numerous outstanding research works have proposed effective solutions for the localization problem. However, there has been a…

Robotics · Computer Science 2023-09-25 Xinggang Hu

In robotics, the effective integration of environmental data into actionable knowledge remains a significant challenge due to the variety and incompatibility of data formats commonly used in scene descriptions, such as MJCF, URDF, and SDF.…

Robotics · Computer Science 2025-07-17 Giang Nguyen , Mihai Pomarlan , Sascha Jongebloed , Nils Leusmann , Minh Nhat Vu , Michael Beetz

This paper aims to tackle the problem of modeling dynamic urban streets for autonomous driving scenes. Recent methods extend NeRF by incorporating tracked vehicle poses to animate vehicles, enabling photo-realistic view synthesis of dynamic…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Yunzhi Yan , Haotong Lin , Chenxu Zhou , Weijie Wang , Haiyang Sun , Kun Zhan , Xianpeng Lang , Xiaowei Zhou , Sida Peng

Creating and maintaining an accurate representation of the environment is an essential capability for every service robot. Especially for household robots acting in indoor environments, semantic information is important. In this paper, we…

Robotics · Computer Science 2025-01-09 Nils Dengler , Tobias Zaenker , Francesco Verdoja , Maren Bennewitz

To autonomously navigate in real-world environments, special in search and rescue operations, Unmanned Aerial Vehicles (UAVs) necessitate comprehensive maps to ensure safety. However, the prevalent metric map often lacks semantic…

Robotics · Computer Science 2024-01-17 Thanh Nguyen Canh , Armagan Elibol , Nak Young Chong , Xiem HoangVan

Real-time open-vocabulary scene understanding is essential for efficient 3D perception in applications such as vision-language navigation, embodied intelligence, and augmented reality. However, existing methods suffer from imprecise…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Xiaofeng Jin , Matteo Frosi , Matteo Matteucci