English
Related papers

Related papers: Modernising Reinforcement Learning-Based Navigatio…

200 papers

Autonomous navigation is a fundamental task for robot vacuum cleaners in indoor environments. Since their core function is to clean entire areas, robots inevitably encounter dead zones in cluttered and narrow scenarios. Existing planning…

Robotics · Computer Science 2025-03-06 Han Zheng , Jiale Zhang , Mingyang Jiang , Peiyuan Liu , Danni Liu , Tong Qin , Ming Yang

To operate effectively in the real world, agents should be able to act from high-dimensional raw sensory input such as images and achieve diverse goals across long time-horizons. Current deep reinforcement and imitation learning methods can…

Machine Learning · Computer Science 2020-11-16 Scott Emmons , Ajay Jain , Michael Laskin , Thanard Kurutach , Pieter Abbeel , Deepak Pathak

Robust robot planning in dynamic, human-centric environments remains challenging due to multimodal uncertainty, the need for real-time adaptation, and safety requirements. Optimization-based planners enable explicit constraint handling but…

Robotics · Computer Science 2026-03-24 Kazuki Mizuta , Karen Leung

Embodied navigation agents built upon large reasoning models (LRMs) can handle complex, multimodal environmental input and perform grounded reasoning per step to improve sequential decision-making for long-horizon tasks. However, a critical…

Artificial Intelligence · Computer Science 2026-04-10 He Zhao , Yijun Yang , Zichuan Lin , Deheng Ye , Chunyan Miao

In this paper, we introduce the Semantic Environment Atlas (SEA), a novel mapping approach designed to enhance visual navigation capabilities of embodied agents. The SEA utilizes semantic graph maps that intricately delineate the…

Artificial Intelligence · Computer Science 2024-10-15 Nuri Kim , Jeongho Park , Mineui Hong , Songhwai Oh

Understanding human instructions and accomplishing Vision-Language Navigation tasks in unknown environments is essential for robots. However, existing modular approaches heavily rely on the quality of training data and often exhibit poor…

Robotics · Computer Science 2025-09-30 Yao Wang , Zhirui Sun , Wenzheng Chi , Baozhi Jia , Wenjun Xu , Jiankun Wang

Camera-based 3D semantic scene completion (SSC) provides dense geometric and semantic perception for autonomous driving and robotic navigation. However, existing methods rely on a coupled encoder to deliver both semantic and geometric…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Shiyuan Chen , Wei Sui , Bohao Zhang , Zeyd Boukhers , John See , Cong Yang

When humans perform everyday tasks, we naturally adjust our actions based on the current state of the environment. For instance, if we intend to put something into a drawer but notice it is closed, we open it first. However, many autonomous…

Robotics · Computer Science 2025-08-18 Che Rin Yu , Daewon Chae , Dabin Seo , Sangwon Lee , Hyeongwoo Im , Jinkyu Kim

Visual navigation requires the robot to reach a specified goal such as an image, based on a sequence of first-person visual observations. While recent learning-based approaches have made significant progress, they often focus on improving…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Hao Ren , Zetong Bi , Yiming Zeng , Zhaoliang Wan , Lu Qi , Hui Cheng

Deep learning techniques have led to remarkable breakthroughs in the field of generic object detection and have spawned a lot of scene-understanding tasks in recent years. Scene graph has been the focus of research because of its powerful…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Guangming Zhu , Liang Zhang , Youliang Jiang , Yixuan Dang , Haoran Hou , Peiyi Shen , Mingtao Feng , Xia Zhao , Qiguang Miao , Syed Afaq Ali Shah , Mohammed Bennamoun

Camera-based 3D Semantic Scene Completion (SSC) is a critical task in autonomous driving systems, assessing voxel-level geometry and semantics for holistic scene perception. While existing voxel-based and plane-based SSC methods have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Zhiwen Yang , Yuxin Peng

In autonomous driving, accurately interpreting the movements of other road users and leveraging this knowledge to forecast future trajectories is crucial. This is typically achieved through the integration of map data and tracked…

Robotics · Computer Science 2024-05-17 Tobias Demmler , Andreas Tamke , Thao Dang , Karsten Haug , Lars Mikelsons

We present a novel method for generating, predicting, and using Spatiotemporal Occupancy Grid Maps (SOGM), which embed future information of dynamic scenes. Our automated generation process creates groundtruth SOGMs from previous navigation…

Robotics · Computer Science 2021-09-17 Hugues Thomas , Matthieu Gallet de Saint Aurin , Jian Zhang , Timothy D. Barfoot

Knowledge graph completion demands effective modeling of multifaceted semantic relationships between entities. Yet, prevailing methods, which rely on static scoring functions over learned embeddings, struggling to simultaneously capture…

Computation and Language · Computer Science 2025-09-03 Siyuan Li , Ruitong Liu , Yan Wen , Te Sun , Andi Zhang , Yanbiao Ma , Xiaoshuai Hao

Reinforcement learning is a promising paradigm for solving sequential decision-making problems, but low data efficiency and weak generalization across tasks are bottlenecks in real-world applications. Model-based meta reinforcement learning…

Machine Learning · Computer Science 2021-02-17 Qi Wang , Herke van Hoof

3D semantic scene graphs are a powerful holistic representation as they describe the individual objects and depict the relation between them. They are compact high-level graphs that enable many tasks requiring scene reasoning. In real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Shun-Cheng Wu , Keisuke Tateno , Nassir Navab , Federico Tombari

Enabling embodied agents to imagine future states is essential for robust and generalizable visual navigation. Yet, state-of-the-art systems typically rely on modular designs that decouple navigation planning from visual world modeling,…

Artificial Intelligence · Computer Science 2026-03-24 Yifei Dong , Fengyi Wu , Guangyu Chen , Lingdong Kong , Xu Zhu , Qiyu Hu , Yuxuan Zhou , Jingdong Sun , Jun-Yan He , Qi Dai , Alexander G. Hauptmann , Zhi-Qi Cheng

Geometric navigation is nowadays a well-established field of robotics and the research focus is shifting towards higher-level scene understanding, such as Semantic Mapping. When a robot needs to interact with its environment, it must be…

Robotics · Computer Science 2023-11-23 Federico Rollo , Gennaro Raiola , Andrea Zunino , Nikolaos Tsagarakis , Arash Ajoudani

Accurate semantic segmentation models typically require significant computational resources, inhibiting their use in practical applications. Recent works rely on well-crafted lightweight models to achieve fast inference. However, these…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Danna Xue , Fei Yang , Pei Wang , Luis Herranz , Jinqiu Sun , Yu Zhu , Yanning Zhang

Effectively capturing intricate interactions among road users is of critical importance to achieving safe navigation for autonomous vehicles. While graph learning (GL) has emerged as a promising approach to tackle this challenge, existing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Junyao Wang , Arnav Vaibhav Malawade , Junhong Zhou , Shih-Yuan Yu , Mohammad Abdullah Al Faruque