English
Related papers

Related papers: Residual Reactive Navigation: Combining Classical …

200 papers

In this paper, we propose a novel hierarchical framework for robot navigation in dynamic environments with heterogeneous constraints. Our approach leverages a graph neural network trained via reinforcement learning (RL) to efficiently…

Robotics · Computer Science 2025-07-24 Huajian Liu , Yixuan Feng , Wei Dong , Kunpeng Fan , Chao Wang , Yongzhuo Gao

Ordinal regression and ranking are challenging due to inherent ordinal dependencies that conventional methods struggle to model. We propose Ranking-Aware Reinforcement Learning (RARL), a novel RL framework that explicitly learns these…

Machine Learning · Computer Science 2026-01-29 Aiming Hao , Chen Zhu , Jiashu Zhu , Jiahong Wu , Xiangxiang Chu

Model-free reinforcement learning has recently been shown to be effective at learning navigation policies from complex image input. However, these algorithms tend to require large amounts of interaction with the environment, which can be…

Robotics · Computer Science 2018-07-17 Jake Bruce , Niko Sünderhauf , Piotr Mirowski , Raia Hadsell , Michael Milford

There is a growing demand for redirected walking (RDW) techniques and their application. To apply appropriate RDW methods and manipulation, the RDW controllers are predominantly used. There are three types of RDW controllers: direct…

Machine Learning · Computer Science 2021-10-14 Yuchen Chang , Keigo Matsumoto , Takuji Narumi , Tomohiro Tanikawa , Michitaka Hirose

Smart and agile drones are fast becoming ubiquitous at the edge of the cloud. The usage of these drones are constrained by their limited power and compute capability. In this paper, we present a Transfer Learning (TL) based approach to…

Machine Learning · Computer Science 2019-10-15 Aqeel Anwar , Arijit Raychowdhury

Motion planning is critical to realize the autonomous operation of mobile robots. As the complexity and randomness of robot application scenarios increase, the planning capability of the classical hierarchical motion planners is challenged.…

Robotics · Computer Science 2022-02-24 Lu Dong , Zichen He , Chunwei Song , Changyin Sun

Classical navigation systems typically operate using a fixed set of hand-picked parameters (e.g. maximum speed, sampling rate, inflation radius, etc.) and require heavy expert re-tuning in order to work in new environments. To mitigate this…

Robotics · Computer Science 2020-11-03 Zifan Xu , Gauraang Dhamankar , Anirudh Nair , Xuesu Xiao , Garrett Warnell , Bo Liu , Zizhao Wang , Peter Stone

This paper proposes a novel adaptive guidance system developed using reinforcement meta-learning with a recurrent policy and value function approximator. The use of recurrent network layers allows the deployed policy to adapt real time to…

Systems and Control · Electrical Eng. & Systems 2024-12-20 Brian Gaudet , Richard Linares

Distribution shift severely degrades the performance of deep forecasting models. While this issue is well-studied for individual time series, it remains a significant challenge in the spatio-temporal domain. Effective solutions like…

Machine Learning · Computer Science 2026-04-20 Zhaobo Hu , Vincent Gauthier , Mehdi Naima

Reinforcement learning (RL) algorithms are designed to optimize problem-solving by learning actions that maximize rewards, a task that becomes particularly challenging in random and nonstationary environments. Even advanced RL algorithms…

Machine Learning · Computer Science 2025-10-31 Sebastian Zieglmeier , Niklas Erdmann , Narada D. Warakagoda

In this paper, we consider the problem of predicting unknown targets from data. We propose Online Residual Learning (ORL), a method that combines online adaptation with offline-trained predictions. At a lower level, we employ multiple…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Anastasios Vlachos , Anastasios Tsiamis , Aren Karapetyan , Efe C. Balta , John Lygeros

To achieve successful field autonomy, mobile robots need to freely adapt to changes in their environment. Visual navigation systems such as Visual Teach and Repeat (VT&R) often assume the space around the reference trajectory is free, but…

Robotics · Computer Science 2022-07-01 Matías Mattamala , Nived Chebrolu , Maurice Fallon

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

This paper was motivated by the problem of how to make robots fuse and transfer their experience so that they can effectively use prior knowledge and quickly adapt to new environments. To address the problem, we present a learning…

Robotics · Computer Science 2024-12-20 Boyi Liu , Lujia Wang , Ming Liu

This paper presents a technique for navigation of mobile robot with Deep Q-Network (DQN) combined with Gated Recurrent Unit (GRU). The DQN integrated with the GRU allows action skipping for improved navigation performance. This technique…

Robotics · Computer Science 2021-12-08 Inhwan Kim , Sarvar Hussain Nengroo , Dongsoo Har

Robotic systems are nowadays capable of solving complex navigation tasks. However, their capabilities are limited to the knowledge of the designer and consequently lack generalizability to initially unconsidered situations. This makes deep…

Robotics · Computer Science 2022-05-24 Christopher Gebauer , Nils Dengler , Maren Bennewitz

We present a novel approach to improve the performance of deep reinforcement learning (DRL) based outdoor robot navigation systems. Most, existing DRL methods are based on carefully designed dense reward functions that learn the efficient…

Goal-conditioned reinforcement learning (GCRL) has a wide range of potential real-world applications, including manipulation and navigation problems in robotics. Especially in such robotics tasks, sample efficiency is of the utmost…

Machine Learning · Computer Science 2023-01-23 Bo Liu , Yihao Feng , Qiang Liu , Peter Stone

Robot decision-making in partially observable, real-time, dynamic, and multi-agent environments remains a difficult and unsolved challenge. Model-free reinforcement learning (RL) is a promising approach to learning decision-making in such…

A residual deep reinforcement learning (RDRL) approach is proposed by integrating DRL with model-based optimization for inverter-based volt-var control in active distribution networks when the accurate power flow model is unknown. RDRL…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun