English
Related papers

Related papers: Online Learning Based Mobile Robot Controller Adap…

200 papers

This paper introduces a physics enhanced residual learning (PERL) framework for connected and automated vehicle (CAV) platoon control, addressing the dynamics and unpredictability inherent to platoon systems. The framework first develops a…

Robotics · Computer Science 2024-12-31 Peng Zhang , Heye Huang , Hang Zhou , Haotian Shi , Keke Long , Xiaopeng Li

Reinforcement learning (RL), with its ability to explore and optimize policies in complex, dynamic decision-making tasks, has emerged as a promising approach to addressing motion planning (MoP) challenges in autonomous driving (AD). Despite…

Machine Learning · Computer Science 2025-04-01 Zhuoren Li , Guizhe Jin , Ran Yu , Zhiwen Chen , Nan Li , Wei Han , Lu Xiong , Bo Leng , Jia Hu , Ilya Kolmanovsky , Dimitar Filev

Many existing traffic signal controllers are either simple adaptive controllers based on sensors placed around traffic intersections, or optimized by traffic engineers on a fixed schedule. Optimizing traffic controllers is time consuming…

Systems and Control · Electrical Eng. & Systems 2019-11-15 Kai Liang Tan , Subhadipto Poddar , Anuj Sharma , Soumik Sarkar

The rapid development of autonomous vehicles (AVs) holds vast potential for transportation systems through improved safety, efficiency, and access to mobility. However, the progression of these impacts, as AVs are adopted, is not well…

Artificial Intelligence · Computer Science 2022-01-03 Cathy Wu , Aboudy Kreidieh , Kanaad Parvate , Eugene Vinitsky , Alexandre M Bayen

Deep Reinforcement Learning (DRL) has been applied successfully to many robotic applications. However, the large number of trials needed for training is a key issue. Most of existing techniques developed to improve training efficiency (e.g.…

Robotics · Computer Science 2018-12-13 Linhai Xie , Sen Wang , Stefano Rosa , Andrew Markham , Niki Trigoni

Reinforcement Learning (RL) of robotic manipulation skills, despite its impressive successes, stands to benefit from incorporating domain knowledge from control theory. One of the most important properties that is of interest is control…

Robotics · Computer Science 2021-03-03 Shahbaz Abdul Khader , Hang Yin , Pietro Falco , Danica Kragic

Offline-to-online reinforcement learning harnesses the stability of offline pretraining and the flexibility of online fine-tuning. A key challenge lies in the non-stationary distribution shift between offline datasets and the evolving…

Machine Learning · Computer Science 2026-05-15 Letian Yang , Xu Liu , Yiqiang Lu , Jian Liu , Weiqiang Wang , Shuai Li

The growing complexity and capacity demands for mobile networks necessitate innovative techniques for optimizing resource usage. Meanwhile, recent breakthroughs have brought Reinforcement Learning (RL) into the domain of continuous control…

Networking and Internet Architecture · Computer Science 2022-10-28 Vegard Edvardsen , Gard Spreemann , Jeriek Van den Abeele

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

Machine Learning · Computer Science 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

The recent offline reinforcement learning (RL) studies have achieved much progress to make RL usable in real-world systems by learning policies from pre-collected datasets without environment interaction. Unfortunately, existing offline RL…

Artificial Intelligence · Computer Science 2022-04-22 Xianyuan Zhan , Xiangyu Zhu , Haoran Xu

We provide an algorithm for adaptive legged locomotion via online learning and model predictive control. The algorithm is composed of two interacting modules: model predictive control (MPC) and online learning of residual dynamics. The…

Robotics · Computer Science 2025-12-02 Hongyu Zhou , Xiaoyu Zhang , Vasileios Tzoumas

Real-world control applications in complex and uncertain environments require adaptability to handle model uncertainties and robustness against disturbances. This paper presents an online, output-feedback, critic-only, model-based…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Tochukwu Elijah Ogri , S. M. Nahid Mahmud , Zachary I. Bell , Rushikesh Kamalapurkar

Whole-body humanoid locomotion is challenging due to high-dimensional control, morphological instability, and the need for real-time adaptation to various terrains using onboard perception. Directly applying reinforcement learning (RL) with…

In this work, we consider the task of improving the accuracy of dynamic models for model predictive control (MPC) in an online setting. Although prediction models can be learned and applied to model-based controllers, these models are often…

Robotics · Computer Science 2022-11-29 Tom Z. Jiahao , Kong Yao Chee , M. Ani Hsieh

Autonomous mobile robots require accurate human motion predictions to safely and efficiently navigate among pedestrians, whose behavior may adapt to environmental changes. This paper introduces a self-supervised continual learning framework…

Robotics · Computer Science 2022-02-16 Luzia Knoedler , Chadi Salmi , Hai Zhu , Bruno Brito , Javier Alonso-Mora

Recently, there has been a surge in interest in safe and robust techniques within reinforcement learning (RL). Current notions of risk in RL fail to capture the potential for systemic failures such as abrupt stoppages from system failures…

Systems and Control · Computer Science 2019-10-09 David Mguni

Machine and reinforcement learning (RL) are increasingly being applied to plan and control the behavior of autonomous systems interacting with the physical world. Examples include self-driving vehicles, distributed sensor networks, and…

Optimization and Control · Mathematics 2019-09-24 Nikolai Matni , Alexandre Proutiere , Anders Rantzer , Stephen Tu

Reinforcement Learning (RL) methods have been proven successful in solving manipulation tasks autonomously. However, RL is still not widely adopted on real robotic systems because working with real hardware entails additional challenges,…

For autonomous vehicles integrating onto roadways with human traffic participants, it requires understanding and adapting to the participants' intention and driving styles by responding in predictable ways without explicit communication.…

Robotics · Computer Science 2021-07-09 Zhitao Wang , Yuzheng Zhuang , Qiang Gu , Dong Chen , Hongbo Zhang , Wulong Liu