English
Related papers

Related papers: A Safety Modulator Actor-Critic Method in Model-Fr…

200 papers

Deep reinforcement learning methods have shown great performance on many challenging cooperative multi-agent tasks. Two main promising research directions are multi-agent value function decomposition and multi-agent policy gradients. In…

Artificial Intelligence · Computer Science 2021-05-11 Yuan Pu , Shaochen Wang , Rui Yang , Xin Yao , Bin Li

Reinforcement learning has gathered much attention in recent years due to its rapid development and rich applications, especially on control systems and robotics. When tackling real-world applications with reinforcement learning method, the…

Machine Learning · Computer Science 2025-10-02 Andy Wu , Chun-Cheng Lin , Rung-Tzuo Liaw , Yuehua Huang , Chihjung Kuo , Chia Tong Weng

Model predictive control (MPC) is widely used for motion planning, particularly in autonomous driving. Real-time capability of the planner requires utilizing convex approximation of optimal control problems (OCPs) for the planner. However,…

Robotics · Computer Science 2025-12-04 Johannes Fischer , Marlon Steiner , Ömer Sahin Tas , Christoph Stiller

We propose WSAC (Weighted Safe Actor-Critic), a novel algorithm for Safe Offline Reinforcement Learning (RL) under functional approximation, which can robustly optimize policies to improve upon an arbitrary reference policy with limited…

Machine Learning · Computer Science 2024-11-01 Honghao Wei , Xiyue Peng , Arnob Ghosh , Xin Liu

We address the problem of coordination and control of Connected and Automated Vehicles (CAVs) in the presence of imperfect observations in mixed traffic environment. A commonly used approach is learning-based decision-making, such as…

Robotics · Computer Science 2024-09-25 Zhili Zhang , H M Sabbir Ahmad , Ehsan Sabouni , Yanchao Sun , Furong Huang , Wenchao Li , Fei Miao

Real-world reinforcement learning (RL) problems often demand that agents behave safely by obeying a set of designed constraints. We address the challenge of safe RL by coupling a safety guide based on model predictive control (MPC) with a…

Machine Learning · Computer Science 2022-03-30 Samuel Pfrommer , Tanmay Gautam , Alec Zhou , Somayeh Sojoudi

Existing actor-critic algorithms, which are popular for continuous control reinforcement learning (RL) tasks, suffer from poor sample efficiency due to lack of principled exploration mechanism within them. Motivated by the success of…

Machine Learning · Computer Science 2025-01-30 Haque Ishfaq , Guangyuan Wang , Sami Nur Islam , Doina Precup

Deep reinforcement learning (RL) algorithms can use high-capacity deep networks to learn directly from image observations. However, these high-dimensional observation spaces present a number of challenges in practice, since the policy must…

Machine Learning · Computer Science 2020-10-27 Alex X. Lee , Anusha Nagabandi , Pieter Abbeel , Sergey Levine

Risk-bounded motion planning is an important yet difficult problem for safety-critical tasks. While existing mathematical programming methods offer theoretical guarantees in the context of constrained Markov decision processes, they either…

Machine Learning · Computer Science 2021-08-05 Xin Huang , Meng Feng , Ashkan Jasour , Guy Rosman , Brian Williams

Advances in Reinforcement Learning (RL) have demonstrated data efficiency and optimal control over large state spaces at the cost of scalable performance. Genetic methods, on the other hand, provide scalability but depict hyperparameter…

Machine Learning · Computer Science 2021-01-19 Karush Suri , Xiao Qi Shi , Konstantinos N. Plataniotis , Yuri A. Lawryshyn

Unmanned Aerial Vehicles (UAVs) depend on onboard sensors for perception, navigation, and control. However, these sensors are susceptible to physical attacks, such as GPS spoofing, that can corrupt state estimates and lead to unsafe…

Machine Learning · Computer Science 2025-06-30 Pritam Dash , Ethan Chan , Nathan P. Lawrence , Karthik Pattabiraman

Communication technologies enable coordination among connected and autonomous vehicles (CAVs). However, it remains unclear how to utilize shared information to improve the safety and efficiency of the CAV system in dynamic and complicated…

Robotics · Computer Science 2023-03-15 Zhili Zhang , Songyang Han , Jiangwei Wang , Fei Miao

Self-supervised skill learning aims to acquire useful behaviors that leverage the underlying dynamics of the environment. Latent variable models, based on mutual information maximization, have been successful in this task but still struggle…

Machine Learning · Computer Science 2024-03-22 David Emukpere , Bingbing Wu , Julien Perez , Jean-Michel Renders

A key open challenge in agile quadrotor flight is how to combine the flexibility and task-level generality of model-free reinforcement learning (RL) with the structure and online replanning capabilities of model predictive control (MPC),…

Robotics · Computer Science 2026-01-21 Angel Romero , Elie Aljalbout , Yunlong Song , Davide Scaramuzza

The proliferation of unmanned aerial vehicles (UAVs) in controlled airspace presents significant risks, including potential collisions, disruptions to air traffic, and security threats. Ensuring the safe and efficient operation of airspace,…

Robotics · Computer Science 2025-10-22 Francisco Giral , Ignacio Gómez , Soledad Le Clainche

Providing densely shaped reward functions for RL algorithms is often exceedingly challenging, motivating the development of RL algorithms that can learn from easier-to-specify sparse reward functions. This sparsity poses new exploration…

Machine Learning · Computer Science 2022-10-24 Albert Wilcox , Ashwin Balakrishna , Jules Dedieu , Wyame Benslimane , Daniel S. Brown , Ken Goldberg

Safe offline reinforcement learning aims to learn policies that maximize cumulative rewards while adhering to safety constraints, using only offline data for training. A key challenge is balancing safety and performance, particularly when…

Machine Learning · Computer Science 2024-12-13 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Risk-averse Constrained Reinforcement Learning (RaCRL) aims to learn policies that minimise the likelihood of rare and catastrophic constraint violations caused by an environment's inherent randomness. In general, risk-aversion leads to…

Machine Learning · Computer Science 2025-08-28 James McCarthy , Radu Marinescu , Elizabeth Daly , Ivana Dusparic

Overestimation is a fundamental characteristic of model-free reinforcement learning (MF-RL), arising from the principles of temporal difference learning and the approximation of the Q-function. To address this challenge, we propose a novel…

Machine Learning · Computer Science 2025-04-15 Ukjo Hwang , Songnam Hong

The increasing adoption of Reinforcement Learning in safety-critical systems domains such as autonomous vehicles, health, and aviation raises the need for ensuring their safety. Existing safety mechanisms such as adversarial training,…

Machine Learning · Computer Science 2021-11-11 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh , John Mullins