English
Related papers

Related papers: Safe Reinforcement Learning Beyond Baseline Contro…

200 papers

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

Many practical applications of online reinforcement learning require the satisfaction of safety constraints while learning about the unknown environment. In this work, we establish theoretical foundations for reinforcement learning with…

Machine Learning · Statistics 2025-04-30 Benjamin Schiffer , Lucas Janson

Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In this paper, we use…

Machine Learning · Computer Science 2019-03-26 Xiao Li , Calin Belta

In this paper, we present a novel learning-based shared control framework. This framework deploys first-order Dynamical Systems (DS) as motion generators providing the desired reference motion, and a Variable Stiffness Dynamical Systems…

Robotics · Computer Science 2023-07-20 Haotian Xue , Youssef Michel , Dongheui Lee

Operating effectively in complex environments while complying with specified constraints is crucial for the safe and successful deployment of robots that interact with and operate around people. In this work, we focus on generating…

Robotics · Computer Science 2024-10-01 Zeyu Feng , Hao Luan , Pranav Goyal , Harold Soh

Reinforcement Learning (RL) algorithms have achieved remarkable performance in decision making and control tasks due to their ability to reason about long-term, cumulative reward using trial and error. However, during RL training, applying…

Robotics · Computer Science 2021-03-03 Yifei Simon Shao , Chao Chen , Shreyas Kousik , Ram Vasudevan

In recent years, deep reinforcement learning has emerged as a technique to solve closed-loop flow control problems. Employing simulation-based environments in reinforcement learning enables a priori end-to-end optimization of the control…

Fluid Dynamics · Physics 2024-04-11 Andre Weiner , Janis Geise

We explore fixed-horizon temporal difference (TD) methods, reinforcement learning algorithms for a new kind of value function that predicts the sum of rewards over a $\textit{fixed}$ number of future time steps. To learn the value function…

Machine Learning · Computer Science 2020-02-12 Kristopher De Asis , Alan Chan , Silviu Pitis , Richard S. Sutton , Daniel Graves

This paper introduces new perspectives on analog design space search. To minimize the time-to-market, this endeavor better cast as constraint satisfaction problem than global optimization defined in prior arts. We incorporate model-based…

This paper introduces a safe force/position tracking control strategy designed for Free-Floating Mobile Manipulator Systems (MMSs) engaging in compliant contact with planar surfaces. The strategy uniquely integrates the Control Barrier…

Robotics · Computer Science 2024-04-23 Maryam Sharifi , Shahab Heshmati-Alamdari

Decision-making in military aviation Prognostics and Health Management (PHM) faces significant challenges due to the "curse of dimensionality" in large-scale fleet operations, combined with sparse feedback and stochastic mission profiles.…

Machine Learning · Computer Science 2026-04-09 Yong Si , Mingfei Lu , Jing Li , Yang Hu , Guijiang Li , Yueheng Song , Zhaokui Wang

Feedforward steering control is a key component of hierarchical control architectures for autonomous racing. The goal is to reduce steering corrections from the feedback controllers by predicting the vehicle's inverse lateral dynamics. This…

Robotics · Computer Science 2026-05-21 Georg Jank , Mattia Piccinini , Sebastian Wenk , Phillip Pitschi , Johannes Betz , Boris Lohmann

In this work, we consider the problem of learning a feed-forward neural network controller to safely steer an arbitrarily shaped planar robot in a compact and obstacle-occluded workspace. Unlike existing methods that depend strongly on the…

Systems and Control · Electrical Eng. & Systems 2022-12-14 Panagiotis Vlantis , Leila J. Bridgeman , Michael M. Zavlanos

Cyber-Physical Systems (CPS) often leverage Reinforcement Learning (RL) techniques to adapt dynamically to changing environments and optimize performance. However, it is challenging to construct safety cases for RL components. We therefore…

Software Engineering · Computer Science 2025-03-13 Katherine Dearstyne , Pedro , Alarcon Granadeno , Theodore Chambers , Jane Cleland-Huang

Safe Reinforcement Learning (Safe RL) is one of the prevalently studied subcategories of trial-and-error-based methods with the intention to be deployed on real-world systems. In safe RL, the goal is to maximize reward performance while…

Machine Learning · Computer Science 2024-08-16 Homayoun Honari , Amir Mehdi Soufi Enayati , Mehran Ghafarian Tamizi , Homayoun Najjaran

Learning reliably safe autonomous control is one of the core problems in trustworthy autonomy. However, training a controller that can be formally verified to be safe remains a major challenge. We introduce a novel approach for learning…

Machine Learning · Computer Science 2024-11-19 Junlin Wu , Huan Zhang , Yevgeniy Vorobeychik

This paper presents a hierarchical decision-making framework for unmanned aerial vehicle (UAV) missions motivated by search-and-rescue (SAR) scenarios under limited simulation training. The framework combines a fixed rule-based high-level…

Robotics · Computer Science 2026-04-30 Mahya Ramezani , Holger Voos

Reinforcement learning is an emerging approach to control dynamical systems for which classical approaches are difficult to apply. However, trained agents may not generalize against the variations of system parameters. This paper presents…

Systems and Control · Electrical Eng. & Systems 2023-11-10 Abdel Gafoor Haddad , Igor Boiko , Yahya Zweiri

The emergence of truck-drone collaborative systems in last-mile logistics has positioned the Traveling Salesman Problem with Drones (TSP-D) as a pivotal extension of classical routing optimization, where synchronized vehicle coordination…

Machine Learning · Computer Science 2025-11-10 Taihelong Zeng , Yun Lin , Yuhe Shi , Yan Li , Zhiqing Wei , Xuanru Ji

This paper delves into designing stabilizing feedback control gains for continuous linear systems with unknown state matrix, in which the control is subject to a general structural constraint. We bring forth the ideas from reinforcement…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Sayak Mukherjee , Thanh Long Vu