English
Related papers

Related papers: Deep QP Safety Filter: Model-free Learning for Rea…

200 papers

In this paper, we develop a data-based controller design framework for diffusively coupled systems with guaranteed convergence to an $\epsilon$-neighborhood of the desired formation. The controller is comprised of a fixed controller with an…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Miel Sharf , Anne Koch , Daniel Zelazo , Frank Allgöwer

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

In this paper we tackle the problem of deformable object manipulation through model-free visual reinforcement learning (RL). In order to circumvent the sample inefficiency of RL, we propose two key ideas that accelerate learning. First, we…

Robotics · Computer Science 2020-03-04 Yilin Wu , Wilson Yan , Thanard Kurutach , Lerrel Pinto , Pieter Abbeel

We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain. We present an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. Using…

While conventional reinforcement learning focuses on designing agents that can perform one task, meta-learning aims, instead, to solve the problem of designing agents that can generalize to different tasks (e.g., environments, obstacles,…

Machine Learning · Computer Science 2021-09-06 Xiaowu Sun , Wael Fatnassi , Ulices Santa Cruz , Yasser Shoukry

Reinforcement learning (RL) algorithms can achieve state-of-the-art performance in decision-making and continuous control tasks. However, applying RL algorithms on safety-critical systems still needs to be well justified due to the…

Robotics · Computer Science 2022-11-22 Mahmoud Selim , Amr Alanwar , M. Watheq El-Kharashi , Hazem M. Abbas , Karl H. Johansson

Obstacle avoidance is a fundamental vision-based task essential for enabling quadrotors to perform advanced applications. When planning the trajectory, existing approaches both on optimization and learning typically regard quadrotor as a…

Robotics · Computer Science 2026-04-17 Fanxing Li , Shengyang Wang , Yuxiang Huang , Fangyu Sun , Shuyu Wu , Yufei Yan , Danping Zou , Wenxian Yu

Distributionally robust reinforcement learning (DRRL) focuses on designing policies that achieve good performance under model uncertainties. The goal is to maximize the worst-case long-term discounted reward, where the data for RL comes…

Machine Learning · Computer Science 2026-03-17 Saptarshi Mandal , Yashaswini Murthy , R. Srikant

For safely applying reinforcement learning algorithms on high-dimensional nonlinear dynamical systems, a simplified system model is used to formulate a safe reinforcement learning framework. Based on the simplified system model, a…

Robotics · Computer Science 2021-09-09 Zhehua Zhou , Ozgur S. Oguz , Marion Leibold , Martin Buss

This paper presents a one-shot learning approach with performance and robustness guarantees for the linear quadratic regulator (LQR) control of stochastic linear systems. Even though data-based LQR control has been widely considered,…

Systems and Control · Electrical Eng. & Systems 2024-10-29 Ramin Esmzad , Hamidreza Modares

A deep learning approach for the approximation of the Hamilton-Jacobi-Bellman partial differential equation (HJB PDE) associated to the Nonlinear Quadratic Regulator (NLQR) problem. A state-dependent Riccati equation control law is first…

Optimization and Control · Mathematics 2022-07-20 Anastasia Borovykh , Dante Kalise , Alexis Laignelet , Panos Parpas

Stabilizing an unknown control system is one of the most fundamental problems in control systems engineering. In this paper, we provide a simple, model-free algorithm for stabilizing fully observed dynamical systems. While model-free…

Systems and Control · Electrical Eng. & Systems 2021-10-14 Juan C. Perdomo , Jack Umenberger , Max Simchowitz

Reinforcement learning (RL)-based adaptive cruise control systems (ACC) that learn and adapt to road, traffic and vehicle conditions are attractive for enhancing vehicle energy efficiency and traffic flow. However, the application of RL in…

Systems and Control · Electrical Eng. & Systems 2023-01-04 Habtamu Hailemichael , Beshah Ayalew , Lindsey Kerbel , Andrej Ivanco , Keith Loiselle

Hamilton-Jacobi (HJ) reachability analysis has been developed over the past decades into a widely-applicable tool for determining goal satisfaction and safety verification in nonlinear systems. While HJ reachability can be formulated very…

Robotics · Computer Science 2020-03-13 Vicenc Rubies-Royo , David Fridovich-Keil , Sylvia Herbert , Claire J. Tomlin

In this paper, we consider depth control problems of an autonomous underwater vehicle (AUV) for tracking the desired depth trajectories. Due to the unknown dynamical model of the AUV, the problems cannot be solved by most of model-based…

Robotics · Computer Science 2017-11-23 Hui Wu , Shiji Song , Keyou You , Cheng Wu

This paper addresses the problem of safety-critical control for non-affine control systems. It has been shown that optimizing quadratic costs subject to state and control constraints can be sub-optimally reduced to a sequence of quadratic…

Systems and Control · Electrical Eng. & Systems 2024-02-15 Wei Xiao , Ross Allen , Daniela Rus

A critical goal of autonomy and artificial intelligence is enabling autonomous robots to rapidly adapt in dynamic and uncertain environments. Classic adaptive control and safe control provide stability and safety guarantees but are limited…

Robotics · Computer Science 2024-04-30 Wenli Xiao , Tairan He , John Dolan , Guanya Shi

Control barrier functions have shown great success in addressing control problems with safety guarantees. These methods usually find the next safe control input by solving an online quadratic programming problem. However, model uncertainty…

Systems and Control · Electrical Eng. & Systems 2020-11-24 Chuanzheng Wang , Yinan Li , Yiming Meng , Stephen L. Smith , Jun Liu

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

A deep learning system typically suffers from a lack of reproducibility that is partially rooted in hardware or software implementation details. The irreproducibility leads to skepticism in deep learning technologies and it can hinder them…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Jiahao Pang , Muhammad Asad Lodhi , Junghyun Ahn , Yuning Huang , Dong Tian