English
Related papers

Related papers: Data-driven Outer-Loop Control Using Deep Reinforc…

200 papers

Deep reinforcement learning has the potential to address various scientific problems. In this paper, we implement an optics simulation environment for reinforcement learning based controllers. The environment captures the essence of…

Machine Learning · Computer Science 2023-10-03 Abulikemu Abuduweili , Changliu Liu

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

Learning-based control aims to construct models of a system to use for planning or trajectory optimization, e.g. in model-based reinforcement learning. In order to obtain guarantees of safety in this context, uncertainty must be accurately…

Robotics · Computer Science 2020-06-08 David D. Fan , Ali-akbar Agha-mohammadi , Evangelos A. Theodorou

High performance tracking control can only be achieved if a good model of the dynamics is available. However, such a model is often difficult to obtain from first order physics only. In this paper, we develop a data-driven control law that…

Systems and Control · Computer Science 2018-11-20 Thomas Beckers , Jonas Umlauft , Dana Kulić , Sandra Hirche

Industrial robots are widely used in various manufacturing environments due to their efficiency in doing repetitive tasks such as assembly or welding. A common problem for these applications is to reach a destination without colliding with…

Robotics · Computer Science 2023-01-18 Teham Bhuiyan , Linh Kästner , Yifan Hu , Benno Kutschank , Jens Lambrecht

This paper studies the data-driven control of unknown linear-threshold network dynamics to stabilize the state to a reference value. We consider two types of controllers: (i) a state feedback controller with feed-forward reference input and…

Systems and Control · Electrical Eng. & Systems 2025-10-03 Xuan Wang , Duy Duong-Tran , Jorge Cortés

Deep neural networks (DNN) are increasingly being used to learn controllers due to their excellent approximation capabilities. However, their black-box nature poses significant challenges to closed-loop stability guarantees and performance…

Robotics · Computer Science 2024-09-13 Jiajun Qian , Liang Xu , Xiaoqiang Ren , Xiaofan Wang

Quadcopters have been studied for decades thanks to their maneuverability and capability of operating in a variety of circumstances. However, quadcopters suffer from dynamical nonlinearity, actuator saturation, as well as sensor noise that…

Robotics · Computer Science 2024-06-19 Truong-Dong Do , Nguyen Xuan Mung , Sung Kyung Hong

The design of controllers from data for nonlinear systems is a challenging problem. In a recent paper, De Persis, Rotulo and Tesi, "Learning controllers from data via approximate nonlinearity cancellation," IEEE Transactions on Automatic…

Systems and Control · Electrical Eng. & Systems 2024-04-30 Xiaoyan Dai , Claudio De Persis , Nima Monshizadeh , Pietro Tesi

Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the potential to address…

Machine Learning · Computer Science 2023-10-24 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

In this paper, we address the problem of reference tracking for uncertain nonlinear systems. Since collecting data from the target system (i.e., the system of interest) is often challenging, our objective is to design optimal controllers…

Artificial Intelligence · Computer Science 2026-05-22 Jiaqi Yan , Ankush Chakrabarty , Niklas Schmid , John Lygeros , Alisa Rupenyan

In this paper, we propose the Model Reference Adaptive Control & Reinforcement Learning (MRAC-RL) approach to developing online policies for systems in which modeling errors occur in real-time. Although reinforcement learning (RL)…

Systems and Control · Electrical Eng. & Systems 2021-10-20 Anubhav Guha , Anuradha Annaswamy

In this paper, we consider the periodic reference tracking problem in the framework of batch-mode reinforcement learning, which studies methods for solving optimal control problems from the sole knowledge of a set of trajectories. In…

Systems and Control · Computer Science 2013-03-13 Aivar Sootla , Natalja Strelkowa , Damien Ernst , Mauricio Barahona , Guy-Bart Stan

Model-based reinforcement learning attempts to use an available or learned model to improve the data efficiency of reinforcement learning. This work proposes a one-step lookback approach that jointly learns the deep incremental model and…

Robotics · Computer Science 2025-02-28 Cong Li

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the…

Robotics · Computer Science 2020-06-18 Simen Theie Havenstrøm , Adil Rasheed , Omer San

In this paper, we present a learning-based approach that allows a robot to quickly follow a reference path defined in joint space without exceeding limits on the position, velocity, acceleration and jerk of each robot joint. Contrary to…

Robotics · Computer Science 2022-10-21 Jonas C. Kiemel , Torsten Kröger

Policy iteration is one of the classical frameworks of reinforcement learning, which requires a known initial stabilizing control. However, finding the initial stabilizing control depends on the known system model. To relax this requirement…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Dongdong Li , Jiuxiang Dong

Continuous monitoring and real-time control of high-dimensional distributed systems are often crucial in applications to ensure a desired physical behavior, without degrading stability and system performances. Traditional feedback control…

Optimization and Control · Mathematics 2024-12-16 Matteo Tomasetto , Francesco Braghin , Andrea Manzoni

We present a motion planning algorithm for a class of uncertain control-affine nonlinear systems which guarantees runtime safety and goal reachability when using high-dimensional sensor measurements (e.g., RGB-D images) and a learned…

Robotics · Computer Science 2022-08-25 Glen Chou , Necmiye Ozay , Dmitry Berenson

We propose a novel adaptive reinforcement learning control approach for fault tolerant control of degrading systems that is not preceded by a fault detection and diagnosis step. Therefore, \textit{a priori} knowledge of faults that may…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Marcos Quiñones-Grueiro , Gautam Biswas