English
Related papers

Related papers: Data-driven Outer-Loop Control Using Deep Reinforc…

200 papers

This article addresses the problem of data-driven numerical optimal control for unknown nonlinear systems. In our scenario, we suppose to have the possibility of performing multiple experiments (or simulations) on the system. Experiments…

Systems and Control · Electrical Eng. & Systems 2025-06-19 Marco Borghesi , Lorenzo Sforni , Giuseppe Notarstefano

Leader-follower tracking control design has received significant attention in recent years due to its important and wide applications. Considering a multi-agent system composed of a leader and multiple followers, this paper proposes and…

Systems and Control · Computer Science 2019-04-02 Chuan Yan , Huazhen Fang

A key barrier to using reinforcement learning (RL) in many real-world applications is the requirement of a large number of system interactions to learn a good control policy. Off-policy and Offline RL methods have been proposed to reduce…

Machine Learning · Computer Science 2022-12-02 Wenqi Cui , Linbin Huang , Weiwei Yang , Baosen Zhang

Deep reinforcement learning (DRL) is a promising outer-loop intelligence paradigm which can deploy problem solving strategies for complex tasks. Consequently, DRL has been utilized for several scientific applications, specifically in cases…

Machine Learning · Computer Science 2023-04-05 Sahil Bhola , Suraj Pawar , Prasanna Balaprakash , Romit Maulik

With the development of state-of-art deep reinforcement learning, we can efficiently tackle continuous control problems. But the deep reinforcement learning method for continuous control is based on historical data, which would make…

Robotics · Computer Science 2016-12-02 Xi Xiong , Jianqiang Wang , Fang Zhang , Keqiang Li

This article studies the control ideas of the optimal backstepping technique, proposing an event-triggered optimal tracking control scheme for a class of strict-feedback nonlinear systems with non-affine and nonlinear faults. A simplified…

Optimization and Control · Mathematics 2024-06-13 Ling Wang , Xin Wang , Ziming Wang

We consider a multicast scheme recently proposed for a wireless downlink in [1]. It was shown earlier that power control can significantly improve its performance. However for this system, obtaining optimal power control is intractable…

Networking and Internet Architecture · Computer Science 2019-10-25 Ramkumar Raghu , Pratheek Upadhyaya , Mahadesh Panju , Vaneet Aggarwal , Vinod Sharma

Besides parametric uncertainties and disturbances, the unmodeled dynamics and time delay at the input are often present in practical systems, which cannot be ignored in some cases. This paper aims to solve output feedback tracking control…

Systems and Control · Computer Science 2020-03-10 Quan Quan , Hai Lin , Kai-Yuan Cai

We propose a simple, practical and intuitive approach to improve the performance of a conventional controller in uncertain environments using deep reinforcement learning while maintaining safe operation. Our approach is motivated by the…

Systems and Control · Electrical Eng. & Systems 2021-10-07 Tom Staessens , Tom Lefebvre , Guillaume Crevecoeur

In this paper, we propose a deep unfolding-based framework for the output feedback control of systems with input saturation. Although saturation commonly arises in several practical control systems, there is still a scarce of effective…

Systems and Control · Electrical Eng. & Systems 2021-01-28 Koki Kobayashi , Masaki Ogura , Taisuke Kobayashi , Kenji Sugimoto

Animals and robots exist in a physical world and must coordinate their bodies to achieve behavioral objectives. With recent developments in deep reinforcement learning, it is now possible for scientists and engineers to obtain sensorimotor…

Robotics · Computer Science 2024-05-21 Yusheng Jiao , Feng Ling , Sina Heydari , Nicolas Heess , Josh Merel , Eva Kanso

A methodology is developed to learn a feedback linearization (i.e., nonlinear change of coordinates and input transformation) using a data-driven approach for a single input control-affine nonlinear system with unknown dynamics. We employ…

Systems and Control · Electrical Eng. & Systems 2023-05-23 Raktim Gautam Goswami , Prashanth Krishnamurthy , Farshad Khorrami

Deep reinforcement learning approaches are becoming appealing for the design of nonlinear controllers for voltage control problems, but the lack of stability guarantees hinders their deployment in real-world scenarios. This paper constructs…

Systems and Control · Electrical Eng. & Systems 2023-08-31 Jie Feng , Wenqi Cui , Jorge Cortés , Yuanyuan Shi

We construct two error feedback controllers for robust output tracking and disturbance rejection of a regular linear system with nonsmooth reference and disturbance signals. We show that for sufficiently smooth signals the output converges…

Optimization and Control · Mathematics 2023-03-01 Lassi Paunonen

This paper proposes a reinforcement learning-based approach for optimal transient frequency control in power systems with stability and safety guarantees. Building on Lyapunov stability theory and safety-critical control, we derive…

Systems and Control · Electrical Eng. & Systems 2024-02-22 Zhenyi Yuan , Changhong Zhao , Jorge Cortes

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Autopilot systems are typically composed of an "inner loop" providing stability and control, while an "outer loop" is responsible for mission-level objectives, e.g. way-point navigation. Autopilot systems for UAVs are predominately…

Robotics · Computer Science 2018-04-13 William Koch , Renato Mancuso , Richard West , Azer Bestavros

Autonomous navigation has recently gained great interest in the field of reinforcement learning. However, little attention was given to the time optimal velocity control problem, i.e. controlling a vehicle such that it travels at the…

Robotics · Computer Science 2019-07-26 Gabriel Hartmann , Zvi Shiller , Amos Azaria

In order to autonomously learn to control unknown systems optimally w.r.t. an objective function, Adaptive Dynamic Programming (ADP) is well-suited to adapt controllers based on experience from interaction with the system. In recent years,…

Systems and Control · Electrical Eng. & Systems 2020-02-18 Florian Köpf , Simon Ramsteiner , Michael Flad , Sören Hohmann

Can ideas and techniques from machine learning be leveraged to automatically generate "good" routing configurations? We investigate the power of data-driven routing protocols. Our results suggest that applying ideas and techniques from deep…

Networking and Internet Architecture · Computer Science 2017-11-15 Asaf Valadarsky , Michael Schapira , Dafna Shahaf , Aviv Tamar