English
Related papers

Related papers: A modular framework for stabilizing deep reinforce…

200 papers

A convex parameterization of internally stabilizing controllers is fundamental for many controller synthesis procedures. The celebrated Youla parameterization relies on a doubly-coprime factorization of the system, while the recent…

Optimization and Control · Mathematics 2020-06-01 Yang Zheng , Luca Furieri , Antonis Papachristodoulou , Na Li , Maryam Kamgarpour

We propose a two-component data-driven controller to safely perform docking maneuvers for satellites. Reinforcement Learning is used to deduce an optimal control policy based on measurement data. To safeguard the learning phase, an…

Optimization and Control · Mathematics 2024-07-30 Simon Gottschalk , Lukas Lanza , Karl Worthmann , Kerstin Lux-Gottschalk

We describe a two-step approach for dialogue management in task-oriented spoken dialogue systems. A unified neural network framework is proposed to enable the system to first learn by supervision from a set of dialogue data and then…

Computation and Language · Computer Science 2016-06-09 Pei-Hao Su , Milica Gasic , Nikola Mrksic , Lina Rojas-Barahona , Stefan Ultes , David Vandyke , Tsung-Hsien Wen , Steve Young

Learning predictive models from observations using deep neural networks (DNNs) is a promising new approach to many real-world planning and control problems. However, common DNNs are too unstructured for effective planning, and current…

Robotics · Computer Science 2023-12-21 Ziang Liu , Genggeng Zhou , Jeff He , Tobia Marcucci , Li Fei-Fei , Jiajun Wu , Yunzhu Li

Reinforcement learning has been successfully applied to the problem of tuning PID controllers in several applications. The existing methods often utilize function approximation, such as neural networks, to update the controller parameters…

Many real-world domains require safe decision making in uncertain environments. In this work, we introduce a deep reinforcement learning framework for approaching this important problem. We consider a distribution over transition models,…

Machine Learning · Computer Science 2023-10-27 James Queeney , Mouhacine Benosman

The paper studies digital redesign of linear time-invariant analog controllers under intermittent sampling. The sampling pattern is only assumed to be uniformly bounded, but otherwise irregular and unknown a priori. The contribution of the…

Optimization and Control · Mathematics 2016-03-10 Leonid Mirkin

We present an architecture where a feedback controller derived on an approximate model of the environment assists the learning process to enhance its data efficiency. This architecture, which we term as Control-Tutored Q-learning (CTQL), is…

Machine Learning · Computer Science 2021-12-14 F. De Lellis , M. Coraggio , G. Russo , M. Musolesi , M. di Bernardo

Recent studies suggest that context-aware low-rank approximation is a useful tool for compression and fine-tuning of modern large-scale neural networks. In this type of approximation, a norm is weighted by a matrix of input activations,…

Machine Learning · Computer Science 2026-03-26 Uliana Parkina , Maxim Rakhuba

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

In this paper, we present a data-driven output feedback controller for nonlinear systems that achieves practical output regulation, using noise-free input/output measurement data. The proposed controller is based on (i) an inverse model of…

Systems and Control · Electrical Eng. & Systems 2026-03-12 Yeongjun Jang , Hamin Chang , Heein Park , Hyeonyeong Jang , Takashi Tanaka , Hyungbo Shim

We consider the problem of impulse response estimation of stable linear single-input single-output systems. It is a well-studied problem where flexible non-parametric models recently offered a leap in performance compared to the classical…

Systems and Control · Computer Science 2018-10-12 Carl Andersson , Niklas Wahlström , Thomas B. Schön

This paper studies the design of controllers that guarantee stability and safety of nonlinear control affine systems with parametric uncertainty in both the drift and control vector fields. To this end, we introduce novel classes of robust…

Optimization and Control · Mathematics 2022-08-12 Max H. Cohen , Calin Belta , Roberto Tron

This article proposes a model-based deep reinforcement learning (DRL) method to design emergency control strategies for short-term voltage stability problems in power systems. Recent advances show promising results in model-free DRL-based…

Systems and Control · Electrical Eng. & Systems 2022-12-07 Ramij R. Hossain , Tianzhixi Yin , Yan Du , Renke Huang , Jie Tan , Wenhao Yu , Yuan Liu , Qiuhua Huang

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

Training certifiable neural networks enables one to obtain models with robustness guarantees against adversarial attacks. In this work, we introduce a framework to bound the adversary-free region in the neighborhood of the input data by a…

Machine Learning · Computer Science 2021-09-21 Chen Liu , Mathieu Salzmann , Sabine Süsstrunk

Cellular reprogramming can be used for both the prevention and cure of different diseases. However, the efficiency of discovering reprogramming strategies with classical wet-lab experiments is hindered by lengthy time commitments and high…

Machine Learning · Computer Science 2025-03-04 Andrzej Mizera , Jakub Zarzycki

Linear quadratic regulator with unmeasurable states and unknown system matrix parameters better aligns with practical scenarios. However, for this problem, balancing the optimality of the resulting controller and the leniency of the…

Optimization and Control · Mathematics 2025-09-04 Jun Xie , Yuan-Hua Ni , Yiqin Yang , Bo Xu

Controlling systems with complex, nonlinear dynamics poses a significant challenge, particularly in achieving efficient and robust control. In this paper, we propose a Dyna-Style Reinforcement Learning control framework that integrates…

Systems and Control · Electrical Eng. & Systems 2025-12-25 Karim Abdelsalam , Zeyad Gamal , Ayman El-Badawy

Inter-area oscillations in power system limit of power transfer capability though tie-lines. For stable operation, wide-area power system stabilizers are deployed to provide sufficient damping. However, as the feedback is through a…

Systems and Control · Electrical Eng. & Systems 2020-07-27 Abhilash Patel