English
Related papers

Related papers: A modular framework for stabilizing deep reinforce…

200 papers

In this work, a predictive control framework is presented for feedback stabilization of nonlinear systems. To achieve this, we integrate Koopman operator theory with Lyapunov-based model predictive control (LMPC). The main idea is to…

Systems and Control · Electrical Eng. & Systems 2020-05-26 Abhinav Narasingam , Joseph Sang-Il Kwon

Reinforcement learning is an emerging approach to control dynamical systems for which classical approaches are difficult to apply. However, trained agents may not generalize against the variations of system parameters. This paper presents…

Systems and Control · Electrical Eng. & Systems 2023-11-10 Abdel Gafoor Haddad , Igor Boiko , Yahya Zweiri

In recent years, deep reinforcement learning has emerged as a technique to solve closed-loop flow control problems. Employing simulation-based environments in reinforcement learning enables a priori end-to-end optimization of the control…

Fluid Dynamics · Physics 2024-04-11 Andre Weiner , Janis Geise

This paper proposes a novel approach to controller design for MR-damped vehicle suspension system. This approach is predicated on the premise that the optimal control strategy can be learned through real-world or simulated experiments…

Systems and Control · Electrical Eng. & Systems 2023-09-06 AmirReza BabaAhmadi , Masoud ShariatPanahi , Moosa Ayati

In this paper, a novel online, output-feedback, critic-only, model-based reinforcement learning framework is developed for safety-critical control systems operating in complex environments. The developed framework ensures system stability…

Systems and Control · Electrical Eng. & Systems 2024-06-28 Tochukwu Elijah Ogri , Muzaffar Qureshi , Zachary I. Bell , Rushikesh Kamalapurkar

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possible faults. Instead it…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Hamed Khorasgani , Gautam Biswas

The design and deployment of autonomous systems for space missions require robust solutions to navigate strict reliability constraints, extended operational duration, and communication challenges. This study evaluates the stability and…

Robotics · Computer Science 2025-03-04 Henry Lei , Zachary S. Lippay , Anonto Zaman , Joshua Aurand , Amin Maghareh , Sean Phillips

Controlling instabilities in complex dynamical systems is challenging in scientific and engineering applications. Deep reinforcement learning (DRL) has seen promising results for applications in different scientific applications. The…

Machine Learning · Computer Science 2025-04-09 Luning Sun , Xin-Yang Liu , Siyan Zhao , Aditya Grover , Jian-Xun Wang , Jayaraman J. Thiagarajan

We study the constrained linear quadratic regulator with unknown dynamics, addressing the tension between safety and exploration in data-driven control techniques. We present a framework which allows for system identification through…

Optimization and Control · Mathematics 2019-07-09 Sarah Dean , Stephen Tu , Nikolai Matni , Benjamin Recht

We consider the adaptive control problem for discrete-time, nonlinear stochastic systems with linearly parameterised uncertainty. Assuming access to a parameterised family of controllers that can stabilise the system in a bounded set within…

Systems and Control · Electrical Eng. & Systems 2025-11-24 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

In this effort, we propose a new deep architecture utilizing residual blocks inspired by implicit discretization schemes. As opposed to the standard feed-forward networks, the outputs of the proposed implicit residual blocks are defined as…

Machine Learning · Computer Science 2021-02-23 Viktor Reshniak , Clayton Webster

Learning-based methods are powerful in handling complex scenarios. However, it is still challenging to use learning-based methods under uncertain environments while stability, safety, and real-time performance of the system are desired to…

Robotics · Computer Science 2022-03-08 Zhixuan Wu , Rui Yang , Lei Zheng , Hui Cheng

We propose a piecewise learning framework for controlling nonlinear systems with unknown dynamics. While model-based reinforcement learning techniques in terms of some basis functions are well known in the literature, when it comes to more…

Optimization and Control · Mathematics 2022-04-06 Milad Farsi , Yinan Li , Ye Yuan , Jun Liu

Deep reinforcement learning (DRL) provides a promising way for learning navigation in complex autonomous driving scenarios. However, identifying the subtle cues that can indicate drastically different outcomes remains an open problem with…

Machine Learning · Computer Science 2021-03-25 Xiaobai Ma , Jiachen Li , Mykel J. Kochenderfer , David Isele , Kikuo Fujimura

Quantum control has been of increasing interest in recent years, e.g. for tasks like state initialization and stabilization. Feedback-based strategies are particularly powerful, but also hard to find, due to the exponentially increased…

Quantum Physics · Physics 2022-06-30 Riccardo Porotti , Antoine Essig , Benjamin Huard , Florian Marquardt

This paper proposes a new optimization objective for value-based deep reinforcement learning. We extend conventional Deep Q-Networks (DQNs) by adding a model-learning component yielding a transcoder network. The prediction errors for the…

Machine Learning · Computer Science 2018-11-21 Felix Leibfried , Peter Vrancx

This work provides a framework for data-driven control of discrete time systems with unknown input-output dynamics and outputs controllable by the inputs. This framework leads to stable and robust real-time control of the system such that a…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Amit K. Sanyal

Recent development of contraction theory based analysis of singularly perturbed system has opened the door for inspecting differential behavior of multi time-scale systems. In this paper a contraction theory based framework is proposed for…

Systems and Control · Computer Science 2015-12-04 Madan Mohan Rayguru , I N Kar

Training modern neural networks is increasingly fragile, with rare but severe destabilizing updates often causing irreversible divergence or silent performance degradation. Existing optimization methods primarily rely on preventive…

Machine Learning · Computer Science 2026-01-27 Barak Or

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

Robotics · Computer Science 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen