English
Related papers

Related papers: Policy Gradient-Based EMT-in-the-Loop Learning to …

200 papers

In optimal control problem, policy iteration (PI) is a powerful reinforcement learning (RL) tool used for designing optimal controller for the linear systems. However, the need for an initial stabilizing control policy significantly limits…

Optimization and Control · Mathematics 2024-11-13 Zhen Pang , Shengda Tang , Jun Cheng , Shuping He

This paper demonstrates the applicability of the safe model predictive control (SMPC) framework to autonomous driving scenarios, focusing on the design of adaptive cruise control (ACC) and automated lane-change systems. Building on the SMPC…

Systems and Control · Electrical Eng. & Systems 2025-05-12 Francesco Prignoli , Ying Shuai Quan , Mohammad Jeddi , Jonas Sjöberg , Paolo Falcone

Reinforcement learning (RL) shows great potential in sequential decision-making. At present, mainstream RL algorithms are data-driven, which usually yield better asymptotic performance but much slower convergence compared with model-driven…

Machine Learning · Computer Science 2024-02-27 Yang Guan , Jingliang Duan , Shengbo Eben Li , Jie Li , Jianyu Chen , Bo Cheng

In this paper, we tackle the state transformation problem in non-strict full state-constrained systems by introducing an adaptive fixed-time control method, utilizing a one-to-one asymmetric nonlinear mapping auxiliary system. Additionally,…

Systems and Control · Electrical Eng. & Systems 2025-05-28 Chenglin Gong , Ziming Wang , Guanxuan Jiang , Xin Wang , Yiding Ji

We propose a novel adaptive reinforcement learning control approach for fault tolerant control of degrading systems that is not preceded by a fault detection and diagnosis step. Therefore, \textit{a priori} knowledge of faults that may…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Marcos Quiñones-Grueiro , Gautam Biswas

Traditional controllers have limitations as they rely on prior knowledge about the physics of the problem, require modeling of dynamics, and struggle to adapt to abnormal situations. Deep reinforcement learning has the potential to address…

Machine Learning · Computer Science 2023-10-24 Ammar N. Abbas , Georgios C. Chasparis , John D. Kelleher

Many applications -- including power systems, robotics, and economics -- involve a dynamical system interacting with a stochastic and hard-to-model environment. We adopt a reinforcement learning approach to control such systems.…

Optimization and Control · Mathematics 2025-08-26 Abed AlRahman Al Makdah , Oliver Kosut , Lalitha Sankar , Shaofeng Zou

Policy gradient methods in reinforcement learning update policy parameters by taking steps in the direction of an estimated gradient of policy value. In this paper, we consider the statistically efficient estimation of policy gradients from…

Machine Learning · Statistics 2020-02-21 Nathan Kallus , Masatoshi Uehara

Given the high dimensionality and underlying complexity of many oscillatory dynamical systems, phase reduction is often an imperative first step in control applications where oscillation timing and entrainment are of interest.…

Dynamical Systems · Mathematics 2021-02-10 Dan Wilson

ESG-aware portfolio optimization is increasingly important for sustainable capital allocation, yet most learning-based methods still operationalize ESG by appending static scores to the policy observation or reward. This creates a mismatch…

Artificial Intelligence · Computer Science 2026-05-12 Xin Li , Yan Ke , Longbing Cao

Soft robotic manipulators offer operational advantage due to their compliant and deformable structures. However, their inherently nonlinear dynamics presents substantial challenges. Traditional analytical methods often depend on simplifying…

Robotics · Computer Science 2024-10-28 Uljad Berdica , Matthew Jackson , Niccolò Enrico Veronese , Jakob Foerster , Perla Maiolino

On-chip learning is key to scalable and adaptive neuromorphic systems, yet existing training methods are either difficult to implement in hardware or overly restrictive. However, recent studies show that feedback-control optimizers can…

Proportional-integral-derivative (PID) controllers have been widely used in the process industry. However, the satisfactory control performance of a PID controller depends strongly on the tuning parameters. Conventional PID tuning methods…

Systems and Control · Electrical Eng. & Systems 2022-10-06 Myisha A. Chowdhury , Qiugang Lu

Reinforcement learning for control over continuous spaces typically uses high-entropy stochastic policies, such as Gaussian distributions, for local exploration and estimating policy gradient to optimize performance. Many robotic control…

Machine Learning · Computer Science 2024-04-03 Ya-Chien Chang , Sicun Gao

This paper presents novel methods for achieving stable and efficient convergence in multivariable extremum seeking control (ESC) using sliding mode techniques. Drawing inspiration from both classical sliding mode control and more recent…

Optimization and Control · Mathematics 2025-08-13 Roberto Luo , Victor Hugo Pereira Rodrigues , Tiago Roux Oliveira , Miroslav Krstic

Modern deep learning systems are typically deployed as open-loop function approximators: they map inputs to outputs in a single pass, without regulating how much computation or explanatory effort is spent on a given case. In safety-critical…

Machine Learning · Computer Science 2025-12-02 Vishal Joshua Meesala

Imitation learning is a control design paradigm that seeks to learn a control policy reproducing demonstrations from expert agents. By substituting expert demonstrations for optimal behaviours, the same paradigm leads to the design of…

Machine Learning · Computer Science 2024-12-20 Dharmesh Tailor , Dario Izzo

With widespread deployment of renewables, the electric power grids are experiencing increasing dynamics and uncertainties, with its secure operation being threatened. Existing frequency control schemes based on day-ahead offline analysis…

Systems and Control · Electrical Eng. & Systems 2022-02-02 Yi Zhou , Liangcai Zhou , Di Shi , Xiaoying Zhao

Training deep learning models on embedded devices is typically avoided since this requires more memory, computation and power over inference. In this work, we focus on lowering the amount of memory needed for storing all activations, which…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Robby Neven , Marian Verhelst , Tinne Tuytelaars , Toon Goedemé

Large language models are typically post-trained using supervised fine-tuning (SFT) and reinforcement learning (RL), yet effectively unifying efficient knowledge injection with robust generalization remains challenging. In this work, we…

Artificial Intelligence · Computer Science 2026-05-05 Wangjie Gan , Miao Pan , Linbo Xi , Wenqi Zhang , Jintao Chen , Jianwei Yin , Xuhong Zhang