English
Related papers

Related papers: Reinforcement learning for port-Hamiltonian system…

200 papers

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a…

Systems and Control · Electrical Eng. & Systems 2021-09-14 Robert Dyro , James Harrison , Apoorva Sharma , Marco Pavone

We propose an iterative approach for designing Robust Learning Model Predictive Control (LMPC) policies for a class of nonlinear systems with additive, unmodelled dynamics. The nominal dynamics are assumed to be difference flat, i.e., the…

Systems and Control · Electrical Eng. & Systems 2023-03-23 Siddharth H. Nair , Francesco Borrelli

To extend the realm of application of the well known controller design technique of interconnection and damping assignment passivity-based control (IDA-PBC) of mechanical systems two modifications to the standard method are presented in…

Optimization and Control · Mathematics 2015-06-26 Alejandro Donaire , Romeo Ortega , Jose Guadalupe Romero

Following the recent resurgence in establishing linear control theoretic benchmarks for reinforcement leaning (RL)-based policy optimization (PO) for complex dynamical systems with continuous state and action spaces, an optimal control…

Systems and Control · Electrical Eng. & Systems 2023-06-30 Leilei Cui , Lekan Molu

We propose and analyze a real-time model predictive control (MPC) scheme that utilizes stored data to improve its performance by learning the value function online with stability guarantees. For linear and nonlinear systems, a learning…

Optimization and Control · Mathematics 2020-09-23 Lukas Schwenkel , Meriem Gharbi , Sebastian Trimpe , Christian Ebenbauer

We explore the use of policy gradient methods in reinforcement learning for quantum control via energy landscape shaping of XX-Heisenberg spin chains in a model agnostic fashion. Their performance is compared to finding controllers using…

Quantum Physics · Physics 2022-07-19 I. Khalid , C. A. Weidner , E. A. Jonckheere , S. G. Schirmer , F. C. Langbein

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

Systems and Control · Electrical Eng. & Systems 2022-03-24 Daniel Tabas , Baosen Zhang

We present a differentiable predictive control (DPC) methodology for learning constrained control laws for unknown nonlinear systems. DPC poses an approximate solution to multiparametric programming problems emerging from explicit nonlinear…

Systems and Control · Electrical Eng. & Systems 2021-07-27 Jan Drgona , Aaron Tuor , Soumya Vasisht , Elliott Skomski , Draguna Vrabie

Health-aware control (HAC) has emerged as one of the domains where control synthesis is sought based upon the failure prognostics of system/component or the Remaining Useful Life (RUL) predictions of critical components. The fact that…

Artificial Intelligence · Computer Science 2020-10-20 Mayank Shekhar Jha , Philippe Weber , Didier Theilliol , Jean-Christophe Ponsart , Didier Maquin

This paper presents an auto-optimization control framework for wave energy converters (WECs) to maximize energy generation under unknown and changing ocean conditions. The proposed control framework consists of two levels. The high-level…

Systems and Control · Electrical Eng. & Systems 2025-07-08 Siyang Tang , Wen-Hua Chen , Cunjia Liu

Buildings account for approximately 40% of global energy consumption, and with the growing share of intermittent renewable energy sources, enabling demand-side flexibility, particularly in heating, ventilation and air conditioning systems,…

Systems and Control · Electrical Eng. & Systems 2026-04-20 Colin Jüni , Mina Montazeri , Yi Guo , Federica Bellizio , Giovanni Sansavini , Philipp Heer

Control contraction metrics (CCMs) provide a framework to co-synthesize a controller and a corresponding contraction metric -- a positive-definite Riemannian metric under which a closed-loop system is guaranteed to be incrementally…

Machine Learning · Computer Science 2025-06-23 Minjae Cho , Hiroyasu Tsukamoto , Huy Trong Tran

In this work we present a constructive method to design a family of virtual contraction based controllers that solve the standard trajectory tracking problem of flexible-joint robots (FJRs) in the port-Hamiltonian (pH) framework. The…

Systems and Control · Electrical Eng. & Systems 2020-02-06 Rodolfo Reyes-Báez , Arjan van der Schaft , Bayu Jayawardhana , Le Pan

This paper deals with the problem of control of partially known nonlinear systems, which have an open-loop stable equilibrium, but we would like to add a PI controller to regulate its behavior around another operating point. Our main…

Systems and Control · Computer Science 2016-04-08 Stanislav Aranovskiy , Romeo Ortega , Rafael Cisneros

Designing predictive controllers towards optimal closed-loop performance while maintaining safety and stability is challenging. This work explores closed-loop learning for predictive control parameters under imperfect information while…

Systems and Control · Electrical Eng. & Systems 2024-04-19 Sebastian Hirt , Maik Pfefferkorn , Ali Mesbah , Rolf Findeisen

Ensuring safety under unknown and stochastic dynamics remains a significant challenge in reinforcement learning (RL). In this paper, we propose a model predictive control (MPC)-based safe RL framework, called Probabilistic Ensembles with…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Ali Umut Kaypak , Prashanth Krishnamurthy , Farshad Khorrami

Model Predictive Control (MPC) provides interpretable, tunable locomotion controllers grounded in physical models, but its robustness depends on frequent replanning and is limited by model mismatch and real-time computational constraints.…

Robotics · Computer Science 2025-10-15 Se Hwan Jeon , Ho Jae Lee , Seungwoo Hong , Sangbae Kim

This paper introduces a reinforcement learning-based tracking control approach for a class of nonlinear systems using neural networks. In this approach, adversarial attacks were considered both in the actuator and on the outputs. This…

Systems and Control · Electrical Eng. & Systems 2022-09-20 Farshad Rahimi , Sepideh Ziaei

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

Recently, adaptive control systems with relaxed persistent excitation (PE) conditions have been proposed to guarantee true parameter convergence and improve the transient response. However, in some cases, sufficient control performance and…

Systems and Control · Electrical Eng. & Systems 2025-03-03 Satoshi Tsuruhara , Kazuhisa Ito