English
Related papers

Related papers: Learning to control non-equilibrium dynamics using…

200 papers

Recent work on data-driven control and reinforcement learning has renewed interest in a relative old field in control theory: model-free optimal control approaches which work directly with a cost function and do not rely upon perfect…

Optimization and Control · Mathematics 2021-08-31 Eduardo D. Sontag

Given an unknown dynamical system, what is the minimum number of samples needed for effective learning of its governing laws and accurate prediction of its future evolution behavior, and how to select these critical samples? In this work,…

Machine Learning · Computer Science 2024-01-15 Ce Zhang , Kailiang Wu , Zhihai He

This paper proposes a novel online data-driven adaptive control for unknown linear time-varying systems. Initialized with an empirical feedback gain, the algorithm periodically updates this gain based on the data collected over a short time…

Systems and Control · Electrical Eng. & Systems 2024-01-31 Shenyu Liu , Kaiwen Chen , Jaap Eising

Growing demands in the semiconductor industry result in the need for enhanced performance of lithographic equipment. However, position tracking accuracy of high precision mechatronics is often limited by the presence of disturbance sources,…

Systems and Control · Electrical Eng. & Systems 2021-05-05 Ioannis Proimadis , Yorick Broens , Roland Tóth , Hans Butler

Output reference tracking can be improved by iteratively learning from past data to inform the design of feedforward control inputs for subsequent tracking attempts. This process is called iterative learning control (ILC). This article…

Systems and Control · Electrical Eng. & Systems 2021-08-18 Isaac A Spiegel , Nard Strijbosch , Tom Oomen , Kira Barton

This article studies the control ideas of the optimal backstepping technique, proposing an event-triggered optimal tracking control scheme for a class of strict-feedback nonlinear systems with non-affine and nonlinear faults. A simplified…

Optimization and Control · Mathematics 2024-06-13 Ling Wang , Xin Wang , Ziming Wang

We investigate robust model-free reinforcement learning algorithms designed for environments that may be dynamic or even adversarial. Traditional state-based policies often struggle to accommodate the challenges imposed by the presence of…

Machine Learning · Computer Science 2023-11-02 Udaya Ghai , Arushi Gupta , Wenhan Xia , Karan Singh , Elad Hazan

In this article, we present data-driven feedback linearization for nonlinear systems with periodic orbits in the zero-dynamics. This scenario is challenging for data-driven control design because the higher order terms of the internal…

Systems and Control · Electrical Eng. & Systems 2022-11-22 Karthik Shenoy , Akshit Saradagi , Ramkrishna Pasumarthy , Vijaysekhar Chellaboina

As robotic systems move from highly structured environments to open worlds, incorporating uncertainty from dynamics learning or state estimation into the control pipeline is essential for robust performance. In this paper we present a…

Systems and Control · Electrical Eng. & Systems 2021-09-14 Robert Dyro , James Harrison , Apoorva Sharma , Marco Pavone

In this work, we propose a rigorous method for implementing predictor feedback controllers in nonlinear systems with unknown and arbitrarily long actuator delays. To address the analytically intractable nature of the predictor, we…

Systems and Control · Electrical Eng. & Systems 2025-08-29 Luke Bhan , Miroslav Krstic , Yuanyuan Shi

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Iterative self-correction is increasingly deployed in agentic LLM systems, yet whether repeated refinement improves or degrades performance remains inconsistent across models. We recast self-correction as a closed-loop feedback-control…

Artificial Intelligence · Computer Science 2026-05-05 Aofan Liu , Jingxiang Meng

In real-world robotics applications, accurate models of robot dynamics are critical for safe and stable control in rapidly changing operational conditions. This motivates the use of machine learning techniques to approximate robot dynamics…

Robotics · Computer Science 2022-01-13 Thai Duong , Nikolay Atanasov

Achieving both optimality and safety under unknown system dynamics is a central challenge in real-world deployment of agents. To address this, we introduce a notion of maximum safe dynamics learning, where sufficient exploration is…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Manish Prajapat , Johannes Köhler , Melanie N. Zeilinger , Andreas Krause

Modeling how a robot interacts with the environment around it is an important prerequisite for designing control and planning algorithms. In fact, the performance of controllers and planners is highly dependent on the quality of the model.…

Machine Learning · Computer Science 2020-03-03 Clark Zhang , Arbaaz Khan , Santiago Paternain , Alejandro Ribeiro

This survey paper deals with the stabilization of nonlinear systems by analyzing the controlling method in terms of state feedback and output feedback. A brief overview of some literature on how the feedback controller of some dynamic…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Demelash Abiye Deguale

This paper addresses the problem of online inverse reinforcement learning for systems with limited data and uncertain dynamics. In the developed approach, the state and control trajectories are recorded online by observing an agent perform…

Systems and Control · Electrical Eng. & Systems 2020-08-21 Ryan Self , S M Nahid Mahmud , Katrine Hareland , Rushikesh Kamalapurkar

Brains need to predict how the body reacts to motor commands. It is an open question how networks of spiking neurons can learn to reproduce the non-linear body dynamics caused by motor commands, using local, online and stable learning…

Neurons and Cognition · Quantitative Biology 2017-11-30 Aditya Gilra , Wulfram Gerstner

Optimal control problems of tracking type for a class of linear systems with uncertain parameters in the dynamics are investigated. An affine tracking feedback control input is obtained by considering the minimization of an energy-like…

Optimization and Control · Mathematics 2024-02-02 Philipp A. Guth , Karl Kunisch , Sergio S. Rodrigues

This work developed a meta-learning approach that adapts the control policy on the fly to different changing conditions for robust locomotion. The proposed method constantly updates the interaction model, samples feasible sequences of…

Robotics · Computer Science 2021-01-20 Timothée Anne , Jack Wilkinson , Zhibin Li