English
Related papers

Related papers: Optimal Exploration for Model-Based RL in Nonlinea…

200 papers

We draw on the latest advancements in the physics community to propose a novel method for discovering the governing non-linear dynamics of physical systems in reinforcement learning (RL). We establish that this method is capable of…

Machine Learning · Computer Science 2022-09-01 Rushiv Arora , Bruno Castro da Silva , Eliot Moss

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

Robotics · Computer Science 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

Nonlinear systems play a significant role in numerous scientific and engineering disciplines, and comprehending their behavior is crucial for the development of effective control and prediction strategies. This paper introduces a novel…

Systems and Control · Electrical Eng. & Systems 2023-08-15 Kaushal Kumar

We study the fundamental problem of learning a marginally stable unknown nonlinear dynamical system. We describe an algorithm for this problem, based on the technique of spectral filtering, which learns a mapping from past observations to…

Machine Learning · Computer Science 2025-08-19 Evan Dogariu , Anand Brahmbhatt , Elad Hazan

Controllable Markov chains describe the dynamics of sequential decision making tasks and are the central component in optimal control and reinforcement learning. In this work, we give the general form of an optimal policy for learning…

Machine Learning · Computer Science 2025-12-24 Peter N. Loxley

We address the problem of learning to control an unknown nonlinear dynamical system through sequential interactions. Motivated by high-stakes applications in which mistakes can be catastrophic, such as robotics and healthcare, we study…

Machine Learning · Computer Science 2025-04-14 James Wang , Bruce D. Lee , Ingvar Ziemann , Nikolai Matni

The paper presents a robust parameter learning methodology for identification of nonlinear dynamical system from data while satisfying safety and stability constraints in the context of learning from demonstration (LfD) methods. Extreme…

Systems and Control · Electrical Eng. & Systems 2022-12-12 Iman Salehi , Ghananeel Rotithor , Ashwin P. Dani

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar

In this paper, we propose an online learning-based predictive control (LPC) approach designed for nonlinear systems that lack explicit system dynamics. Unlike traditional model predictive control (MPC) algorithms that rely on known system…

Optimization and Control · Mathematics 2025-03-17 Yuanqing Zhang , Huanshui Zhang

Real-world control applications in complex and uncertain environments require adaptability to handle model uncertainties and robustness against disturbances. This paper presents an online, output-feedback, critic-only, model-based…

Systems and Control · Electrical Eng. & Systems 2023-04-25 Tochukwu Elijah Ogri , Zachary I. Bell , Rushikesh Kamalapurkar

Research on control using models based on machine-learning methods has now shifted to the practical engineering stage. Achieving high performance and theoretically guaranteeing the safety of the system is critical for such applications. In…

Systems and Control · Electrical Eng. & Systems 2025-01-28 Ryuta Moriyasu , Masayuki Kusunoki , Kenji Kashima

Real-time computation of optimal control is a challenging problem and, to solve this difficulty, many frameworks proposed to use learning techniques to learn (possibly sub-optimal) controllers and enable their usage in an online fashion.…

This work studies the design of safe control policies for large-scale non-linear systems operating in uncertain environments. In such a case, the robust control framework is a principled approach to safety that aims to maximize the…

Systems and Control · Computer Science 2019-03-04 Edouard Leurent , Yann Blanco , Denis Efimov , Odalric-Ambrym Maillard

Infinite-time nonlinear optimal regulation control is widely utilized in aerospace engineering as a systematic method for synthesizing stable controllers. However, conventional methods often rely on linearization hypothesis, while recent…

Systems and Control · Electrical Eng. & Systems 2025-06-13 Han Wang , Di Wu , Lin Cheng , Shengping Gong , Xu Huang

We present a three-step method to perform system identification and optimal control of non-linear systems. Our approach is mainly data driven and does not require active excitation of the system to perform system identification. In…

Systems and Control · Electrical Eng. & Systems 2020-09-16 Baptiste Schubnel , Rafael E. Carrillo , Pierre-Jean Alet , Andreas Hutter

In this work we present a general machine learning based scheme to optimize experimental control. The method utilizes the neural network to learn the relation between the control parameters and the control goal, with which the optimal…

Quantum Gases · Physics 2020-11-03 Yadong Wu , Zengming Meng , Kai Wen , Chengdong Mi , Jing Zhang , Hui Zhai

We propose a learning-based robust predictive control algorithm that compensates for significant uncertainty in the dynamics for a class of discrete-time systems that are nominally linear with an additive nonlinear component. Such systems…

Systems and Control · Electrical Eng. & Systems 2021-10-15 Rohan Sinha , James Harrison , Spencer M. Richards , Marco Pavone

This paper considers the problem of real-time control and learning in dynamic systems subjected to parametric uncertainties. We propose a combination of a Reinforcement Learning (RL) based policy in the outer loop suitably chosen to ensure…

Machine Learning · Computer Science 2023-06-13 Anuradha M. Annaswamy , Anubhav Guha , Yingnan Cui , Sunbochen Tang , Peter A. Fisher , Joseph E. Gaudio

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

A fundamental challenge in learning to control an unknown dynamical system is to reduce model uncertainty by making measurements while maintaining safety. In this work, we formulate a mathematical definition of what it means to safely learn…

Optimization and Control · Mathematics 2020-11-25 Amir Ali Ahmadi , Abraar Chaudhry , Vikas Sindhwani , Stephen Tu