English
Related papers

Related papers: Combining Model-Based and Model-Free Methods for N…

200 papers

In this paper, we present the combined learning-and-control (CLC) approach, which is a new way to solve optimal control problems with unknown dynamics by unifying model-based control and data-driven learning. The key idea is simple: we…

Systems and Control · Electrical Eng. & Systems 2025-10-02 Panagiotis Kounatidis , Andreas A. Malikopoulos

Learning-based control methods typically assume stationary system dynamics, an assumption often violated in real-world systems due to drift, wear, or changing operating conditions. We study reinforcement learning for control under…

Machine Learning · Computer Science 2026-04-03 Klemens Iten , Bruce Lee , Chenhao Li , Lenart Treven , Andreas Krause , Bhavya Sukhija

Owing to the growth of interest in Reinforcement Learning in the last few years, gradient based policy control methods have been gaining popularity for Control problems as well. And rightly so, since gradient policy methods have the…

Machine Learning · Computer Science 2021-12-01 Santanu Rathod , Manoj Bhadu , Abir De

Machine-learned black-box policies are ubiquitous for nonlinear control problems. Meanwhile, crude model information is often available for these problems from, e.g., linear approximations of nonlinear dynamics. We study the problem of…

Machine Learning · Computer Science 2022-06-06 Tongxin Li , Ruixiao Yang , Guannan Qu , Yiheng Lin , Steven Low , Adam Wierman

We propose and demonstrate a nonlinear control method that can be applied to unknown, complex systems where the controller is based on a type of artificial neural network known as a reservoir computer. In contrast to many modern…

Systems and Control · Electrical Eng. & Systems 2020-10-07 Daniel Canaday , Andrew Pomerance , Daniel J Gauthier

Signal processing traditionally relies on classical statistical modeling techniques. Such model-based methods utilize mathematical formulations that represent the underlying physics, prior information and additional domain knowledge. Simple…

Signal Processing · Electrical Eng. & Systems 2023-06-08 Nir Shlezinger , Yonina C. Eldar

Model-free reinforcement learning algorithms can compute policy gradients given sampled environment transitions, but require large amounts of data. In contrast, model-based methods can use the learned model to generate new data, but model…

Machine Learning · Computer Science 2022-03-04 Lukas P. Fröhlich , Maksym Lefarov , Melanie N. Zeilinger , Felix Berkenkamp

The control and modeling of robot dynamics have increasingly adopted model-free control strategies using machine learning. Given the non-linear elastic nature of bionic robotic systems, learning-based methods provide reliable alternatives…

Robotics · Computer Science 2024-10-08 Po-Yu Hsieh , June-Hao Hou

This paper discusses the concept of model-driven software engineering applied to the Grid application domain. As an extension to this concept, the approach described here, attempts to combine both formal architecture-centric and…

Software Engineering · Computer Science 2007-05-23 David Manset , Herve Verjus , Richard McClatchey , Flavio Oquendo

In this paper, we develop a data-based controller design framework for diffusively coupled systems with guaranteed convergence to an $\epsilon$-neighborhood of the desired formation. The controller is comprised of a fixed controller with an…

Systems and Control · Electrical Eng. & Systems 2025-01-30 Miel Sharf , Anne Koch , Daniel Zelazo , Frank Allgöwer

The development of efficient and robust dynamic models is fundamental in the field of systems and control engineering. In this paper, a new formulation for the dynamic model of nonlinear mechanical systems, that can be applied to different…

Systems and Control · Electrical Eng. & Systems 2026-02-09 Davide Tebaldi , Roberto Zanasi

Model-based control is a popular paradigm for robot navigation because it can leverage a known dynamics model to efficiently plan robust robot trajectories. However, it is challenging to use model-based methods in settings where the…

Robotics · Computer Science 2019-07-19 Somil Bansal , Varun Tolani , Saurabh Gupta , Jitendra Malik , Claire Tomlin

Modern nonlinear control theory seeks to endow systems with properties such as stability and safety, and has been deployed successfully across various domains. Despite this success, model uncertainty remains a significant challenge in…

Systems and Control · Electrical Eng. & Systems 2021-04-02 Andrew J. Taylor , Victor D. Dorobantu , Sarah Dean , Benjamin Recht , Yisong Yue , Aaron D. Ames

Reinforcement Learning is divided in two main paradigms: model-free and model-based. Each of these two paradigms has strengths and limitations, and has been successfully applied to real world domains that are appropriate to its…

Machine Learning · Computer Science 2017-10-19 Somil Bansal , Roberto Calandra , Kurtland Chua , Sergey Levine , Claire Tomlin

The robust disturbance rejection controller has been the subject of intensive research due to its undeniable importance for automation. Modern control theory tends to use model-based approaches versus model-free approaches, especially when…

Systems and Control · Electrical Eng. & Systems 2022-01-03 Atta Oveisi

Gradient-based methods have been widely used for system design and optimization in diverse application domains. Recently, there has been a renewed interest in studying theoretical properties of these methods in the context of control and…

Optimization and Control · Mathematics 2022-10-11 Bin Hu , Kaiqing Zhang , Na Li , Mehran Mesbahi , Maryam Fazel , Tamer Başar

Risk-aware control, though with promise to tackle unexpected events, requires a known exact dynamical model. In this work, we propose a model-free framework to learn a risk-aware controller with a focus on the linear system. We formulate it…

Systems and Control · Electrical Eng. & Systems 2021-06-01 Feiran Zhao , Keyou You

Energy and pollution are urging problems of the 21th century. By gradually changing the actual power grid system, smart grid may evolve into different systems by means of size, elements and strategies, but its fundamental requirements and…

Optimization and Control · Mathematics 2025-12-19 Soufian Ben Amor , Alain Bui , Guillaume Guerard

The ability to achieve precise and smooth trajectory tracking is crucial for ensuring the successful execution of various tasks involving robotic manipulators. State-of-the-art techniques require accurate mathematical models of the robot…

Robotics · Computer Science 2024-06-21 Mohamed Abdelwahab , Giulio Giacomuzzo , Alberto Dalla Libera , Ruggero Carli

Learning-based optimal control algorithms control unknown systems using past trajectory data and a learned model of the system dynamics. These controllers use either a linear approximation of the learned dynamics, trading performance for…

Systems and Control · Electrical Eng. & Systems 2023-07-21 Adam W. Hall , Melissa Greeff , Angela P. Schoellig