English
Related papers

Related papers: Combining Model-Based and Model-Free Methods for N…

200 papers

Model-based reinforcement learning approaches carry the promise of being data efficient. However, due to challenges in learning dynamics models that sufficiently match the real-world dynamics, they struggle to achieve the same asymptotic…

Machine Learning · Computer Science 2018-09-17 Ignasi Clavera , Jonas Rothfuss , John Schulman , Yasuhiro Fujita , Tamim Asfour , Pieter Abbeel

In the context of model-based control of industrial processes, it is a common practice to develop a data-driven linear dynamical model around a specified operating point. However, in applications involving wider operating conditions,…

Systems and Control · Electrical Eng. & Systems 2024-06-07 Vatsal Kedia , Vivek S. Pinnamaraju , Dinesh Patil

Reinforcement learning (RL) algorithms for real-world robotic applications need a data-efficient learning process and the ability to handle complex, unknown dynamical systems. These requirements are handled well by model-based and…

Robotics · Computer Science 2017-06-20 Yevgen Chebotar , Karol Hausman , Marvin Zhang , Gaurav Sukhatme , Stefan Schaal , Sergey Levine

In order to increase the number of situations in which an intelligent vehicle can operate without human intervention, lateral control is required to accurately guide it in a reference trajectory regardless of the shape of the road or the…

Systems and Control · Electrical Eng. & Systems 2022-10-05 Marcos Moreno-Gonzalez , Antonio Artuñedo , Jorge Villagra , Cédric Join , Michel Fliess

Feedback optimization is a control paradigm that enables physical systems to autonomously reach efficient operating points. Its central idea is to interconnect optimization iterations in closed-loop with the physical plant. Since iterative…

Optimization and Control · Mathematics 2024-07-16 Zhiyu He , Saverio Bolognani , Jianping He , Florian Dörfler , Xinping Guan

Learning for model based control can be sample-efficient and generalize well, however successfully learning models and controllers that represent the problem at hand can be challenging for complex tasks. Using inaccurate models for learning…

Robotics · Computer Science 2020-11-10 Sarah Bechtle , Bilal Hammoud , Akshara Rai , Franziska Meier , Ludovic Righetti

Model-based control requires an accurate model of the system dynamics for precisely and safely controlling the robot in complex and dynamic environments. Moreover, in the presence of variations in the operating conditions, the model should…

Robotics · Computer Science 2024-09-04 Alessandro Saviolo , Jonathan Frey , Abhishek Rathod , Moritz Diehl , Giuseppe Loianno

Models play an essential role in the design process of cyber-physical systems. They form the basis for simulation and analysis and help in identifying design problems as early as possible. However, the construction of models that comprise…

This paper compares two different types of data-driven control methods, representing model-based and model-free approaches. One is a recently proposed method - Deep Koopman Representation for Control (DKRC), which utilizes a deep neural…

Machine Learning · Computer Science 2020-06-18 Wenjian Hao , Yiqiang Han

We show how optimal nonlinear regulation can be achieved in a model predictive control fashion.

Optimization and Control · Mathematics 2013-10-29 Cesar O. Aguilar , Arthur J. Krener

The design of control engineering applications usually requires a model that accurately represents the dynamics of the real system. In addition to classical physical modeling, powerful data-driven approaches are increasingly used. However,…

Systems and Control · Electrical Eng. & Systems 2023-01-02 Annika Junker , Julia Timmermann , Ansgar Trächtler

Model-based policy optimization often struggles with inaccurate system dynamics models, leading to suboptimal closed-loop performance. This challenge is especially evident in Model Predictive Control (MPC) policies, which rely on the model…

Systems and Control · Electrical Eng. & Systems 2026-04-21 Riccardo Zuliani , Efe C. Balta , John Lygeros

In this paper a new framework has been applied to the design of controllers which encompasses nonlinearity, hysteresis and arbitrary density functions of forward models and inverse controllers. Using mixture density networks, the…

Optimization and Control · Mathematics 2018-01-09 Randa Herzallah

This paper introduces a continuous-time constrained nonlinear control scheme which implements a model predictive control strategy as a continuous-time dynamic system. The approach is based on the idea that the solution of the optimal…

Systems and Control · Computer Science 2017-09-20 Marco M. Nicotra , Dominic Liao-McPherson , Ilya V. Kolmanovsky

Data-driven control offers a powerful alternative to traditional model-based methods, particularly when accurate system models are unavailable or prohibitively complex. While existing data-driven control methods primarily aim to construct…

Systems and Control · Electrical Eng. & Systems 2026-01-12 Janina Schaa , Thomas Berger

While artificial-intelligence-based methods suffer from lack of transparency, rule-based methods dominate in safety-critical systems. Yet, the latter cannot compete with the first ones in robustness to multiple requirements, for instance,…

Artificial Intelligence · Computer Science 2022-02-01 Andrei Aksjonov , Ville Kyrki

A desirable property in fault-tolerant controllers is adaptability to system changes as they evolve during systems operations. An adaptive controller does not require optimal control policies to be enumerated for possible faults. Instead it…

Systems and Control · Electrical Eng. & Systems 2020-08-12 Ibrahim Ahmed , Hamed Khorasgani , Gautam Biswas

This paper considers the optimal control for hybrid systems whose trajectories transition between distinct subsystems when state-dependent constraints are satisfied. Though this class of systems is useful while modeling a variety of…

Optimization and Control · Mathematics 2018-03-21 Pengcheng Zhao , Shankar Mohan , Ram Vasudevan

In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of…

Systems and Control · Electrical Eng. & Systems 2023-02-07 Mohammed I. Abouheaf , Hashim A. Hashim , Mohammad A. Mayyas , Kyriakos G. Vamvoudakis

Reinforcement learning has been established over the past decade as an effective tool to find optimal control policies for dynamical systems, with recent focus on approaches that guarantee safety during the learning and/or execution phases.…

Systems and Control · Electrical Eng. & Systems 2021-10-06 S M Nahid Mahmud , Scott A Nivison , Zachary I. Bell , Rushikesh Kamalapurkar