English
Related papers

Related papers: Model-Based Policy Search for Automatic Tuning of …

200 papers

We consider the problem of computing optimal linear control policies for linear systems in finite-horizon. The states and the inputs are required to remain inside pre-specified safety sets at all times despite unknown disturbances. In this…

Systems and Control · Computer Science 2019-12-17 Luca Furieri , Maryam Kamgarpour

Reinforcement learning algorithms require a large amount of samples; this often limits their real-world applications on even simple tasks. Such a challenge is more outstanding in multi-agent tasks, as each step of operation is more costly…

Machine Learning · Computer Science 2022-09-05 Yali Du , Chengdong Ma , Yuchen Liu , Runji Lin , Hao Dong , Jun Wang , Yaodong Yang

In this article, a model predictive control (MPC) method is proposed for constrained linear systems to track bounded references with arbitrary dynamics. Besides control inputs to be determined, artificial reference is introduced as…

Systems and Control · Electrical Eng. & Systems 2025-03-27 Shibo Han , Bonan Hou , Yuhao Zhang , Xiaotong Shi , Xingwei Zhao

Reinforcement learning (RL) is a promising method to solve control problems. However, model-free RL algorithms are sample inefficient and require thousands if not millions of samples to learn optimal control policies. A major source of…

Machine Learning · Computer Science 2022-10-31 Atish Dixit , Ahmed Elsheikh

The model-free control approach is an advanced control law that requires few information about the process to control. Since its introduction in 2008, numerous applications have been successfully considered, highlighting attractive…

Systems and Control · Computer Science 2025-02-27 Loïc Michel

This paper presents the design of a tune-free (human-out-of-the-loop parameter tuning) control framework, aiming at accelerating large scale autonomous driving system deployed on various vehicles and driving environments. The framework…

Robotics · Computer Science 2020-11-10 Yu Wang , Shu Jiang , Weiman Lin , Yu Cao , Longtao Lin , Jiangtao Hu , Jinghao Miao , Qi Luo

This paper evaluates and compares the performance of model-free and model-based reinforcement learning for the attitude control of fixed-wing unmanned aerial vehicles using PID as a reference point. The comparison focuses on their ability…

Robotics · Computer Science 2024-09-27 David Olivares , Pierre Fournier , Pavan Vasishta , Julien Marzat

The closed-loop performance of model predictive controllers (MPCs) is sensitive to the choice of prediction models, controller formulation, and tuning parameters. However, prediction models are typically optimized for prediction accuracy…

Systems and Control · Electrical Eng. & Systems 2020-11-25 Farshud Sorourifar , Georgios Makrygirgos , Ali Mesbah , Joel A. Paulson

It is well-known that the classical PID controller is by far the most widely used ones in industrial processes, despite of the remarkable progresses of the modern control theory over the past half a century. It is also true that the…

Optimization and Control · Mathematics 2016-12-21 Cheng Zhao , Lei Guo

We present a three-step method to perform system identification and optimal control of non-linear systems. Our approach is mainly data driven and does not require active excitation of the system to perform system identification. In…

Systems and Control · Electrical Eng. & Systems 2020-09-16 Baptiste Schubnel , Rafael E. Carrillo , Pierre-Jean Alet , Andreas Hutter

Instability and slowness are two main problems in deep reinforcement learning. Even if proximal policy optimization (PPO) is the state of the art, it still suffers from these two problems. We introduce an improved algorithm based on…

Machine Learning · Computer Science 2019-10-01 Zhenyu Zhang , Xiangfeng Luo , Tong Liu , Shaorong Xie , Jianshu Wang , Wei Wang , Yang Li , Yan Peng

This work examines the optimal covariance steering problem for systems subject to unknown parameters that enter multiplicatively with the state and control, in addition to additive disturbances. In contrast to existing works, the unknown…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Jacob W. Knaup , Panagiotis Tsiotras

The response to a setpoint change in PID controlled feedback systems plays an important role for the tuning methods. This response may be easily evaluated in linear systems without delay by solving the related ordinary differential…

Optimization and Control · Mathematics 2007-05-23 Gianpasquale Martelli

Model predictive control (MPC) is a popular control method that has proved effective for robotics, among other fields. MPC performs re-planning at every time step. Re-planning is done with a limited horizon per computational and real-time…

Robotics · Computer Science 2017-03-22 Aviv Tamar , Garrett Thomas , Tianhao Zhang , Sergey Levine , Pieter Abbeel

Many practical applications of optimal control are subject to real-time computational constraints. When applying model predictive control (MPC) in these settings, respecting timing constraints is achieved by limiting the number of…

Optimization and Control · Mathematics 2024-12-16 Anusha Srikanthan , Aren Karapetyan , Vijay Kumar , Nikolai Matni

A robust model predictive control scheme for a class of constrained norm-bounded uncertain discrete-time linear systems is developed under the hypothesis that only partial state measurements are available for feedback. Off-line calculations…

Systems and Control · Computer Science 2018-07-23 Giuseppe Franzè , Massimiliano Mattei , Luciano Ollio , Valerio Scordamaglia

We focus on developing efficient and reliable policy optimization strategies for robot learning with real-world data. In recent years, policy gradient methods have emerged as a promising paradigm for training control policies in simulation.…

Machine Learning · Computer Science 2023-11-07 Tyler Westenbroek , Jacob Levy , David Fridovich-Keil

Shared Control methods often use impedance control to track target poses in a robotic manipulator. The guidance behavior of such controllers is shaped by the used stiffness gains, which can be varying over time to achieve an adaptive…

Model-reference adaptive systems refer to a consortium of techniques that guide plants to track desired reference trajectories. Approaches based on theories like Lyapunov, sliding surfaces, and backstepping are typically employed to advise…

Systems and Control · Electrical Eng. & Systems 2023-03-20 Mohammed Abouheaf , Wail Gueaieb , Davide Spinello , Salah Al-Sharhan

Model-based reinforcement learning methods learn a dynamics model with real data sampled from the environment and leverage it to generate simulated data to derive an agent. However, due to the potential distribution mismatch between…

Machine Learning · Computer Science 2020-10-29 Jian Shen , Han Zhao , Weinan Zhang , Yong Yu