English
Related papers

Related papers: Model-Based Policy Search for Automatic Tuning of …

200 papers

Modelling complex multiphysics systems governed by nonlinear and strongly coupled partial differential equations (PDEs) is a cornerstone in computational science and engineering. However, it remains a formidable challenge for traditional…

Machine Learning · Computer Science 2025-02-28 Biao Yuan , He Wang , Yanjie Song , Ana Heitor , Xiaohui Chen

The aim of this work is to control the longitudinal position of an autonomous vehicle with an internal combustion engine. The powertrain has an inherent dead-time characteristic and constraints on physical states apply since the vehicle is…

Systems and Control · Electrical Eng. & Systems 2021-01-15 André Kempf , Markus Herrmann-Wicklmayr , Steffen Müller

Real-world autonomous systems operate under uncertainty about both their pose and dynamics. Autonomous control systems must simultaneously perform estimation and control tasks to maintain robustness to changing dynamics or modeling errors.…

Systems and Control · Computer Science 2018-08-03 Patrick Slade , Zachary N. Sunberg , Mykel J. Kochenderfer

In adaptive control, a controller is precisely designed for a certain model of the system, but that model's parameters are updated online by another mechanism called the adaptive update. This allows the controller to aim for the benefits of…

Systems and Control · Computer Science 2017-11-28 Jason Nezvadovitz

This paper addresses the problem of controlling a continuum manipulator (CM) in free or obstructed environments with no prior knowledge about the deformation behavior of the CM and the stiffness and geometry of the interacting obstructed…

Robotics · Computer Science 2020-05-06 Farshid Alambeigi , Zerui Wang , Yun-Hui Liu , Russell H. Taylor , Mehran Armand

Solving goal-oriented tasks is an important but challenging problem in reinforcement learning (RL). For such tasks, the rewards are often sparse, making it difficult to learn a policy effectively. To tackle this difficulty, we propose a new…

Machine Learning · Computer Science 2019-11-04 Hao Sun , Zhizhong Li , Xiaotong Liu , Dahua Lin , Bolei Zhou

We study reinforcement learning in hybrid discrete-continuous action spaces, such as settings where the discrete component selects a regime (or index) and the continuous component optimizes within it -- a structure common in robotics,…

Machine Learning · Computer Science 2026-05-15 Matias Alvo , Daniel Russo , Yash Kanoria

Proportional-integral-derivative (PID) control is the most widely used in industrial control, robot control and other fields. However, traditional PID control is not competent when the system cannot be accurately modeled and the operating…

Robotics · Computer Science 2021-07-13 Xinyi Yu , Yuehai Fan , Siyu Xu , Linlin Ou

Most policy search algorithms require thousands of training episodes to find an effective policy, which is often infeasible with a physical robot. This survey article focuses on the extreme other end of the spectrum: how can a robot adapt…

Model-based reinforcement learning (RL) can be effectively supported at scale through the use of world models. However, in practice, scaling such approaches remains fundamentally limited. A commonly recognized challenge is model bias and…

Machine Learning · Computer Science 2026-05-27 Xiaoyuan Cheng , Wenxuan Yuan , Zhancun Mu , Yuanzhao Zhang , Yiming Yang , Hai Wang , Zhuo Sun , Che Liu

Leveraging planning during learning and decision-making is central to the long-term development of intelligent agents. Recent works have successfully combined tree-based search methods and self-play learning mechanisms to this end. However,…

Artificial Intelligence · Computer Science 2024-11-01 Matthew V Macfarlane , Edan Toledo , Donal Byrne , Paul Duckworth , Alexandre Laterre

This paper investigates the control of nonlinear systems using a piecewise linear approximation framework. The proposed approach combines a PID controller with locally linearized models obtained by partitioning the nonlinear function into…

Optimization and Control · Mathematics 2026-04-14 Robert Vrabel

This paper presents a data-driven strategy to streamline the deployment of model-based controllers in legged robotic hardware platforms. Our approach leverages a model-free safe learning algorithm to automate the tuning of control gains,…

Robotics · Computer Science 2023-10-27 Daniel Widmer , Dongho Kang , Bhavya Sukhija , Jonas Hübotter , Andreas Krause , Stelian Coros

Contemporary autopilot systems for unmanned aerial vehicles (UAVs) are far more limited in their flight envelope as compared to experienced human pilots, thereby restricting the conditions UAVs can operate in and the types of missions they…

Robotics · Computer Science 2019-11-14 Eivind Bøhn , Erlend M. Coates , Signe Moe , Tor Arne Johansen

End-to-end autonomous driving is typically built upon imitation learning (IL), yet its performance is constrained by the quality of human demonstrations. To overcome this limitation, recent methods incorporate reinforcement learning (RL)…

Robotics · Computer Science 2026-04-13 Zhexi Lian , Haoran Wang , Xuerun Yan , Weimeng Lin , Xianhong Zhang , Yongyu Chen , Jia Hu

Stabilizing an unknown control system is one of the most fundamental problems in control systems engineering. In this paper, we provide a simple, model-free algorithm for stabilizing fully observed dynamical systems. While model-free…

Systems and Control · Electrical Eng. & Systems 2021-10-14 Juan C. Perdomo , Jack Umenberger , Max Simchowitz

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance…

Machine Learning · Computer Science 2019-06-27 Tung-Long Vuong , Kenneth Tran

Complexity and nonlinear behaviours of inverted pendulum system make its control design a very challenging task. In this paper, a hybrid fuzzy adaptive control system using model reference approach is designed for inverted-pendulum system…

Systems and Control · Electrical Eng. & Systems 2019-10-18 Abdulbasid Ismail Isa , Mukhtar Fatihu Hamza , Mustapha Muhammad

The tunable approximated explicit model predictive control (MPC) comes with the benefits of real-time tunability without the necessity of solving the optimization problem online. This paper provides a novel self-tunable control policy that…

Systems and Control · Electrical Eng. & Systems 2024-06-07 Lenka Galčíková , Juraj Oravec

Today's autonomous vehicles rely on a multitude of sensors to perceive their environment. To improve the perception or create redundancy, the sensor's alignment relative to each other must be known. With Multi-LiCa, we present a novel…

Robotics · Computer Science 2025-04-23 Dominik Kulmer , Ilir Tahiraj , Andrii Chumak , Markus Lienkamp