English
Related papers

Related papers: Reinforcement Learning Ship Autopilot: Sample effi…

200 papers

Model predictive control (MPC) is a powerful tool for controlling complex nonlinear systems under constraints, but often struggles with model uncertainties and the design of suitable cost functions. To address these challenges, we discuss…

Systems and Control · Electrical Eng. & Systems 2024-10-08 Sebastian Hirt , Andreas Höhl , Johannes Pohlodek , Joachim Schaeffer , Maik Pfefferkorn , Richard D. Braatz , Rolf Findeisen

Deploying multiple robots for target search and tracking has many practical applications, yet the challenge of planning over unknown or partially known targets remains difficult to address. With recent advances in deep learning, intelligent…

Robotics · Computer Science 2023-08-30 Jigang Kim , Dohyun Jang , H. Jin Kim

In this work, we propose a Model Predictive Control (MPC)-based Reinforcement Learning (RL) method for Autonomous Surface Vehicles (ASVs). The objective is to find an optimal policy that minimizes the closed-loop performance of a simplified…

Systems and Control · Electrical Eng. & Systems 2021-08-06 Wenqi Cai , Arash B. Kordabad , Hossein N. Esfahani , Anastasios M. Lekkas , Sebastien Gros

Data assimilation (DA) has increasingly emerged as a critical tool for state estimation across a wide range of applications. It is significantly challenging when the governing equations of the underlying dynamics are unknown. To this end,…

Machine Learning · Computer Science 2026-01-13 Ziyi Wang , Lijian Jiang

Model predictive control (MPC) is widely used in process control due to its interpretability and ability to handle constraints. As a parametric policy in reinforcement learning (RL), MPC offers strong initial performance and low data…

Systems and Control · Electrical Eng. & Systems 2026-04-03 Dean Brandner , Sebastien Gros , Sergio Lucia

One of the key challenges in applying reinforcement learning to complex robotic control tasks is the need to gather large amounts of experience in order to find an effective policy for the task at hand. Model-based reinforcement learning…

Machine Learning · Computer Science 2016-08-12 Justin Fu , Sergey Levine , Pieter Abbeel

Overactuated omnidirectional flying vehicles are capable of generating force and torque in any direction, which is important for applications such as contact-based industrial inspection. This comes at the price of an increase in model…

Robotics · Computer Science 2020-06-24 Weixuan Zhang , Maximilian Brunner , Lionel Ott , Mina Kamel , Roland Siegwart , Juan Nieto

Designing missiles' autopilot controllers has been a complex task, given the extensive flight envelope and the nonlinear flight dynamics. A solution that can excel both in nominal performance and in robustness to uncertainties is still to…

Machine Learning · Computer Science 2021-09-21 Bernardo Cortez

This paper presents a robust adaptive learning Model Predictive Control (MPC) framework for linear systems with parametric uncertainties and additive disturbances performing iterative tasks. The approach refines the parameter estimates…

Systems and Control · Electrical Eng. & Systems 2025-09-04 Hannes Petrenz , Johannes Köhler , Francesco Borrelli

We propose the use of Bayesian networks, which provide both a mean value and an uncertainty estimate as output, to enhance the safety of learned control policies under circumstances in which a test-time input differs significantly from the…

Machine Learning · Computer Science 2019-02-18 Keuntaek Lee , Kamil Saigol , Evangelos A. Theodorou

In the last decade, reinforcement learning successfully solved complex control tasks and decision-making problems, like the Go board game. Yet, there are few success stories when it comes to deploying those algorithms to real-world…

Artificial Intelligence · Computer Science 2024-09-13 Giuseppe Paolo , Jonas Gonzalez-Billandon , Albert Thomas , Balázs Kégl

This paper presents a novel model-reference reinforcement learning control method for uncertain autonomous surface vehicles. The proposed control combines a conventional control method with deep reinforcement learning. With the conventional…

Systems and Control · Electrical Eng. & Systems 2021-06-17 Qingrui Zhang , Wei Pan , Vasso Reppa

This paper proposes a novel control design for voltage tracking of an islanded AC microgrid in the presence of {nonlinear} loads and parametric uncertainties at the primary level of control. The proposed method is based on the Tube-Based…

Systems and Control · Electrical Eng. & Systems 2023-09-06 Sahand Kiani , Hamed Kebriaei , Mohsen Hamzeh , Ali Salmanpour

There have been numerous advances in reinforcement learning, but the typically unconstrained exploration of the learning process prevents the adoption of these methods in many safety critical applications. Recent work in safe reinforcement…

Machine Learning · Computer Science 2019-10-02 David Isele , Alireza Nakhaei , Kikuo Fujimura

Reinforcement learning is commonly associated with training of reward-maximizing (or cost-minimizing) agents, in other words, controllers. It can be applied in model-free or model-based fashion, using a priori or online collected system…

Systems and Control · Electrical Eng. & Systems 2022-09-01 Lukas Beckenbach , Pavel Osinenko , Stefan Streif

Model Predictive Control (MPC) has established itself as the primary methodology for constrained control, enabling autonomy across diverse applications. While model fidelity is crucial in MPC, solving the corresponding optimization problem…

Systems and Control · Electrical Eng. & Systems 2026-04-23 Lukas Schroth , Daniel Morton , Amon Lahr , Daniele Gammelli , Andrea Carron , Marco Pavone

Learning-based methods have improved locomotion skills of quadruped robots through deep reinforcement learning. However, the sim-to-real gap and low sample efficiency still limit the skill transfer. To address this issue, we propose an…

Robotics · Computer Science 2024-03-19 Haojie Shi , Tingguang Li , Qingxu Zhu , Jiapeng Sheng , Lei Han , Max Q. -H. Meng

Sequential decision-making under cost-sensitive tasks is prohibitively daunting, especially for the problem that has a significant impact on people's daily lives, such as malaria control, treatment recommendation. The main challenge faced…

Machine Learning · Computer Science 2021-05-06 Lixin Zou , Long Xia , Linfang Hou , Xiangyu Zhao , Dawei Yin

One major challenge for autonomous attitude takeover control for on-orbit servicing of spacecraft is that an accurate dynamic motion model of the combined vehicles is highly nonlinear, complex and often costly to identify online, which…

Systems and Control · Electrical Eng. & Systems 2023-10-25 Yuhan Liu , Pengyu Wang , Chang-Hun Lee , Roland Tóth

While deep reinforcement learning (RL) has been increasingly applied in designing car-following models in the last years, this study aims at investigating the feasibility of RL-based vehicle-following for complex vehicle dynamics and strong…

Computational Engineering, Finance, and Science · Computer Science 2022-07-08 Fabian Hart , Ostap Okhrin , Martin Treiber