English
Related papers

Related papers: Reinforcement Learning Ship Autopilot: Sample effi…

200 papers

In recent years, deep reinforcement learning has emerged as a technique to solve closed-loop flow control problems. Employing simulation-based environments in reinforcement learning enables a priori end-to-end optimization of the control…

Fluid Dynamics · Physics 2024-04-11 Andre Weiner , Janis Geise

Autonomous navigation in complex and partially observable environments remains a central challenge in robotics. Several bio-inspired models of mapping and navigation based on place cells in the mammalian hippocampus have been proposed. This…

Neural and Evolutionary Computing · Computer Science 2026-01-08 Bekarys Dukenbaev , Andrew Gerstenslager , Alexander Johnson , Ali A. Minai

In this paper, we present a state-of-the-art reinforcement learning method for autonomous driving. Our approach employs temporal difference learning in a Bayesian framework to learn vehicle control signals from sensor data. The agent has…

Computer Vision and Pattern Recognition · Computer Science 2021-04-09 Zahra Gharaee , Karl Holmquist , Linbo He , Michael Felsberg

Stable gait generation is a crucial problem for legged robot locomotion as this impacts other critical performance factors such as, e.g. mobility over an uneven terrain and power consumption. Gait generation stability results from the…

Robotics · Computer Science 2023-07-18 Vyacheslav Kovalev , Anna Shkromada , Henni Ouerdane , Pavel Osinenko

This paper focuses on hyperparameter optimization for autonomous driving strategies based on Reinforcement Learning. We provide a detailed description of training the RL agent in a simulation environment. Subsequently, we employ Efficient…

Machine Learning · Computer Science 2024-07-22 Nihal Acharya Adde , Hanno Gottschalk , Andreas Ebert

Sampling-based model predictive control methods like MPPI and CEM are essential for real-time control of nonlinear robotic systems, particularly where discontinuous dynamics preclude gradient-based optimization. However, these methods…

Robotics · Computer Science 2026-05-05 Vincent Pacelli , Akash Ratheesh , Evangelos A. Theodorou

Combining model-based and model-free deep reinforcement learning has shown great promise for improving sample efficiency on complex control tasks while still retaining high performance. Incorporating imagination is a recent effort in this…

Machine Learning · Computer Science 2019-10-11 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Three major challenges in reinforcement learning are the complex dynamical systems with large state spaces, the costly data acquisition processes, and the deviation of real-world dynamics from the training environment deployment. To…

Machine Learning · Computer Science 2024-06-04 Shyam Sundhar Ramesh , Pier Giuseppe Sessa , Yifan Hu , Andreas Krause , Ilija Bogunovic

Nonlinear model predictive control (NMPC) is one of the few control methods that can handle multivariable nonlinear controlsystems with constraints. Gaussian processes (GPs) present a powerful tool to identify the required plant model and…

Optimization and Control · Mathematics 2020-05-26 E. Bradford , L. Imsland , D. Zhang , E. A. del Rio-Chanona

We present a Reinforcement Learning-based Robust Nonlinear Model Predictive Control (RL-RNMPC) framework for controlling nonlinear systems in the presence of disturbances and uncertainties. An approximate Robust Nonlinear Model Predictive…

Systems and Control · Electrical Eng. & Systems 2021-04-08 Hossein Nejatbakhsh Esfahani , Arash Bahari Kordabad , Sebastien Gros

We propose a model-based reinforcement learning (RL) approach for noisy time-dependent gate optimization with improved sample complexity over model-free RL. Sample complexity is the number of controller interactions with the physical…

Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle's continuous dynamics and discrete gear…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Samuel Mallick , Gianpietro Battocletti , Qizhang Dong , Azita Dabiri , Bart De Schutter

Ensuring safety under unknown and stochastic dynamics remains a significant challenge in reinforcement learning (RL). In this paper, we propose a model predictive control (MPC)-based safe RL framework, called Probabilistic Ensembles with…

Systems and Control · Electrical Eng. & Systems 2026-04-09 Ali Umut Kaypak , Prashanth Krishnamurthy , Farshad Khorrami

A big challenge in environmental monitoring is the spatiotemporal variation of the phenomena to be observed. To enable persistent sensing and estimation in such a setting, it is beneficial to have a time-varying underlying environmental…

Robotics · Computer Science 2019-01-10 Kai-Chieh Ma , Lantao Liu , Gaurav S. Sukhatme

Learning-based model predictive control has emerged as a powerful approach for handling complex dynamics in mechatronic systems, enabling data-driven performance improvements while respecting safety constraints. However, when computational…

Systems and Control · Electrical Eng. & Systems 2025-12-19 Mark Benazet , Francesco Ricca , Dario Bralla , Melanie N. Zeilinger , Andrea Carron

This paper presents an integrated Reinforcement Learning (RL) and Model Predictive Control (MPC) framework for autonomous satellite docking with a partially filled fuel tank. Traditional docking control faces challenges due to fuel sloshing…

Accurately modeling robot dynamics is crucial to safe and efficient motion control. In this paper, we develop and apply an iterative learning semi-parametric model, with a neural network, to the task of autonomous racing with a Model…

Robotics · Computer Science 2020-11-18 Ignat Georgiev , Christoforos Chatzikomis , Timo Völkl , Joshua Smith , Michael Mistry

Meta-reinforcement learning (meta-RL) acquires meta-policies that show good performance for tasks in a wide task distribution. However, conventional meta-RL, which learns meta-policies by randomly sampling tasks, has been reported to show…

Machine Learning · Computer Science 2022-04-01 Morio Matsumoto , Hiroya Matsuba , Toshihiro Kujirai

In the last few years, researchers have applied machine learning strategies in the context of vehicular platoons to increase the safety and efficiency of cooperative transportation. Reinforcement Learning methods have been employed in the…

Systems and Control · Electrical Eng. & Systems 2022-11-17 Armando Alves Neto , Leonardo Amaral Mozelli

A robust Model Predictive Control (MPC) approach for controlling front steering of an autonomous vehicle is presented in this paper. We present various approaches to increase the robustness of model predictive control by using weight…

Systems and Control · Computer Science 2018-05-23 Che Kun Law , Darshit Dalal , Stephen Shearrow