English
Related papers

Related papers: Superior Computer Chess with Model Predictive Cont…

200 papers

In this paper, we leverage the rapid advances in imitation learning, a topic of intense recent focus in the Reinforcement Learning (RL) literature, to develop new sample complexity results and performance guarantees for data-driven Model…

Optimization and Control · Mathematics 2022-10-18 Kwangjun Ahn , Zakaria Mhammedi , Horia Mania , Zhang-Wei Hong , Ali Jadbabaie

State-of-the-art model-based Reinforcement Learning (RL) approaches either use gradient-free, population-based methods for planning, learned policy networks, or a combination of policy networks and planning. Hybrid approaches that combine…

Machine Learning · Computer Science 2026-05-25 Jonathan Spieler , Sven Behnke

Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle's continuous dynamics and discrete gear…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Samuel Mallick , Gianpietro Battocletti , Qizhang Dong , Azita Dabiri , Bart De Schutter

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

Systems and Control · Electrical Eng. & Systems 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

Fast feedback control and safety guarantees are essential in modern robotics. We present an approach that achieves both by combining novel robust model predictive control (MPC) with function approximation via (deep) neural networks (NNs).…

Robotics · Computer Science 2020-03-04 Julian Nubert , Johannes Köhler , Vincent Berenz , Frank Allgöwer , Sebastian Trimpe

Model Predictive Control (MPC) has become a popular framework in embedded control for high-performance autonomous systems. However, to achieve good control performance using MPC, an accurate dynamics model is key. To maintain real-time…

Robotics · Computer Science 2023-07-26 Tim Salzmann , Elia Kaufmann , Jon Arrizabalaga , Marco Pavone , Davide Scaramuzza , Markus Ryll

Reservoir computers (RCs) provide a computationally efficient alternative to deep learning while also offering a framework for incorporating brain-inspired computational principles. By using an internal neural network with random, fixed…

Neural and Evolutionary Computing · Computer Science 2025-04-18 Keshav Srinivasan , Dietmar Plenz , Michelle Girvan

The reinforcement learning (RL) and model predictive control (MPC) communities have developed vast ecosystems of theoretical approaches and computational tools for solving optimal control problems. Given their conceptual similarities but…

Machine Learning · Computer Science 2025-09-04 Nathan P. Lawrence , Thomas Banker , Ali Mesbah

Transformer models have demonstrated impressive capabilities when trained at scale, excelling at difficult cognitive tasks requiring complex reasoning and rational decision-making. In this paper, we explore the application of transformers…

Machine Learning · Computer Science 2024-10-29 Daniel Monroe , Philip A. Chalmers

We present the first reinforcement-learning model to self-improve its reward-modulated training implemented through a continuously improving "intuition" neural network. An agent was trained how to play the arcade video game Pong with two…

Artificial Intelligence · Computer Science 2016-09-26 Matt Oberdorfer , Matt Abuzalaf

Economic model predictive control (EMPC) is a promising methodology for optimal operation of dynamical processes that has been shown to improve process economics considerably. However, EMPC performance relies heavily on the accuracy of the…

Systems and Control · Electrical Eng. & Systems 2021-05-10 Khalid Alhazmi , Fahad Albalawi , S. Mani Sarathy

Robotic systems must be able to quickly and robustly make decisions when operating in uncertain and dynamic environments. While Reinforcement Learning (RL) can be used to compute optimal policies with little prior knowledge about the…

Robotics · Computer Science 2016-09-13 Yunpeng Pan , Xinyan Yan , Evangelos Theodorou , Byron Boots

There is growing interest in reinforcement learning (RL) methods that leverage the simulator's derivatives to improve learning efficiency. While early gradient-based approaches have demonstrated superior performance compared to…

Robotics · Computer Science 2025-09-05 Joseph Amigo , Rooholla Khorrambakht , Elliot Chane-Sane , Nicolas Mansard , Ludovic Righetti

Safety is essential for reinforcement learning (RL) applied in real-world situations. Chance constraints are suitable to represent the safety requirements in stochastic systems. Previous chance-constrained RL methods usually have a low…

Machine Learning · Computer Science 2021-03-17 Baiyu Peng , Yao Mu , Yang Guan , Shengbo Eben Li , Yuming Yin , Jianyu Chen

Reinforcement learning (RL) has recently proven great success in various domains. Yet, the design of the reward function requires detailed domain expertise and tedious fine-tuning to ensure that agents are able to learn the desired…

Robotics · Computer Science 2023-03-06 Murad Dawood , Nils Dengler , Jorge de Heuvel , Maren Bennewitz

Dynamic discrete choice (DDC) models have found widespread application in marketing. However, estimating these becomes challenging in "big data" settings with high-dimensional state-action spaces. To address this challenge, this paper…

Econometrics · Economics 2026-01-06 Ahmed Khwaja , Sonal Srivastava

Despite the success of model predictive control (MPC), its application to high-dimensional systems, such as flexible structures and coupled fluid/rigid-body systems, remains a largely open challenge due to excessive computational…

Systems and Control · Computer Science 2019-05-03 Joseph Lorenzetti , Benoit Landry , Sumeet Singh , Marco Pavone

Despite great successes, model predictive control (MPC) relies on an accurate dynamical model and requires high onboard computational power, impeding its wider adoption in engineering systems, especially for nonlinear real-time systems with…

Systems and Control · Electrical Eng. & Systems 2023-07-03 Amin Vahidi-Moghaddam , Kaian Chen , Kaixiang Zhang , Zhaojian Li , Yan Wang , Kai Wu

The exploration-exploitation trade-off is at the heart of reinforcement learning (RL). However, most continuous control benchmarks used in recent RL research only require local exploration. This led to the development of algorithms that…

Robotics · Computer Science 2022-06-10 Guillaume Matheron , Nicolas Perrin , Olivier Sigaud

Predicting player behavior in strategic games, especially complex ones like chess, presents a significant challenge. The difficulty arises from several factors. First, the sheer number of potential outcomes stemming from even a single…

Machine Learning · Computer Science 2025-04-09 Benny Skidanov , Daniel Erbesfeld , Gera Weiss , Achiya Elyasaf