English
Related papers

Related papers: Model Predictive Control with Self-supervised Repr…

200 papers

Model Predictive Control (MPC) is a classic tool for optimal control of complex, real-world systems. Although it has been successfully applied to a wide range of challenging tasks in robotics, it is fundamentally limited by the prediction…

Robotics · Computer Science 2021-04-08 Nathan Hatch , Byron Boots

Most model-free reinforcement learning methods leverage state representations (embeddings) for generalization, but either ignore structure in the space of actions or assume the structure is provided a priori. We show how a policy can be…

Machine Learning · Computer Science 2019-05-16 Yash Chandak , Georgios Theocharous , James Kostas , Scott Jordan , Philip S. Thomas

Deep Reinforcement Learning has shown its ability in solving complicated problems directly from high-dimensional observations. However, in end-to-end settings, Reinforcement Learning algorithms are not sample-efficient and requires long…

Machine Learning · Computer Science 2021-07-06 Nicolò Botteghi , Mannes Poel , Beril Sirmacek , Christoph Brune

Model-based reinforcement learning has the potential to be more sample efficient than model-free approaches. However, existing model-based methods are vulnerable to model bias, which leads to poor generalization and asymptotic performance…

Machine Learning · Computer Science 2019-06-27 Tung-Long Vuong , Kenneth Tran

Combining model-based and model-free learning systems has been shown to improve the sample efficiency of learning to perform complex robotic tasks. However, dual-system approaches fail to consider the reliability of the learned model when…

Machine Learning · Computer Science 2020-11-03 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

In the realm of control systems, model predictive control (MPC) has exhibited remarkable potential; however, its reliance on accurate models and substantial computational resources has hindered its broader application, especially within…

Systems and Control · Electrical Eng. & Systems 2025-04-14 Amin Vahidi-Moghaddam , Kaian Chen , Kaixiang Zhang , Zhaojian Li , Yan Wang , Kai Wu

Model Predictive Control (MPC) offers a versatile framework for constraint handling and multi-objective optimisation, yet practical application faces challenges regarding initial and recursive feasibility, robustness against model…

Optimization and Control · Mathematics 2026-02-27 Dario Dennstädt

In this paper, a learning based Model Predictive Control (MPC) using a low dimensional residual model is proposed for autonomous driving. One of the critical challenge in autonomous driving is the complexity of vehicle dynamics, which…

Robotics · Computer Science 2024-12-06 Yaoyu Li , Chaosheng Huang , Dongsheng Yang , Wenbo Liu , Jun Li

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

Machine Learning · Computer Science 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

Training an agent to solve control tasks directly from high-dimensional images with model-free reinforcement learning (RL) has proven difficult. A promising approach is to learn a latent representation together with the control policy.…

Machine Learning · Computer Science 2020-07-10 Denis Yarats , Amy Zhang , Ilya Kostrikov , Brandon Amos , Joelle Pineau , Rob Fergus

Deep reinforcement learning has shown remarkable success in the past few years. Highly complex sequential decision making problems have been solved in tasks such as game playing and robotics. Unfortunately, the sample complexity of most…

Machine Learning · Computer Science 2020-12-03 Aske Plaat , Walter Kosters , Mike Preuss

In this paper, we address the problem of reducing the computational burden of Model Predictive Control (MPC) for real-time robotic applications. We propose TransformerMPC, a method that enhances the computational efficiency of MPC…

Robotics · Computer Science 2024-09-17 Vrushabh Zinage , Ahmed Khalil , Efstathios Bakolas

Model predictive control (MPC) is an industry standard control technique that iteratively solves an open-loop optimization problem to guide a system towards a desired state or trajectory. Consequently, an accurate forward model of system…

Systems and Control · Electrical Eng. & Systems 2024-11-11 Jan P. Williams , J. Nathan Kutz , Krithika Manohar

Self-supervised speech representations have been shown to be effective in a variety of speech applications. However, existing representation learning methods generally rely on the autoregressive model and/or observed global dependencies…

Computation and Language · Computer Science 2020-11-03 Alexander H. Liu , Yu-An Chung , James Glass

The quality of data representation in deep learning methods is directly related to the prior model imposed on the representations; however, generally used fixed priors are not capable of adjusting to the context in the data. To address this…

Machine Learning · Computer Science 2013-03-18 Rakesh Chalasani , Jose C. Principe

The problem of selecting the right state-representation in a reinforcement learning problem is considered. Several models (functions mapping past observations to a finite set) of the observations are given, and it is known that for at least…

Machine Learning · Computer Science 2013-02-12 Odalric-Ambrym Maillard , Rémi Munos , Daniil Ryabko

Co-optimization of both vehicle speed and gear position via model predictive control (MPC) has been shown to offer benefits for fuel-efficient autonomous driving. However, optimizing both the vehicle's continuous dynamics and discrete gear…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Samuel Mallick , Gianpietro Battocletti , Qizhang Dong , Azita Dabiri , Bart De Schutter

A data-efficient learning-based control design method is proposed in this paper. It is based on learning a system dynamics model that is then leveraged in a two-level procedure. On the higher level, a simple but powerful optimization…

Systems and Control · Electrical Eng. & Systems 2026-02-03 Ludvig Svedlund , Constantin Cronrath , Jonas Fredriksson , Bengt Lennartson

Latent prediction--where agents learn by predicting their own latents--has emerged as a powerful paradigm for training general representations in machine learning. In reinforcement learning (RL), this approach has been explored to define…

Machine Learning · Computer Science 2025-10-02 Marco Bagatella , Matteo Pirotta , Ahmed Touati , Alessandro Lazaric , Andrea Tirinzoni

Continual learning (CL) has spurred the development of several methods aimed at consolidating previous knowledge across sequential learning. Yet, the evaluations of these methods have primarily focused on the final output, such as changes…

Machine Learning · Computer Science 2024-08-20 Nishant Suresh Aswani , Amira Guesmi , Muhammad Abdullah Hanif , Muhammad Shafique