English
Related papers

Related papers: Exact Maximum Entropy Inverse Optimal Control for …

200 papers

Optimal control (OC) using inverse dynamics provides numerical benefits such as coarse optimization, cheaper computation of derivatives, and a high convergence rate. However, to take advantage of these benefits in model predictive control…

Robotics · Computer Science 2023-03-24 Carlos Mastalli , Saroj Prasad Chhatoi , Thomas Corbères , Steve Tonneau , Sethu Vijayakumar

Multi-task Inverse Reinforcement Learning (IRL) is the problem of inferring multiple reward functions from expert demonstrations. Prior work, built on Bayesian IRL, is unable to scale to complex environments due to computational…

Machine Learning · Computer Science 2018-07-17 Adam Gleave , Oliver Habryka

Recent works in high-dimensional model-predictive control and model-based reinforcement learning with learned dynamics and reward models have resorted to population-based optimization methods, such as the Cross-Entropy Method (CEM), for…

Machine Learning · Computer Science 2020-04-21 Homanga Bharadhwaj , Kevin Xie , Florian Shkurti

In real-world problems, uncertainties (e.g., errors in the measurement, precision errors) often lead to poor performance of numerical algorithms when not explicitly taken into account. This is also the case for control problems, where…

Optimization and Control · Mathematics 2020-12-18 Carlos Ignacio Hernández Castellanos , Sina Ober-Blöbaum , Sebastian Peitz

Model-free Reinforcement Learning (RL) works well when experience can be collected cheaply and model-based RL is effective when system dynamics can be modeled accurately. However, both assumptions can be violated in real world problems such…

Machine Learning · Computer Science 2020-05-07 Mohak Bhardwaj , Ankur Handa , Dieter Fox , Byron Boots

We study the inverse reinforcement learning (IRL) problem under a transition dynamics mismatch between the expert and the learner. Specifically, we consider the Maximum Causal Entropy (MCE) IRL learner model and provide a tight upper bound…

Machine Learning · Computer Science 2021-12-01 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Adrian Weller , Volkan Cevher

Model Predictive Control (MPC) has established itself as the primary methodology for constrained control, enabling autonomy across diverse applications. While model fidelity is crucial in MPC, solving the corresponding optimization problem…

Systems and Control · Electrical Eng. & Systems 2026-04-23 Lukas Schroth , Daniel Morton , Amon Lahr , Daniele Gammelli , Andrea Carron , Marco Pavone

This paper shows that the optimal policy and value functions of a Markov Decision Process (MDP), either discounted or not, can be captured by a finite-horizon undiscounted Optimal Control Problem (OCP), even if based on an inexact model.…

Systems and Control · Electrical Eng. & Systems 2023-02-08 Arash Bahari Kordabad , Mario Zanon , Sebastien Gros

We present an information theoretic approach to stochastic optimal control problems that can be used to derive general sampling based optimization schemes. This new mathematical method is used to develop a sampling based model predictive…

Robotics · Computer Science 2017-07-11 Grady Williams , Paul Drews , Brian Goldfain , James M. Rehg , Evangelos A. Theodorou

In this paper, the solvability of the Inverse Optimal Control (IOC) problem based on two existing minimum principal methods, is analysed. The aim of this work is to answer the question regarding what kinds of trajectories, that is depending…

Optimization and Control · Mathematics 2024-03-15 Afreen Islam , Guido Herrmann , Joaquin Carrasco

Optimized certainty equivalents (OCEs) is a family of risk measures widely used by both practitioners and academics. This is mostly due to its tractability and the fact that it encompasses important examples, including entropic risk…

Optimization and Control · Mathematics 2022-06-07 Julio Backhoff Veraguas , A. Max Reppen , Ludovic Tangpi

Model predictive control (MPC) is a method to formulate the optimal scheduling problem for grid flexibilities in a mathematical manner. The resulting time-constrained optimization problem can be re-solved in each optimization time step…

Systems and Control · Electrical Eng. & Systems 2021-08-20 Steven de Jongh , Sina Steinle , Anna Hlawatsch , Felicitas Mueller , Michael Suriyah , Thomas Leibfried

This paper is about a real-time model predictive control (MPC) algorithm for a particular class of model based controllers, whose objective consists of a nominal tracking objective and an additional learning objective. Here, the…

Optimization and Control · Mathematics 2016-11-09 Xuhui Feng , Boris Houska

Model Predictive Control (MPC) offers rigorous safety and performance guarantees but is computationally intensive. Approximate MPC (AMPC) aims to circumvent this drawback by learning a computationally cheaper surrogate policy. Common…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Elias Milios , Kim P. Wabersich , Felix Berkel , Felix Gruber , Melanie N. Zeilinger

A mainstream type of current self-supervised learning methods pursues a general-purpose representation that can be well transferred to downstream tasks, typically by optimizing on a given pretext task such as instance discrimination. In…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Xin Liu , Zhongdao Wang , Yali Li , Shengjin Wang

This paper introduces a novel model-free and a partially model-free algorithm for inverse optimal control (IOC), also known as inverse reinforcement learning (IRL), aimed at estimating the cost function of continuous-time nonlinear…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Hamed Jabbari Asl , Eiji Uchibe

This paper proposes an iterative distributionally robust model predictive control (MPC) scheme to solve a risk-constrained infinite-horizon optimal control problem. In each iteration, the algorithm generates a trajectory from the starting…

Optimization and Control · Mathematics 2023-08-23 Alireza Zolanvari , Ashish Cherukuri

Model Predictive Control (MPC) is widely used in robot control by optimizing a sequence of control outputs over a finite-horizon. Computational approaches for MPC include deterministic methods (e.g., iLQR and COBYLA), as well as…

Robotics · Computer Science 2025-11-03 Zhaoxin Li , Xiaoke Wang , Letian Chen , Rohan Paleja , Subramanya Nageshrao , Matthew Gombolay

Despite decades of research, existing navigation systems still face real-world challenges when deployed in the wild, e.g., in cluttered home environments or in human-occupied public spaces. To address this, we present a new class of…

Event-triggered model predictive control (eMPC) is a popular optimal control method with an aim to alleviate the computation and/or communication burden of MPC. However, it generally requires priori knowledge of the closed-loop system…

Robotics · Computer Science 2022-08-23 Fengying Dang , Dong Chen , Jun Chen , Zhaojian Li