English
Related papers

Related papers: Energy-Based Continuous Inverse Optimal Control

200 papers

We consider the Chance Constrained Model Predictive Control problem for polynomial systems subject to disturbances. In this problem, we aim at finding optimal control input for given disturbed dynamical system to minimize a given cost…

Optimization and Control · Mathematics 2016-05-04 Ashkan Jasour , Constantino Lagoa

In this paper, we consider a class of continuous-time, continuous-space stochastic optimal control problems. Building upon recent advances in Markov chain approximation methods and sampling-based algorithms for deterministic path planning,…

Robotics · Computer Science 2012-02-27 Vu Anh Huynh , Sertac Karaman , Emilio Frazzoli

The entropy regularization is inspired by information entropy from machine learning and the ideas of exploration and exploitation in reinforcement learning, which appears in the control problem to design an approximating algorithm for the…

Optimization and Control · Mathematics 2024-11-21 Ziyue Chen , Qi Zhang

In control theory, typically a nominal model is assumed based on which an optimal control is designed and then applied to an actual (true) system. This gives rise to the problem of performance loss due to the mismatch between the true model…

Optimization and Control · Mathematics 2023-09-19 Somnath Pradhan , Serdar Yuksel

This work addresses inverse linear optimization where the goal is to infer the unknown cost vector of a linear program. Specifically, we consider the data-driven setting in which the available data are noisy observations of optimal…

Optimization and Control · Mathematics 2021-12-07 Rishabh Gupta , Qi Zhang

Linear dynamical systems that obey stochastic differential equations are canonical models. While optimal control of known systems has a rich literature, the problem is technically hard under model uncertainty and there are hardly any…

Systems and Control · Electrical Eng. & Systems 2023-06-09 Mohamad Kazem Shirani Faradonbeh , Mohamad Sadegh Shirani Faradonbeh

We consider controller synthesis for stochastic and partially unknown environments in which safety is essential. Specifically, we abstract the problem as a Markov decision process in which the expected performance is measured using a cost…

Software Engineering · Computer Science 2015-10-21 Sebastian Junges , Nils Jansen , Christian Dehnert , Ufuk Topcu , Joost-Pieter Katoen

Sampling-based Model Predictive Control (MPC) is a flexible control framework that can reason about non-smooth dynamics and cost functions. Recently, significant work has focused on the use of machine learning to improve the performance of…

Robotics · Computer Science 2022-12-07 Jacob Sacks , Byron Boots

Learning optimal feedback control laws capable of executing optimal trajectories is essential for many robotic applications. Such policies can be learned using reinforcement learning or planned using optimal control. While reinforcement…

Machine Learning · Computer Science 2019-10-14 Michael Lutter , Boris Belousov , Kim Listmann , Debora Clever , Jan Peters

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

We establish an algorithm to learn feedback maps from data for a class of robust model predictive control (MPC) problems. The algorithm accounts for the approximation errors due to the learning directly at the synthesis stage, ensuring…

Optimization and Control · Mathematics 2025-10-16 Siddhartha Ganguly , Shubham Gupta , Debasish Chatterjee

In this article, we discuss two algorithms tailored to discrete-time deterministic finite-horizon nonlinear optimal control problems or so-called deterministic trajectory optimization problems. Both algorithms can be derived from an…

Optimization and Control · Mathematics 2024-12-10 Mohammad Mahmoudi Filabadi , Tom Lefebvre , Guillaume Crevecoeur

In this paper we present a dynamic programing approach to stochastic optimal control problems with dynamic, time-consistent risk constraints. Constrained stochastic optimal control problems, which naturally arise when one has to consider…

Optimization and Control · Mathematics 2015-11-24 Yin-Lam Chow , Marco Pavone

In this paper, we propose a novel framework for the synthesis of robust and optimal energy-aware controllers. The framework is based on energy timed automata, allowing for easy expression of timing constraints and variable energy rates. We…

Formal Languages and Automata Theory · Computer Science 2018-05-04 Giovanni Bacci , Patricia Bouyer , Uli Fahrenberg , Kim G. Larsen , Nicolas Markey , Pierre-Alain Reynier

Model-based reinforcement learning techniques accelerate the learning task by employing a transition model to make predictions. In this paper, a model-based learning approach is presented that iteratively computes the optimal value function…

Optimization and Control · Mathematics 2020-10-22 Milad Farsi , Jun Liu

This paper studies the inverse optimal control problem for continuous-time linear quadratic regulators over finite-time horizon, aiming to reconstruct the control, state, and terminal cost matrices in the objective function from observed…

Optimization and Control · Mathematics 2025-10-07 Yuexin Cao , Yibei Li , Zhuo Zou , Xiaoming Hu

We study the problem of data-driven, constrained control of unknown nonlinear dynamics from a single ongoing and finite-horizon trajectory. We consider a one-step optimal control problem with a smooth, black-box objective, typically a…

Optimization and Control · Mathematics 2022-06-23 Abraham P. Vinod , Arie Israel , Ufuk Topcu

Model-based reinforcement learning is an effective approach for controlling an unknown system. It is based on a longstanding pipeline familiar to the control community in which one performs experiments on the environment to collect a…

Systems and Control · Electrical Eng. & Systems 2024-08-14 Bruce D. Lee , Ingvar Ziemann , George J. Pappas , Nikolai Matni

We consider a simple control problem in which the underlying dynamics depend on a parameter that is unknown and must be learned. We exhibit a control strategy which is optimal to within a multiplicative constant. While most authors find…

Optimization and Control · Mathematics 2021-09-15 Jacob Carruth , Maximilian F. Eggl , Charles Fefferman , Clarence W. Rowley , Melanie Weber

We consider amortized Bayesian inference for nonlinear inverse problems in settings where only samples from the joint distribution of parameters and observations are available. Classical methods such as Markov chain Monte Carlo require…

Numerical Analysis · Mathematics 2026-05-19 Hojjat Kaveh , Ricardo Baptista , Andrew M. Stuart