English
Related papers

Related papers: Learning to Optimize via Wasserstein Deep Inverse …

200 papers

Imitation Learning describes the problem of recovering an expert policy from demonstrations. While inverse reinforcement learning approaches are known to be very sample-efficient in terms of expert demonstrations, they usually require…

Machine Learning · Computer Science 2019-06-20 Huang Xiao , Michael Herman , Joerg Wagner , Sebastian Ziesche , Jalal Etesami , Thai Hong Linh

Reinforcement learning can acquire complex behaviors from high-level specifications. However, defining a cost function that can be optimized effectively and encodes the correct task is challenging in practice. We explore how inverse optimal…

Machine Learning · Computer Science 2016-05-30 Chelsea Finn , Sergey Levine , Pieter Abbeel

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

Machine Learning · Computer Science 2012-06-22 Sergey Levine , Vladlen Koltun

The goal of inverse reinforcement learning (IRL) is to infer a reward function that explains the behavior of an agent performing a task. The assumption that most approaches make is that the demonstrated behavior is near-optimal. In many…

Machine Learning · Computer Science 2020-11-20 Luis Haug , Ivan Ovinnikov , Eugene Bykovets

We propose a unified data-driven framework based on inverse optimal transport that can learn adaptive, nonlinear interaction cost function from noisy and incomplete empirical matching matrix and predict new matching in various matching…

Machine Learning · Statistics 2018-11-01 Ruilin Li , Xiaojing Ye , Haomin Zhou , Hongyuan Zha

We introduce Primal-Dual Wasserstein GAN, a new learning algorithm for building latent variable models of the data distribution based on the primal and the dual formulations of the optimal transport (OT) problem. We utilize the primal…

Machine Learning · Statistics 2018-05-25 Mevlana Gemici , Zeynep Akata , Max Welling

The problem of continuous inverse optimal control (over finite time horizon) is to learn the unknown cost function over the sequence of continuous control variables from expert demonstrations. In this article, we study this fundamental…

Machine Learning · Computer Science 2022-04-20 Yifei Xu , Jianwen Xie , Tianyang Zhao , Chris Baker , Yibiao Zhao , Ying Nian Wu

We prove Wasserstein inverse reinforcement learning enables the learner's reward values to imitate the expert's reward values in a finite iteration for multi-objective optimizations. Moreover, we prove Wasserstein inverse reinforcement…

Machine Learning · Computer Science 2023-05-19 Akira Kitaoka , Riki Eto

Given a set of observations generated by an optimization process, the goal of inverse optimization is to determine likely parameters of that process. We cast inverse optimization as a form of deep learning. Our method, called deep inverse…

Machine Learning · Computer Science 2018-12-04 Yingcong Tan , Andrew Delong , Daria Terekhov

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf

We investigate the problem of risk averse robot path planning using the deep reinforcement learning and distributionally robust optimization perspectives. Our problem formulation involves modelling the robot as a stochastic linear dynamical…

Robotics · Computer Science 2022-11-07 Cem Alpturk , Venkatraman Renganathan

In this paper, we propose a Transformer-based framework for approximating solutions to infinite-dimensional optimization problems: calculus of variations problems and optimal control problems. Our approach leverages offline training on data…

Optimization and Control · Mathematics 2025-11-20 Gage MacLin , Venanzio Cichella , Andrew Patterson , Irene Gregory

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance without considering risk or safety. In contrast, safe reinforcement learning aims to mitigate or avoid unsafe states. This…

Machine Learning · Computer Science 2024-09-13 Zahra Shahrooei , Ali Baheri

We present an iterative inverse reinforcement learning algorithm to infer optimal cost functions in continuous spaces. Based on a popular maximum entropy criteria, our approach iteratively finds a weight improvement step and proposes a…

Machine Learning · Computer Science 2025-05-14 Sarmad Mehrdad , Avadesh Meduri , Ludovic Righetti

We show the convergence of Wasserstein inverse reinforcement learning for multi-objective optimizations with the projective subgradient method by formulating an inverse problem of the multi-objective optimization problem. In addition, we…

Machine Learning · Computer Science 2023-05-19 Akira Kitaoka , Riki Eto

Inverse problems in physical or biological sciences often involve recovering an unknown parameter that is random. The sought-after quantity is a probability distribution of the unknown parameter, that produces data that aligns with…

Machine Learning · Statistics 2024-10-02 Qin Li , Maria Oprea , Li Wang , Yunan Yang

This article studies inverse reinforcement learning (IRL) for the stochastic linear-quadratic optimal control problem, where two agents are considered. A learner agent does not know the expert agent's performance cost function, but it…

Optimization and Control · Mathematics 2024-05-28 Zhongshi Sun , Guangyan Jia

Robust Reinforcement Learning aims to find the optimal policy with some extent of robustness to environmental dynamics. Existing learning algorithms usually enable the robustness through disturbing the current state or simulating…

Machine Learning · Computer Science 2020-06-02 Linfang Hou , Liang Pang , Xin Hong , Yanyan Lan , Zhiming Ma , Dawei Yin

This paper presents a novel methodology for tractably solving optimal control and offline reinforcement learning problems for high-dimensional systems. This work is motivated by the ongoing challenges of safety, computation, and optimality…

Optimization and Control · Mathematics 2022-07-06 Aaron Kandel , Saehong Park , Scott Moura

We consider a general online stochastic optimization problem with multiple budget constraints over a horizon of finite time periods. In each time period, a reward function and multiple cost functions are revealed, and the decision maker…

Machine Learning · Computer Science 2022-07-26 Jiashuo Jiang , Xiaocheng Li , Jiawei Zhang
‹ Prev 1 2 3 10 Next ›