English
Related papers

Related papers: Maximum Likelihood Methods for Inverse Learning of…

200 papers

This paper addresses the class of continuous-time nonlinear programming problems with equality and inequality constraints. The paper presents necessary optimality conditions of the sequential form. To be more precise, a sequence of…

Optimization and Control · Mathematics 2026-05-14 Moisés R. C. do Monte , Rodrigo B. Moreira , Valeriano A. de Oliveira

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

We study inverse optimization (IO), where the goal is to use a parametric optimization program as the hypothesis class to infer relationships between input-decision pairs. Most of the literature focuses on learning only the objective…

Optimization and Control · Mathematics 2025-05-22 Ke Ren , Peyman Mohajerin Esfahani , Angelos Georghiou

We extend in two ways the standard Karush-Kuhn-Tucker optimality conditions to problems with a convex objective, convex functional constraints, and the extra requirement that some of the variables must be integral. While the standard…

Optimization and Control · Mathematics 2014-12-09 Michel Baes , Timm Oertel , Robert Weismantel

In this paper, we introduce a kind of approximate Karush--Kuhn--Tucker condition (AKKT) for a smooth cone-constrained vector optimization problem. We show that, without any constraint qualification, the AKKT condition is a necessary for a…

Optimization and Control · Mathematics 2019-02-21 Nguyen Van Tuyen , Yi-Bin Xiao , Ta Quang Son

Performance indicators are essential tools for assessing the convergence behavior of multi-objective optimization algorithms, particularly when the true Pareto front is unknown or difficult to approximate. Classical reference-based metrics…

Optimization and Control · Mathematics 2026-03-05 Thiago Santos , Sebastiao Xavier

In many applications, including Stackelberg games, machine learning, and power systems \cite{Mackay2018Selftuning,Heinrich1952The,Wang2021Bi-Level}, the decisions in a minimax optimization problem can be constrained by a solution to an…

Optimization and Control · Mathematics 2026-04-28 Yaling Hu , Jiani Wang , Yu-hong Dai , Xiaojiao Tong

The classical method to solve a quadratic optimization problem with nonlinear equality constraints is to solve the Karush-Kuhn-Tucker (KKT) optimality conditions using Newton's method. This approach however is usually computationally…

Optimization and Control · Mathematics 2016-03-17 Tuan T. Nguyen , Mircea Lazar , Hans Butler

Inverse optimal control, also known as inverse reinforcement learning, is the problem of recovering an unknown reward function in a Markov decision process from expert demonstrations of the optimal policy. We introduce a probabilistic…

Machine Learning · Computer Science 2012-06-22 Sergey Levine , Vladlen Koltun

In this paper, we obtain necessary optimality conditions for neural network approximation. We consider neural networks in Manhattan ($l_1$ norm) and Chebyshev ($\max$ norm). The optimality conditions are based on neural networks with at…

Optimization and Control · Mathematics 2025-06-24 Vinesha Peiris , Nadezda Sukhorukova , Julien Ugon

Second-order optimality conditions for vector nonlinear programming problems with inequality constraints are studied in this paper. We introduce a new second-order constraint qualification, which includes Mangasarian-Fromovitz constraint…

Optimization and Control · Mathematics 2019-06-11 Vsevolod I. Ivanov

In this work, we investigate various approaches that use learning from training data to solve inverse problems, following a bi-level learning approach. We consider a general framework for optimal inversion design, where training data can be…

Numerical Analysis · Mathematics 2021-10-07 Julianne Chung , Matthias Chung , Silvia Gazzola , Mirjeta Pasha

While most approaches to the problem of Inverse Reinforcement Learning (IRL) focus on estimating a reward function that best explains an expert agent's policy or demonstrated behavior on a control task, it is often the case that such…

Machine Learning · Computer Science 2020-05-01 Dexter R. R. Scobee , S. Shankar Sastry

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

The choice of objective is critical for the performance of an optimal controller. When control requirements vary during operation, e.g. due to changes in the environment with which the system is interacting, these variations should be…

Systems and Control · Electrical Eng. & Systems 2023-06-06 Rahel Rickenbach , Elena Arcari , Melanie N. Zeilinger

This paper presents an inverse optimal control methodology and its application to training a predictive model of human motor control from a manipulation task. It introduces a convex formulation for learning both objective function and…

Systems and Control · Computer Science 2019-12-05 Marcel Menner , Peter Worsnop , Melanie N. Zeilinger

We propose an input convex neural network (ICNN)-based self-supervised learning framework to solve continuous constrained optimization problems. By integrating the augmented Lagrangian method (ALM) with the constraint correction mechanism,…

Optimization and Control · Mathematics 2025-05-08 Kang Liu , Wei Peng , Jianchen Hu

We consider the problem of training probabilistic conditional random fields (CRFs) in the context of a task where performance is measured using a specific loss function. While maximum likelihood is the most common approach to training CRFs,…

Machine Learning · Statistics 2015-03-19 Maksims N. Volkovs , Hugo Larochelle , Richard S. Zemel

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin

Various methods for solving the inverse reinforcement learning (IRL) problem have been developed independently in machine learning and economics. In particular, the method of Maximum Causal Entropy IRL is based on the perspective of entropy…

Machine Learning · Computer Science 2021-03-05 Navyata Sanghvi , Shinnosuke Usami , Mohit Sharma , Joachim Groeger , Kris Kitani