English
Related papers

Related papers: Inverse optimization problems with multiple weight…

200 papers

We introduce a new convexified matching method for missing value imputation and individualized inference inspired by computational optimal transport. Our method integrates favorable features from mainstream imputation approaches: optimal…

Econometrics · Economics 2024-07-09 YoonHaeng Hur , Tengyuan Liang

Many interesting tasks in machine learning and computer vision are learned by optimising an objective function defined as a weighted linear combination of multiple losses. The final performance is sensitive to choosing the correct…

Computer Vision and Pattern Recognition · Computer Science 2020-11-11 Rick Groenendijk , Sezer Karaoglu , Theo Gevers , Thomas Mensink

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

Alternating minimization heuristics seek to solve a (difficult) global optimization task through iteratively solving a sequence of (much easier) local optimization tasks on different parts (or blocks) of the input parameters. While popular…

Computational Complexity · Computer Science 2020-03-10 Peter Bürgisser , Ankit Garg , Rafael Oliveira , Michael Walter , Avi Wigderson

This paper addresses the inverse optimal control problem of finding the state weighting function that leads to a quadratic value function when the cost on the input is fixed to be quadratic. The paper focuses on a class of infinite horizon…

Optimization and Control · Mathematics 2022-11-21 Luis Rodrigues

Motivated, in particular, by the entropy-regularized optimal transport problem, we consider convex optimization problems with linear equality constraints, where the dual objective has Lipschitz $p$-th order derivatives, and develop two…

Optimization and Control · Mathematics 2023-08-11 Pavel Dvurechensky , Petr Ostroukhov , Alexander Gasnikov , César A. Uribe , Anastasiya Ivanova

We propose a tree-based algorithm for classification and regression problems in the context of functional data analysis, which allows to leverage representation learning and multiple splitting rules at the node level, reducing…

Machine Learning · Statistics 2020-11-03 Edoardo Belli , Simone Vantini

One fundamental problem when solving inverse problems is how to find regularization parameters. This article considers solving this problem using data-driven bilevel optimization, i.e. we consider the adaptive learning of the regularization…

Statistics Theory · Mathematics 2021-01-08 Neil K. Chada , Claudia Schillings , Xin T. Tong , Simon Weissmann

This work introduces a general numerical technique to invert one dimensional analytic or tabulated nonlinear functions in assigned ranges of interest. The proposed approach is based on an optimal version of the k-vector range searching, an…

Data Structures and Algorithms · Computer Science 2020-04-07 David Arnas , Daniele Mortari

Bi-objective optimization problems on matroids are in general intractable and their corresponding decision problems are in general NP-hard. However, if one of the objective functions is restricted to binary cost coefficients the problem…

Optimization and Control · Mathematics 2022-04-12 Kathrin Klamroth , Michael Stiglmayr , Julia Sudhoff

Overparameterization and overfitting are common concerns when designing and training deep neural networks, that are often counteracted by pruning and regularization strategies. However, these strategies remain secondary to most learning…

Machine Learning · Computer Science 2020-09-01 Malena Reiners , Kathrin Klamroth , Michael Stiglmayr

We study the problem of optimizing nonlinear objective functions over bipartite matchings. While the problem is generally intractable, we provide several efficient algorithms for it, including a deterministic algorithm for maximizing convex…

Optimization and Control · Mathematics 2008-07-24 Yael Berstein , Shmuel Onn

We determine the power of the weighted sum scalarization with respect to the computation of approximations for general multiobjective minimization and maximization problems. Additionally, we introduce a new multi-factor notion of…

Data Structures and Algorithms · Computer Science 2021-12-15 Cristina Bazgan , Stefan Ruzika , Clemens Thielen , Daniel Vanderpooten

We consider the problem of learning optimal binary classification trees. Literature on the topic has burgeoned in recent years, motivated both by the empirical suboptimality of heuristic approaches and the tremendous improvements in…

Machine Learning · Statistics 2020-05-14 Sina Aghaei , Andres Gomez , Phebe Vayanos

The computational cost of solving an inverse problem governed by PDEs, using multiple experiments, increases linearly with the number of experiments. A recently proposed method to decrease this cost uses only a small number of random linear…

Optimization and Control · Mathematics 2017-08-02 Benjamin Crestel , Alen Alexanderian , Georg Stadler , Omar Ghattas

A data-driven inverse optimization problem (DDIOP) seeks to estimate an objective function (i.e., weights) that is consistent with observed optimal-solution data, and is important in many applications, including those involving mixed…

Machine Learning · Computer Science 2026-02-17 Akira Kitaoka

Inverse reinforcement learning (IRL) addresses the problem of recovering a task description given a demonstration of the optimal policy used to solve such a task. The optimal policy is usually provided by an expert or teacher, making IRL…

Machine Learning · Computer Science 2012-02-09 Héctor Ratia , Luis Montesano , Ruben Martinez-Cantin

In this paper, we propose a new Fully Composite Formulation of convex optimization problems. It includes, as a particular case, the problems with functional constraints, max-type minimization problems, and problems of Composite…

Optimization and Control · Mathematics 2021-03-24 Nikita Doikov , Yurii Nesterov

This paper presents a novel convex optimization-based method for finding the globally optimal solutions of a class of mixed-integer non-convex optimal control problems. We consider problems with non-convex constraints that restrict the…

Optimization and Control · Mathematics 2019-11-21 Danylo Malyuta , Behcet Acikmese

In this workshop, we discuss several algorithms for mathematical programs with equilibrium constraints (MPECs). The unifying theme is that MPECs are optimization problems whose feasible set contains a lower-level equilibrium system, often…

Optimization and Control · Mathematics 2026-04-20 Jiguang Yu