English
Related papers

Related papers: Well-Posedness and Efficient Algorithms for Invers…

200 papers

In this paper, we propose objective-function-free (OFF) variants of the proximal Newton method for nonconvex composite optimization problems and the regularized Newton method for unconstrained optimization problems, respectively, using…

Optimization and Control · Mathematics 2026-05-19 Hong Zhu

We study the Schr\"odinger-Bass problem, a one-parameter family of semimartingale optimal transport problems indexed by $\beta>0$, whose limiting regimes interpolate between the classical Schr\"odinger bridge, the Brenier-Strassen problem,…

Probability · Mathematics 2026-04-03 Manuel Hasenbichler , Gudmund Pammer , Stefan Thonhauser

Orthogonality constraints naturally appear in many machine learning problems, from principal component analysis to robust neural network training. They are usually solved using Riemannian optimization algorithms, which minimize the…

Machine Learning · Statistics 2025-08-08 Pierre Ablin , Simon Vary , Bin Gao , P. -A. Absil

This work establishes that an optimal transport~(OT) problem regularized by a given $f$-divergence admits the same solution as another OT problem regularized by a different $g$-divergence, under an appropriate transformation of the cost…

Statistics Theory · Mathematics 2026-04-24 Maxime Nicaise , Yaiza Bermudez , Samir M. Perlaza

We present a novel hierarchical framework for optimal transport (OT) using string diagrams, namely string diagrams of optimal transports. This framework reduces complex hierarchical OT problems to standard OT problems, allowing efficient…

Artificial Intelligence · Computer Science 2025-01-28 Kazuki Watanabe , Noboru Isobe

Optimal Transport (OT) theory has seen an increasing amount of attention from the computer science community due to its potency and relevance in modeling and machine learning. It introduces means that serve as powerful ways to compare…

Machine Learning · Computer Science 2021-06-04 Luis Caicedo Torres , Luiz Manella Pereira , M. Hadi Amini

Regularisation theory in Banach spaces, and non--norm-squared regularisation even in finite dimensions, generally relies upon Bregman divergences to replace norm convergence. This is comparable to the extension of first-order optimisation…

Optimization and Control · Mathematics 2021-03-19 Tuomo Valkonen

The training of deep neural networks predominantly relies on a combination of gradient-based optimisation and back-propagation for the computation of the gradient. While incredibly successful, this approach faces challenges such as…

Machine Learning · Computer Science 2026-02-09 Xiaoyu Wang , Alexandra Valavanis , Azhir Mahmood , Andreas Mang , Martin Benning , Audrey Repetti

This paper investigates online algorithms for smooth time-varying optimization problems, focusing first on methods with constant step-size, momentum, and extrapolation-length. Assuming strong convexity, precise results for the tracking…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

Optimization with nonnegative orthogonality constraints has wide applications in machine learning and data sciences. It is NP-hard due to some combinatorial properties of the constraints. We first propose an equivalent optimization…

Optimization and Control · Mathematics 2021-01-01 Bo Jiang , Xiang Meng , Zaiwen Wen , Xiaojun Chen

Solving optimal control problems for transport-dominated partial differential equations (PDEs) can become computationally expensive, especially when dealing with high-dimensional systems. To overcome this challenge, we focus on developing…

Optimization and Control · Mathematics 2026-03-31 Tobias Breiten , Shubhaditya Burela , Philipp Schulze

In this paper, we propose an inexact proximal Newton-type method for nonconvex composite problems. We establish the global convergence rate of the order $\mathcal{O}(k^{-1/2})$ in terms of the minimal norm of the KKT residual mapping and…

Optimization and Control · Mathematics 2024-12-26 Hong Zhu

Multimarginal Optimal Transport (MOT) is the problem of linear programming over joint probability distributions with fixed marginals. A key issue in many applications is the complexity of solving MOT: the linear program has exponential size…

Optimization and Control · Mathematics 2021-11-16 Jason M. Altschuler , Enric Boix-Adsera

Block-coordinate descent (BCD) is a popular framework for large-scale regularized optimization problems with block-separable structure. Existing methods have several limitations. They often assume that subproblems can be solved exactly at…

Optimization and Control · Mathematics 2019-11-05 Ching-pei Lee , Stephen J. Wright

The rotation averaging problem is a fundamental task in computer vision applications. It is generally very difficult to solve due to the nonconvex rotation constraints. While a sufficient optimality condition is available in the literature,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Yihong Dong , Lunchen Xie , Qingjiang Shi

We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes $(\delta,L)$ inexact oracle and…

Optimal transport (OT) theory has been been used in machine learning to study and characterize maps that can push-forward efficiently a probability measure onto another. Recent works have drawn inspiration from Brenier's theorem, which…

Machine Learning · Computer Science 2023-02-13 Théo Uscidda , Marco Cuturi

We propose a unified data-driven framework based on inverse optimal transport that can learn adaptive, nonlinear interaction cost function from noisy and incomplete empirical matching matrix and predict new matching in various matching…

Machine Learning · Statistics 2018-11-01 Ruilin Li , Xiaojing Ye , Haomin Zhou , Hongyuan Zha

Reinforcement learning can acquire complex behaviors from high-level specifications. However, defining a cost function that can be optimized effectively and encodes the correct task is challenging in practice. We explore how inverse optimal…

Machine Learning · Computer Science 2016-05-30 Chelsea Finn , Sergey Levine , Pieter Abbeel

Inverse optimization (Inverse optimal control) is the task of imputing a cost function such that given test points (trajectories) are (nearly) optimal with respect to the discovered cost. Prior methods in inverse optimization assume that…

Optimization and Control · Mathematics 2025-10-21 Filip Bečanović , Jared Miller , Vincent Bonnet , Kosta Jovanović , Samer Mohammed