English
Related papers

Related papers: Optimal Transport losses and Sinkhorn algorithm wi…

200 papers

We consider optimization methods for convex minimization problems under inexact information on the objective function. We introduce inexact model of the objective, which as a particular cases includes $(\delta,L)$ inexact oracle and…

Optimal Transport (OT) theory has seen an increasing amount of attention from the computer science community due to its potency and relevance in modeling and machine learning. It introduces means that serve as powerful ways to compare…

Machine Learning · Computer Science 2021-06-04 Luis Caicedo Torres , Luiz Manella Pereira , M. Hadi Amini

Persistence diagrams (PDs) are now routinely used to summarize the underlying topology of complex data. Despite several appealing properties, incorporating PDs in learning pipelines can be challenging because their natural geometry is not…

Machine Learning · Statistics 2018-11-14 Théo Lacombe , Marco Cuturi , Steve Oudot

We present a general technique for the analysis of first-order methods. The technique relies on the construction of a duality gap for an appropriate approximation of the objective function, where the function approximation improves as the…

Optimization and Control · Mathematics 2019-12-12 Jelena Diakonikolas , Lorenzo Orecchia

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

This paper presents a widely applicable approach to solving (multi-marginal, martingale) optimal transport and related problems via neural networks. The core idea is to penalize the optimization problem in its dual formulation and reduce it…

Optimization and Control · Mathematics 2019-01-28 Stephan Eckstein , Michael Kupper

In this paper, we study two general classes of optimization algorithms for kernel methods with convex loss function and quadratic norm regularization, and analyze their convergence. The first approach, based on fixed-point iterations, is…

Machine Learning · Computer Science 2013-07-02 Francesco Dinuzzo

This paper studies the Partial Optimal Transport (POT) problem between two unbalanced measures with at most $n$ supports and its applications in various AI tasks such as color transfer or domain adaptation. There is hence the need for fast…

Machine Learning · Computer Science 2023-12-25 Anh Duc Nguyen , Tuan Dung Nguyen , Quang Minh Nguyen , Hoang H. Nguyen , Lam M. Nguyen , Kim-Chuan Toh

Many problems in machine learning involve calculating correspondences between sets of objects, such as point clouds or images. Discrete optimal transport provides a natural and successful approach to such tasks whenever the two sets of…

Machine Learning · Statistics 2019-02-28 David Alvarez-Melis , Stefanie Jegelka , Tommi S. Jaakkola

Optimal transport is a powerful framework for computing distances between probability distributions. We unify the two main approaches to optimal transport, namely Monge-Kantorovitch and Sinkhorn-Cuturi, into what we define as Tsallis…

Machine Learning · Computer Science 2016-09-16 Boris Muzellec , Richard Nock , Giorgio Patrini , Frank Nielsen

Vector quantile regression (VQR) is an optimal transport (OT)-based framework that extends linear quantile regression to vector-valued response variables and can be formulated as an OT problem with a mean-independence constraint. In this…

Optimization and Control · Mathematics 2026-03-24 Kengo Kato , Boyu Wang

The goal of regression and classification methods in supervised learning is to minimize the empirical risk, that is, the expectation of some loss function quantifying the prediction error under the empirical distribution. When facing scarce…

Optimization and Control · Mathematics 2019-07-15 Soroosh Shafieezadeh-Abadeh , Daniel Kuhn , Peyman Mohajerin Esfahani

This paper presents a framework to solve constrained optimization problems in an accelerated manner based on High-Order Tuners (HT). Our approach is based on reformulating the original constrained problem as the unconstrained optimization…

Optimization and Control · Mathematics 2022-05-27 Anjali Parashar , Priyank Srivastava , Anuradha M. Annaswamy

Optimal Transport is a foundational mathematical theory that connects optimization, partial differential equations, and probability. It offers a powerful framework for comparing probability distributions and has recently become an important…

Machine Learning · Statistics 2025-05-13 Gabriel Peyré

In this paper, we introduce a generalized dynamical unbalanced optimal transport framework by incorporating limited control input and mass dissipation, addressing limitations in conventional optimal transport for control applications. We…

Optimization and Control · Mathematics 2025-04-07 Dongjun Wu , Anders Rantzer

This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for…

Optimization and Control · Mathematics 2024-08-27 Yukuan Hu , Mengyu Li , Xin Liu , Cheng Meng

We consider hierarchical variational inequality problems, or more generally, variational inequalities defined over the set of zeros of a monotone operator. This framework includes convex optimization over equilibrium constraints and…

Optimization and Control · Mathematics 2026-01-07 Daniel Cortild , Meggie Marschner , Mathias Staudigl

We consider entropically regularized, semi-discrete versions of variational problems on the set of probability measures involving optimal transport as well as other terms. We prove that the solutions can be characterized by well-posed…

Optimization and Control · Mathematics 2026-04-07 Adrien Cances , Luca Nenna , Daniyar Omarov , Brendan Pass

This paper introduces a dynamic formulation of divergence-regularized optimal transport with weak targets on the path space. In our formulation, the classical relative entropy penalty is replaced by a general convex divergence, and terminal…

Probability · Mathematics 2026-03-31 Camilo Hernández , Ludovic Tangpi

This paper presents a regularized Newton method (RNM) with generalized regularization terms for unconstrained convex optimization problems. The generalized regularization includes quadratic, cubic, and elastic net regularizations as special…

Optimization and Control · Mathematics 2024-07-11 Yuya Yamakawa , Nobuo Yamashita
‹ Prev 1 8 9 10 Next ›