English
Related papers

Related papers: A Sparse Smoothing Newton Method for Solving Discr…

200 papers

This chapter describes techniques for the numerical resolution of optimal transport problems. We will consider several discretizations of these problems, and we will put a strong focus on the mathematical analysis of the algorithms to solve…

Numerical Analysis · Mathematics 2020-03-03 Quentin Merigot , Boris Thibert

This paper improves the state-of-the-art rate of a first-order algorithm for solving entropy regularized optimal transport. The resulting rate for approximating the optimal transport (OT) has been improved from…

Optimization and Control · Mathematics 2023-01-25 Yiling Luo , Yiling Xie , Xiaoming Huo

Optimal Transport (OT) has attracted significant interest in the machine learning community, not only for its ability to define meaningful distances between probability distributions -- such as the Wasserstein distance -- but also for its…

Machine Learning · Computer Science 2025-11-04 Laetitia Chapel , Romain Tavenard , Samuel Vaiter

Making sense of Wasserstein distances between discrete measures in high-dimensional settings remains a challenge. Recent work has advocated a two-step approach to improve robustness and facilitate the computation of optimal transport, using…

Machine Learning · Computer Science 2019-09-04 François-Pierre Paty , Marco Cuturi

In this paper we first study a smooth optimization approach for solving a class of nonsmooth strictly concave maximization problems whose objective functions admit smooth convex minimization reformulations. In particular, we apply…

Methodology · Statistics 2009-04-07 Zhaosong Lu

We provide theoretical complexity analysis for new algorithms to compute the optimal transport (OT) distance between two discrete probability distributions, and demonstrate their favorable practical performance over state-of-art primal-dual…

Data Structures and Algorithms · Computer Science 2020-06-16 Wenshuo Guo , Nhat Ho , Michael I. Jordan

We propose a novel neural algorithm for the fundamental problem of computing the entropic optimal transport (EOT) plan between continuous probability distributions which are accessible by samples. Our algorithm is based on the saddle point…

Machine Learning · Computer Science 2023-11-02 Nikita Gushchin , Alexander Kolesov , Alexander Korotin , Dmitry Vetrov , Evgeny Burnaev

In this paper, we consider variants of Newton-MR algorithm for solving unconstrained, smooth, but non-convex optimization problems. Unlike the overwhelming majority of Newton-type methods, which rely on conjugate gradient algorithm as the…

Optimization and Control · Mathematics 2023-10-02 Yang Liu , Fred Roosta

The Unbalanced Optimal Transport (UOT) problem plays increasingly important roles in computational biology, computational imaging and deep learning. Scaling algorithm is widely used to solve UOT due to its convenience and good convergence…

Optimization and Control · Mathematics 2024-02-28 Xiang Chen , Faqiang Wang , Jun Liu , Li Cui

This paper presents a unified framework for smooth convex regularization of discrete optimal transport problems. In this context, the regularized optimal transport turns out to be equivalent to a matrix nearness problem with respect to…

Machine Learning · Statistics 2018-07-17 Arnaud Dessein , Nicolas Papadakis , Jean-Luc Rouas

Several recent applications of optimal transport (OT) theory to machine learning have relied on regularization, notably entropy and the Sinkhorn algorithm. Because matrix-vector products are pervasive in the Sinkhorn algorithm, several…

Machine Learning · Statistics 2021-03-09 Meyer Scetbon , Marco Cuturi , Gabriel Peyré

Optimal Transport (OT) distances such as Wasserstein have been used in several areas such as GANs and domain adaptation. OT, however, is very sensitive to outliers (samples with large noise) in the data since in its objective function,…

Machine Learning · Computer Science 2020-10-13 Yogesh Balaji , Rama Chellappa , Soheil Feizi

The goal of this paper is to introduce a new theoretical framework for Optimal Transport (OT), using the terminology and techniques of Fully Probabilistic Design (FPD). Optimal Transport is the canonical method for comparing probability…

Artificial Intelligence · Computer Science 2022-12-29 Sarah Boufelja Y. , Anthony Quinn , Martin Corless , Robert Shorten

Sparse logistic regression, as an effective tool of classification, has been developed tremendously in recent two decades, from its origination the $\ell_1$-regularized version to the sparsity constrained models. This paper is carried out…

Optimization and Control · Mathematics 2021-11-23 Rui Wang , Naihua Xiu , Shenglong Zhou

Semi-discrete optimal transport (SOT), which maps a continuous probability measure to a discrete one, is a fundamental problem with wide-ranging applications. Entropic regularization is often employed to solve the SOT problem, leading to a…

Numerical Analysis · Mathematics 2025-08-01 Moaad Khamlich , Francesco Romor , Gianluigi Rozza

Optimal Transport, a theory for optimal allocation of resources, is widely used in various fields such as astrophysics, machine learning, and imaging science. However, many applications impose elementwise constraints on the transport plan…

Optimization and Control · Mathematics 2022-06-28 Zixuan Cang , Qing Nie , Yanxiang Zhao

This paper aims at developing two versions of the generalized Newton method to compute not merely arbitrary local minimizers of nonsmooth optimization problems but just those, which possess an important stability property known as tilt…

Optimization and Control · Mathematics 2021-01-01 Boris Mordukhovich , Ebrahim Sarabi

Wasserstein distance plays increasingly important roles in machine learning, stochastic programming and image processing. Major efforts have been under way to address its high computational complexity, some leading to approximate or…

Machine Learning · Statistics 2019-06-26 Yujia Xie , Xiangfeng Wang , Ruijia Wang , Hongyuan Zha

In this paper, we consider a well-known sparse optimization problem that aims to find a sparse solution of a possibly noisy underdetermined system of linear equations. Mathematically, it can be modeled in a unified manner by minimizing…

Optimization and Control · Mathematics 2021-10-01 Lei Yang , Xiaojun Chen , Shuhuang Xiang

We consider minimization of a smooth nonconvex objective function using an iterative algorithm based on Newton's method and the linear conjugate gradient algorithm, with explicit detection and use of negative curvature directions for the…

Optimization and Control · Mathematics 2018-11-14 Clément W. Royer , Michael O'Neill , Stephen J. Wright