English
Related papers

Related papers: Hard Negative Sampling via Regularized Optimal Tra…

200 papers

Distributional data have become increasingly prominent in modern signal processing, highlighting the necessity of computing optimal transport (OT) maps across multiple probability distributions. Nevertheless, recent studies on neural OT…

Machine Learning · Computer Science 2025-04-25 Mingchen Jiang , Peng Xu , Xichen Ye , Xiaohui Chen , Yun Yang , Yifan Chen

This paper presents a novel two-step approach for the fundamental problem of learning an optimal map from one distribution to another. First, we learn an optimal transport (OT) plan, which can be thought as a one-to-many map between the two…

Optimal Transport (OT) based distances are powerful tools for machine learning to compare probability measures and manipulate them using OT maps. In this field, a setting of interest is semi-discrete OT, where the source measure $\mu$ is…

Regularizing the optimal transport (OT) problem has proven crucial for OT theory to impact the field of machine learning. For instance, it is known that regularizing OT problems with entropy leads to faster computations and better…

Machine Learning · Statistics 2020-08-04 François-Pierre Paty , Marco Cuturi

We establish numerical methods for solving the martingale optimal transport problem (MOT) - a version of the classical optimal transport with an additional martingale constraint on transport's dynamics. We prove that the MOT value can be…

Probability · Mathematics 2019-04-08 Gaoyue Guo , Jan Obloj

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

Machine Learning · Statistics 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

The relevance of optimal transport methods to machine learning has long been hindered by two salient limitations. First, the $O(n^3)$ computational cost of standard sample-based solvers (when used on batches of $n$ samples) is prohibitive.…

Machine Learning · Computer Science 2023-06-01 Meyer Scetbon , Michal Klein , Giovanni Palla , Marco Cuturi

An adaptive, adversarial methodology is developed for the optimal transport problem between two distributions $\mu$ and $\nu$, known only through a finite set of independent samples $(x_i)_{i=1..N}$ and $(y_j)_{j=1..M}$. The methodology…

Optimization and Control · Mathematics 2019-02-20 Montacer Essid , Debra Laefer , Esteban G. Tabak

Neural ordinary differential equations (ODEs) provide expressive representations of invertible transport maps that can be used to approximate complex probability distributions, e.g., for generative modeling, density estimation, and Bayesian…

Machine Learning · Computer Science 2025-02-07 Youssef Marzouk , Zhi Ren , Jakob Zech

The unsupervised task of aligning two or more distributions in a shared latent space has many applications including fair representations, batch effect mitigation, and unsupervised domain adaptation. Existing flow-based approaches estimate…

Machine Learning · Computer Science 2022-03-17 Zeyu Zhou , Ziyu Gong , Pradeep Ravikumar , David I. Inouye

Transport systems on networks are crucial in various applications, but face a significant risk of being adversely affected by unforeseen circumstances such as disasters. The application of entropy-regularized optimal transport (OT) on graph…

Machine Learning · Computer Science 2025-05-07 Koshi Oishi , Yota Hashizume , Tomohiko Jimbo , Hirotaka Kaji , Kenji Kashima

Distributionally robust optimization tackles out-of-sample issues like overfitting and distribution shifts by adopting an adversarial approach over a range of possible data distributions, known as the ambiguity set. To balance conservatism…

Machine Learning · Computer Science 2025-10-02 Ahmad-Reza Ehyaei , Golnoosh Farnadi , Samira Samadi

This paper concerns the application of techniques from optimal transport (OT) to mean field control, in which the probability measures of interest in OT correspond to empirical distributions associated with a large collection of controlled…

Optimization and Control · Mathematics 2025-06-23 Thomas Le Corre , Ana Busic , Sean Meyn

Word2Vec is the most popular model for word representation and has been widely investigated in literature. However, its noise distribution for negative sampling is decided by empirical trials and the optimality has always been ignored. We…

Computation and Language · Computer Science 2019-10-22 Wenxiang Jiao , Irwin King , Michael R. Lyu

An optimal transport (OT) problem seeks to find the cheapest mapping between two distributions with equal total density, given the cost of transporting density from one place to another. Unbalanced OT allows for different total density in…

Optimization and Control · Mathematics 2025-07-28 Jacob J. M. Francis , Colin J. Cotter , Marion P. Mittermaier

Negative sampling is a limiting factor w.r.t. the generalization of metric-learned neural networks. We show that uniform negative sampling provides little information about the class boundaries and thus propose three novel techniques for…

Machine Learning · Computer Science 2021-02-15 James O' Neill , Danushka Bollegala

Recently, min-max optimization problems have received increasing attention due to their wide range of applications in machine learning (ML). However, most existing min-max solution techniques are either single-machine or distributed…

Machine Learning · Computer Science 2023-03-07 Zhuqing Liu , Xin Zhang , Songtao Lu , Jia Liu

Obtaining solutions to Optimal Transportation (OT) problems is typically intractable when the marginal spaces are continuous. Recent research has focused on approximating continuous solutions with discretization methods based on i.i.d.…

Optimization and Control · Mathematics 2021-02-17 Junqi Wang , Pei Wang , Patrick Shafto

This paper investigates the semi-discrete optimal transport (OT) problem with entropic regularization. We characterize the solution using a governing, well-posed ordinary differential equation (ODE). This naturally yields an algorithm to…

Numerical Analysis · Mathematics 2025-04-07 Luca Nenna , Daniyar Omarov , Brendan Pass

This paper focuses on multi-block optimization problems over transport polytopes, which underlie various applications including strongly correlated quantum physics and machine learning. Conventional block coordinate descent-type methods for…

Optimization and Control · Mathematics 2024-08-27 Yukuan Hu , Mengyu Li , Xin Liu , Cheng Meng
‹ Prev 1 3 4 5 6 7 10 Next ›