English
Related papers

Related papers: Scalable Learning from Probability Measures with M…

200 papers

The power and flexibility of Optimal Transport (OT) have pervaded a wide spectrum of problems, including recent Machine Learning challenges such as unsupervised domain adaptation. Its essence of quantitatively relating two probability…

Image and Video Processing · Electrical Eng. & Systems 2023-04-18 Bo Jiang , Hamid Krim , Tianfu Wu , Derya Cansever

Optimal Transport (OT) distances are now routinely used as loss functions in ML tasks. Yet, computing OT distances between arbitrary (i.e. not necessarily discrete) probability distributions remains an open problem. This paper introduces a…

Optimization and Control · Mathematics 2020-07-03 Arthur Mensch , Gabriel Peyré

Mini-batch optimal transport (m-OT) has been successfully used in practical applications that involve probability measures with a very high number of supports. The m-OT solves several smaller optimal transport problems and then returns the…

Machine Learning · Statistics 2022-06-08 Khai Nguyen , Dang Nguyen , Quoc Nguyen , Tung Pham , Hung Bui , Dinh Phung , Trung Le , Nhat Ho

The optimal transport problem for measures supported on non-Euclidean spaces has recently gained ample interest in diverse applications involving representation learning. In this paper, we focus on circular probability measures, i.e.,…

Machine Learning · Computer Science 2023-10-11 Rocio Diaz Martin , Ivan Medri , Yikun Bai , Xinran Liu , Kangbai Yan , Gustavo K. Rohde , Soheil Kolouri

This article introduces a new notion of optimal transport (OT) between tensor fields, which are measures whose values are positive semidefinite (PSD) matrices. This "quantum" formulation of OT (Q-OT) corresponds to a relaxed version of the…

Graphics · Computer Science 2017-07-25 Gabriel Peyré , Lenaïc Chizat , François-Xavier Vialard , Justin Solomon

Bi-causal optimal transport (OT) is a natural framework for comparing and coupling stochastic processes under nonanticipative information constraints, with important applications in robust finance, sequential uncertainty quantification, and…

Optimization and Control · Mathematics 2026-05-19 Haoyang Cao , Jesse Hoekstra , Renyuan Xu , Yumin Xu , Ruixun Zhang

Preference learning in Large Language Models (LLMs) has advanced significantly, yet existing methods remain limited by modest performance gains, high computational costs, hyperparameter sensitivity, and insufficient modeling of global…

Computation and Language · Computer Science 2026-04-03 Liang Zhu , Yuelin Bai , Xiankun Ren , Jiaxi Yang , Lei Zhang , Feiteng Fang , Hamid Alinejad-Rokny , Minghuan Tan , Min Yang

In this paper, we present an intuitive analysis of the optimization technique based on the quantization of an objective function. Quantization of an objective function is an effective optimization methodology that decreases the measure of a…

Machine Learning · Computer Science 2025-01-03 Jinwuk Seok , Changsik Cho

Domain similarity measures can be used to gauge adaptability and select suitable data for transfer learning, but existing approaches define ad hoc measures that are deemed suitable for respective tasks. Inspired by work on curriculum…

Computation and Language · Computer Science 2017-07-18 Sebastian Ruder , Barbara Plank

Estimating Wasserstein distances between two high-dimensional densities suffers from the curse of dimensionality: one needs an exponential (wrt dimension) number of samples to ensure that the distance between two empirical measures is…

Machine Learning · Statistics 2020-07-13 François-Pierre Paty , Alexandre d'Aspremont , Marco Cuturi

Few-Shot classification aims at solving problems that only a few samples are available in the training process. Due to the lack of samples, researchers generally employ a set of training tasks from other domains to assist the target task,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-04 Renjie Xu , Xinghao Yang , Baodi Liu , Kai Zhang , Weifeng Liu

Optimal transport (OT) finds a least cost transport plan between two probability distributions using a cost matrix defined on pairs of points. Unlike standard OT, which infers unstructured pointwise mappings, low-rank optimal transport…

Machine Learning · Computer Science 2026-03-05 Henri Schmidt , Peter Halmos , Ben Raphael

Semi-Supervised Learning (SSL) approaches have been an influential framework for the usage of unlabeled data when there is not a sufficient amount of labeled data available over the course of training. SSL methods based on Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Fariborz Taherkhani , Hadi Kazemi , Ali Dabouei , Jeremy Dawson , Nasser M. Nasrabadi

This paper addresses the limitations of standard uncertainty models, e.g., robust (norm-bounded) and stochastic (one fixed distribution, e.g., Gaussian), and proposes to model uncertainty via Optimal Transport (OT) ambiguity sets. These…

Optimization and Control · Mathematics 2023-09-08 Liviu Aolaritei , Nicolas Lanzetti , Hongruyu Chen , Florian Dörfler

We establish numerical methods for solving the martingale optimal transport problem (MOT) - a version of the classical optimal transport with an additional martingale constraint on transport's dynamics. We prove that the MOT value can be…

Probability · Mathematics 2019-04-08 Gaoyue Guo , Jan Obloj

This paper explores the process of optimal quantization for several types of discrete probability distributions. Quantization is a technique used to approximate a complex distribution with a smaller set of representative points, which is…

Probability · Mathematics 2025-07-16 Russel Cabasag , Samir Huq , Eric Mendoza , Mrinal Kanti Roychowdhury

We propose a fast and scalable algorithm to project a given density on a set of structured measures defined over a compact 2D domain. The measures can be discrete or supported on curves for instance. The proposed principle and algorithm are…

Numerical Analysis · Mathematics 2019-02-05 Frédéric de Gournay , Jonas Kahn , Léo Lebrat , Pierre Weiss

Real-world machine learning applications often have complex test metrics, and may have training and test data that are not identically distributed. Motivated by known connections between complex test metrics and cost-weighted learning, we…

Machine Learning · Statistics 2019-06-18 Sen Zhao , Mahdi Milani Fard , Harikrishna Narasimhan , Maya Gupta

Optimal Transport has received much attention in Machine Learning as it allows to compare probability distributions by exploiting the geometry of the underlying space. However, in its original formulation, solving this problem suffers from…

Machine Learning · Computer Science 2023-11-27 Clément Bonet

The basic goal of quantization for probability distribution is to reduce the number of values, which is typically uncountable, describing a probability distribution to some finite set and thus approximation of a continuous probability…

Probability · Mathematics 2021-01-27 Mrinal Kanti Roychowdhury
‹ Prev 1 3 4 5 6 7 10 Next ›