English
Related papers

Related papers: Inverse Entropic Optimal Transport Solves Semi-sup…

200 papers

In machine learning, Optimal Transport (OT) theory is extensively utilized to compare probability distributions across various applications, such as graph data represented by node distributions and image data represented by pixel…

Machine Learning · Computer Science 2025-01-30 Jianming Huang , Xun Su , Zhongxi Fang , Hiroyuki Kasai

Recent studies have proposed different methods to improve multilingual word representations in contextualized settings including techniques that align between source and target embedding spaces. For contextualized embeddings, alignment…

Computation and Language · Computer Science 2026-03-20 Sawsan Alqahtani , Garima Lalwani , Yi Zhang , Salvatore Romeo , Saab Mansour

Optimal transport (OT) is a versatile framework for comparing probability measures, with many applications to statistics, machine learning, and applied mathematics. However, OT distances suffer from computational and statistical scalability…

Statistics Theory · Mathematics 2022-06-08 Ziv Goldfeld , Kengo Kato , Gabriel Rioux , Ritwik Sadhu

Optimal Transport (OT) has recently emerged as a central tool in data sciences to compare in a geometrically faithful way point clouds and more generally probability distributions. The wide adoption of OT into existing data analysis and…

Machine Learning · Statistics 2023-01-18 Thibault Séjourné , Gabriel Peyré , François-Xavier Vialard

Entropic optimal transport (EOT) in continuous spaces with quadratic cost is a classical tool for solving the domain translation problem. In practice, recent approaches optimize a weak dual EOT objective depending on a single potential, but…

Machine Learning · Computer Science 2026-02-03 Roman Dyachenko , Nikita Gushchin , Kirill Sokolov , Petr Mokrov , Evgeny Burnaev , Alexander Korotin

Maximum entropy models provide the least constrained probability distributions that reproduce statistical properties of experimental datasets. In this work we characterize the learning dynamics that maximizes the log-likelihood in the case…

Disordered Systems and Neural Networks · Physics 2016-09-21 Ulisse Ferrari

In this paper, we propose a novel approach for unsupervised domain adaptation, that relates notions of optimal transport, learning probability measures and unsupervised learning. The proposed approach, HOT-DA, is based on a hierarchical…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Mourad El Hamri , Younès Bennani , Issam Falih , Hamid Ahaggach

An adaptive, adversarial methodology is developed for the optimal transport problem between two distributions $\mu$ and $\nu$, known only through a finite set of independent samples $(x_i)_{i=1..N}$ and $(y_j)_{j=1..M}$. The methodology…

Optimization and Control · Mathematics 2019-02-20 Montacer Essid , Debra Laefer , Esteban G. Tabak

We propose a unified data-driven framework based on inverse optimal transport that can learn adaptive, nonlinear interaction cost function from noisy and incomplete empirical matching matrix and predict new matching in various matching…

Machine Learning · Statistics 2018-11-01 Ruilin Li , Xiaojing Ye , Haomin Zhou , Hongyuan Zha

The most basic assumption used in statistical learning theory is that training data and test data are drawn from the same underlying distribution. Unfortunately, in many applications, the "in-domain" test data is drawn from a distribution…

Machine Learning · Computer Science 2011-09-30 H. Daume , D. Marcu

Semi-Supervised Learning (SSL) approaches have been an influential framework for the usage of unlabeled data when there is not a sufficient amount of labeled data available over the course of training. SSL methods based on Convolutional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Fariborz Taherkhani , Hadi Kazemi , Ali Dabouei , Jeremy Dawson , Nasser M. Nasrabadi

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

Optimal transport (OT) theory provides powerful tools to compare probability measures. However, OT is limited to nonnegative measures having the same mass, and suffers serious drawbacks about its computation and statistics. This leads to…

Machine Learning · Statistics 2021-01-26 Tam Le , Truyen Nguyen

Distributional data have become increasingly prominent in modern signal processing, highlighting the necessity of computing optimal transport (OT) maps across multiple probability distributions. Nevertheless, recent studies on neural OT…

Machine Learning · Computer Science 2025-04-25 Mingchen Jiang , Peng Xu , Xichen Ye , Xiaohui Chen , Yun Yang , Yifan Chen

Despite the success of deep learning-based algorithms, it is widely known that neural networks may fail to be robust. A popular paradigm to enforce robustness is adversarial training (AT), however, this introduces many computational and…

Machine Learning · Computer Science 2024-01-18 Nicolas Garcia Trillos , Matt Jacobs , Jakwang Kim , Matthew Werenski

We propose a novel neural algorithm for the fundamental problem of computing the entropic optimal transport (EOT) plan between continuous probability distributions which are accessible by samples. Our algorithm is based on the saddle point…

Machine Learning · Computer Science 2023-11-02 Nikita Gushchin , Alexander Kolesov , Alexander Korotin , Dmitry Vetrov , Evgeny Burnaev

To remedy the drawbacks of full-mass or fixed-mass constraints in classical optimal transport, we propose adaptive optimal transport which is distinctive from the classical optimal transport in its ability of adaptive-mass preserving. It…

Machine Learning · Computer Science 2025-03-10 Pei Yang , Qi Tan , Guihua Wen

The ability to compare two degenerate probability distributions (i.e. two probability distributions supported on two distinct low-dimensional manifolds living in a much higher-dimensional space) is a crucial problem arising in the…

Machine Learning · Statistics 2017-10-23 Aude Genevay , Gabriel Peyré , Marco Cuturi

Efficient computation of the optimal transport distance between two distributions serves as an algorithm subroutine that empowers various applications. This paper develops a scalable first-order optimization-based method that computes…

Machine Learning · Computer Science 2024-06-21 Gen Li , Yanxi Chen , Yu Huang , Yuejie Chi , H. Vincent Poor , Yuxin Chen

Motivated by robust dynamic resource allocation in operations research, we study the \textit{Online Learning to Transport} (OLT) problem where the decision variable is a probability measure, an infinite-dimensional object. We draw…

Machine Learning · Computer Science 2022-11-21 Wenxuan Guo , YoonHaeng Hur , Tengyuan Liang , Christopher Ryan