English
Related papers

Related papers: Translation-Equivariant Self-Supervised Learning f…

200 papers

Optimal transport (OT) is a powerful geometric tool used to compare and align probability measures following the least effort principle. Despite its widespread use in machine learning (ML), OT problem still bears its computational burden,…

Machine Learning · Computer Science 2023-08-14 Oliver Struckmeier , Ievgen Redko , Anton Mallasto , Karol Arndt , Markus Heinonen , Ville Kyrki

Entropic optimal transport (EOT) in continuous spaces with quadratic cost is a classical tool for solving the domain translation problem. In practice, recent approaches optimize a weak dual EOT objective depending on a single potential, but…

Machine Learning · Computer Science 2026-02-03 Roman Dyachenko , Nikita Gushchin , Kirill Sokolov , Petr Mokrov , Evgeny Burnaev , Alexander Korotin

We introduce an optimal transport-based model for learning a metric tensor from cross-sectional samples of evolving probability measures on a common Riemannian manifold. We neurally parametrize the metric as a spatially-varying matrix field…

Machine Learning · Computer Science 2023-03-08 Christopher Scarvelis , Justin Solomon

Inverse optimal transport (OT) refers to the problem of learning the cost function for OT from observed transport plan or its samples. In this paper, we derive an unconstrained convex optimization formulation of the inverse OT problem,…

Machine Learning · Computer Science 2021-07-06 Shaojun Ma , Haodong Sun , Xiaojing Ye , Hongyuan Zha , Haomin Zhou

Recently, Optimal Transport has been proposed as a probabilistic framework in Machine Learning for comparing and manipulating probability distributions. This is rooted in its rich history and theory, and has offered new solutions to…

Machine Learning · Computer Science 2024-08-22 Eduardo Fernandes Montesuma , Fred Ngolè Mboula , Antoine Souloumiac

Self-supervised learning for inverse problems allows to train a reconstruction network from noise and/or incomplete data alone. These methods have the potential of enabling learning-based solutions when obtaining ground-truth references for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Victor Sechaud , Jérémy Scanvic , Quentin Barthélemy , Patrice Abry , Julián Tachella

With the increasing attention to large vision-language models such as CLIP, there has been a significant amount of effort dedicated to building efficient prompts. Unlike conventional methods of only learning one single prompt, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Guangyi Chen , Weiran Yao , Xiangchen Song , Xinyue Li , Yongming Rao , Kun Zhang

In this work, we propose a novel machine learning approach to compute the optimal transport map between two continuous distributions from their unpaired samples, based on the DeepParticle methods. The proposed method leads to a min-min…

Machine Learning · Statistics 2025-07-01 Yingyuan Li , Aokun Wang , Zhongjian Wang

This thesis examines self-attention training through the lens of Optimal Transport (OT) and develops an OT-based alternative for tabular classification. The study tracks intermediate projections of the self-attention layer during training…

Machine Learning · Statistics 2026-02-19 Alessandro Quadrio , Antonio Candelieri

We address the problem of unsupervised domain adaptation under the setting of generalized target shift (joint class-conditional and label shifts). For this framework, we theoretically show that, for good generalization, it is necessary to…

Machine Learning · Computer Science 2021-10-20 Alain Rakotomamonjy , Rémi Flamary , Gilles Gasso , Mokhtar Z. Alaya , Maxime Berar , Nicolas Courty

We present an ensemble-driven self-training framework for unsupervised neural machine translation (UNMT). Starting from a primary language pair, we train multiple UNMT models that share the same translation task but differ in an auxiliary…

Computation and Language · Computer Science 2026-03-19 Ido Aharon , Jonathan Shaki , Sarit Kraus

This paper proposes a method to construct pretext tasks for self-supervised learning on group equivariant neural networks. Group equivariant neural networks are the models whose structure is restricted to commute with the transformations on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Yusuke Mukuta , Tatsuya Harada

The objective in statistical Optimal Transport (OT) is to consistently estimate the optimal transport plan/map solely using samples from the given source and target marginal distributions. This work takes the novel approach of posing…

Machine Learning · Computer Science 2020-11-11 J. Saketha Nath , Pratik Jawanpuria

In this paper, we propose to tackle the problem of reducing discrepancies between multiple domains referred to as multi-source domain adaptation and consider it under the target shift assumption: in all domains we aim to solve a…

Machine Learning · Statistics 2019-03-15 Ievgen Redko , Nicolas Courty , Rémi Flamary , Devis Tuia

Selecting input features of top relevance has become a popular method for building self-explaining models. In this work, we extend this selective rationalization approach to text matching, where the goal is to jointly select and align text…

Machine Learning · Computer Science 2020-05-28 Kyle Swanson , Lili Yu , Tao Lei

We consider statistical learning problems in which data are observed as a set of probability measures. Optimal transport (OT) is a popular tool to compare and manipulate such objects, but its computational cost becomes prohibitive when the…

Machine Learning · Statistics 2026-03-24 Erell Gachon , Elsa Cazelles , Jérémie Bigot

Domain adaptation aims to transfer knowledge of labeled instances obtained from a source domain to a target domain to fill the gap between the domains. Most domain adaptation methods assume that the source and target domains have the same…

Machine Learning · Computer Science 2022-09-13 Toshimitsu Aritake , Hideitsu Hino

Optimal transport maps define a one-to-one correspondence between probability distributions, and as such have grown popular for machine learning applications. However, these maps are generally defined on empirical observations and cannot be…

Statistics Theory · Mathematics 2021-02-18 Lucas de Lara , Alberto González-Sanz , Jean-Michel Loubes

We propose a method to identify and characterize distribution shifts in classification datasets based on optimal transport. It allows the user to identify the extent to which each class is affected by the shift, and retrieves corresponding…

Machine Learning · Computer Science 2022-08-08 Neha Hulkund , Nicolo Fusi , Jennifer Wortman Vaughan , David Alvarez-Melis

This paper proposes a new method to interpolate between two audio signals. As an interpolation parameter is changed, the pitches in one signal slide to the pitches in the other, producing a portamento, or musical glide. The assignment of…

Audio and Speech Processing · Electrical Eng. & Systems 2019-06-18 Trevor Henderson , Justin Solomon