English
Related papers

Related papers: A Wasserstein Minimum Velocity Approach to Learnin…

200 papers

Many real-world optimization problems contain parameters that are unknown before deployment time, either due to stochasticity or to lack of information (e.g., demand or travel times in delivery problems). A common strategy in such cases is…

Unsupervised skill discovery aims to acquire behavior primitives that improve exploration and accelerate downstream task learning. However, existing approaches often ignore the geometric symmetries of physical environments, leading to…

Robotics · Computer Science 2026-01-21 Junwoo Chang , Joseph Park , Roberto Horowitz , Jongmin Lee , Jongeun Choi

We consider the problem of sampling from a distribution governed by a potential function. This work proposes an explicit score based MCMC method that is deterministic, resulting in a deterministic evolution for particles rather than a…

Machine Learning · Statistics 2023-10-03 Hong Ye Tan , Stanley Osher , Wuchen Li

Based on the manifold hypothesis, real-world data often lie on a low-dimensional manifold, while normalizing flows as a likelihood-based generative model are incapable of finding this manifold due to their structural constraints. So, one…

Machine Learning · Computer Science 2022-06-08 Seyedeh Fatemeh Razavi , Mohammad Mahdi Mehmanchi , Reshad Hosseini , Mostafa Tavassolipour

Approximate inference in probability models is a fundamental task in machine learning. Approximate inference provides powerful tools to Bayesian reasoning, decision making, and Bayesian deep learning. The main goal is to estimate the…

Machine Learning · Computer Science 2020-03-10 Jun Han

Graphs are playing a crucial role in different fields since they are powerful tools to unveil intrinsic relationships among signals. In many scenarios, an accurate graph structure representing signals is not available at all and that…

Machine Learning · Computer Science 2021-05-14 Xiang Zhang , Yinfei Xu , Qinghe Liu , Zhicheng Liu , Jian Lu , Qiao Wang

Flow Matching has recently gained attention in generative modeling as a simple and flexible alternative to diffusion models. While existing statistical guarantees adapt tools from the analysis of diffusion models, we take a different…

Machine Learning · Statistics 2026-03-18 Lea Kunkel , Mathias Trabs

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

In this paper we propose to perform model ensembling in a multiclass or a multilabel learning setting using Wasserstein (W.) barycenters. Optimal transport metrics, such as the Wasserstein distance, allow incorporating semantic side…

Machine Learning · Computer Science 2019-02-14 Pierre Dognin , Igor Melnyk , Youssef Mroueh , Jerret Ross , Cicero Dos Santos , Tom Sercu

Bilevel optimization problems are receiving increasing attention in machine learning as they provide a natural framework for hyperparameter optimization and meta-learning. A key step to tackle these problems is the efficient computation of…

Machine Learning · Statistics 2025-05-20 Riccardo Grazzi , Massimiliano Pontil , Saverio Salzo

Measuring the similarity between data points often requires domain knowledge, which can in parts be compensated by relying on unsupervised methods such as latent-variable models, where similarity/distance is estimated in a more compact…

Machine Learning · Statistics 2020-08-13 Nutan Chen , Alexej Klushyn , Francesco Ferroni , Justin Bayer , Patrick van der Smagt

Utilizing task-invariant knowledge acquired from related tasks as prior information, meta-learning offers a principled approach to learning a new task with limited data records. Sample-efficient adaptation of this prior information is a…

Machine Learning · Computer Science 2025-09-03 Yilang Zhang , Bingcong Li , Georgios B. Giannakis

How can we perform efficient inference and learning in directed probabilistic models, in the presence of continuous latent variables with intractable posterior distributions, and large datasets? We introduce a stochastic variational…

Machine Learning · Statistics 2022-12-13 Diederik P Kingma , Max Welling

Mutual information maximization has emerged as a powerful learning objective for unsupervised representation learning obtaining state-of-the-art performance in applications such as object recognition, speech recognition, and reinforcement…

Machine Learning · Computer Science 2019-03-29 Sherjil Ozair , Corey Lynch , Yoshua Bengio , Aaron van den Oord , Sergey Levine , Pierre Sermanet

The performance of unsupervised methods such as clustering depends on the choice of distance metric between features, or ground metric. Commonly, ground metrics are decided with heuristics or learned via supervised algorithms. However,…

Machine Learning · Computer Science 2025-01-13 Kira M. Düsterwald , Samo Hromadka , Makoto Yamada

This paper targets the task with discrete and periodic class labels ($e.g.,$ pose/orientation estimation) in the context of deep learning. The commonly used cross-entropy or regression loss is not well matched to this problem as they ignore…

Computer Vision and Pattern Recognition · Computer Science 2019-11-05 Xiaofeng Liu , Yang Zou , Tong Che , Peng Ding , Ping Jia , Jane You , Kumar B. V. K

Interpretable representation learning is a central challenge in modern machine learning, particularly in high-dimensional settings such as neuroimaging, genomics, and text analysis. Current methods often struggle to balance the competing…

Machine Learning · Statistics 2025-11-11 Brian B. Avants , Nicholas J. Tustison , James R Stone

Wasserstein Barycenter is a principled approach to represent the weighted mean of a given set of probability distributions, utilizing the geometry induced by optimal transport. In this work, we present a novel scalable algorithm to…

Machine Learning · Computer Science 2021-11-30 Jiaojiao Fan , Amirhossein Taghvaei , Yongxin Chen

Various machine learning tasks, from generative modeling to domain adaptation, revolve around the concept of dataset transformation and manipulation. While various methods exist for transforming unlabeled datasets, principled methods to do…

Machine Learning · Computer Science 2021-06-17 David Alvarez-Melis , Nicolò Fusi

Measuring the distance between ontological elements is fundamental for ontology matching. String-based distance metrics are notorious for shallow syntactic matching. In this exploratory study, we investigate Wasserstein distance targeting…

Artificial Intelligence · Computer Science 2022-09-22 Yuan An , Alex Kalinowski , Jane Greenberg