English
Related papers

Related papers: Distribution-on-Distribution Regression with Wasse…

200 papers

We introduce a novel and scalable Bayesian framework for multivariate-density-density regression (DDR), designed to model relationships between multivariate distributions. Our approach addresses the critical issue of distributions residing…

Methodology · Statistics 2025-09-24 Khai Nguyen , Yang Ni , Peter Mueller

In this paper, we propose a new and unified approach for nonparametric regression and conditional distribution learning. Our approach simultaneously estimates a regression function and a conditional generator using a generative learning…

Machine Learning · Statistics 2023-06-28 Shanshan Song , Tong Wang , Guohao Shen , Yuanyuan Lin , Jian Huang

Modeling observations as random distributions embedded within Wasserstein spaces is becoming increasingly popular across scientific fields, as it captures the variability and geometric structure of the data more effectively. However, the…

Statistics Theory · Mathematics 2026-04-08 François Bachoc , Alberto González-Sanz , Jean-Michel Loubes , Yisha Yao

Distribution regression has recently attracted much interest as a generic solution to the problem of supervised learning where labels are available at the group level, rather than at the individual level. Current approaches, however, do not…

Machine Learning · Statistics 2021-01-18 Ho Chung Leon Law , Danica J. Sutherland , Dino Sejdinovic , Seth Flaxman

Compared with word embedding based on point representation, distribution-based word embedding shows more flexibility in expressing uncertainty and therefore embeds richer semantic information when representing words. The Wasserstein…

Computation and Language · Computer Science 2018-09-05 Chi Sun , Hang Yan , Xipeng Qiu , Xuanjing Huang

In this paper we tackle the problem of comparing distributions of random variables and defining a mean pattern between a sample of random events. Using barycenters of measures in the Wasserstein space, we propose an iterative version as an…

Statistics Theory · Mathematics 2013-12-12 Emmanuel Boissard , Thibaut Le Gouic , Jean-Michel Loubes

Series of univariate distributions indexed by equally spaced time points are ubiquitous in applications and their analysis constitutes one of the challenges of the emerging field of distributional data analysis. To quantify such…

Methodology · Statistics 2023-05-23 Changbo Zhu , Hans-Georg Müller

Understanding the space of probability measures on a metric space equipped with a Wasserstein distance is one of the fundamental questions in mathematical analysis. The Wasserstein metric has received a lot of attention in the machine…

Machine Learning · Computer Science 2021-03-02 Arijit Sehanobish , Neal Ravindra , David van Dijk

Gaussian processes (GPs) are a well-known nonparametric Bayesian inference technique, but they suffer from scalability problems for large sample sizes, and their performance can degrade for non-stationary or spatially heterogeneous data. In…

Machine Learning · Statistics 2021-07-28 Michael E. Kepler , Alec Koppel , Amrit Singh Bedi , Daniel J. Stilwell

We study the Wasserstein natural gradient in parametric statistical models with continuous sample spaces. Our approach is to pull back the $L^2$-Wasserstein metric tensor in the probability density space to a parameter space, equipping the…

Optimization and Control · Mathematics 2024-08-20 Yifan Chen , Wuchen Li

This paper addresses a new active learning strategy for regression problems. The presented Wasserstein active regression model is based on the principles of distribution-matching to measure the representativeness of the labeled dataset. The…

Machine Learning · Computer Science 2024-03-25 Benjamin Bobbia , Matthias Picard

Transfer learning is a powerful paradigm for leveraging knowledge from source domains to enhance learning in a target domain. However, traditional transfer learning approaches often focus on scalar or multivariate data within Euclidean…

Machine Learning · Computer Science 2025-10-24 Kaicheng Zhang , Sinian Zhang , Doudou Zhou , Yidong Zhou

Generative modeling typically concerns transporting a single source distribution to a target distribution via simple probability flows. However, in fields like computer graphics and single-cell genomics, samples themselves can be viewed as…

Machine Learning · Computer Science 2025-05-20 Doron Haviv , Aram-Alexandre Pooladian , Dana Pe'er , Brandon Amos

Learning conditional densities and identifying factors that influence the entire distribution are vital tasks in data-driven applications. Conventional approaches work mostly with summary statistics, and are hence inadequate for a…

Methodology · Statistics 2022-09-13 Chengliang Tang , Nathan Lenssen , Ying Wei , Tian Zheng

With the increasing availability of data objects in the form of probability distributions, there is a growing need for statistical methods tailored to distributional data. Distance measures, especially the pairwise distance matrix between…

Methodology · Statistics 2026-03-03 Edward Shao , Junyoung Park , Naresh Punjabi , Hui Jiang , Irina Gaynanova

We study a distributionally robust optimization formulation (i.e., a min-max game) for two representative problems in Bayesian nonparametric estimation: Gaussian process regression and, more generally, linear inverse problems. Our…

Optimization and Control · Mathematics 2025-01-14 Xuhui Zhang , Jose Blanchet , Youssef Marzouk , Viet Anh Nguyen , Sven Wang

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning with fundamental…

Machine Learning · Statistics 2021-08-23 Ruidi Chen , Ioannis Ch. Paschalidis

The Wasserstein distance is a distance between two probability distributions and has recently gained increasing popularity in statistics and machine learning, owing to its attractive properties. One important approach to extending this…

Methodology · Statistics 2022-02-14 Ryo Okano , Masaaki Imaizumi

Many studies have been conducted on flows of probability measures, often in terms of gradient flows. We utilize a generalized notion of derivatives with respect to time to model the instantaneous evolution of empirically observed…

Methodology · Statistics 2021-09-16 Yaqing Chen , Hans-Georg Müller

Ensembles of neural network weight matrices are studied through the training process for the MNIST classification problem, testing the efficacy of matrix models for representing their distributions, under assumptions of Gaussianity and…

Machine Learning · Computer Science 2025-10-08 Edward Hirst , Sanjaye Ramgoolam