English
Related papers

Related papers: Regression analysis of distributional data through…

200 papers

This paper proposes a distributionally robust approach to logistic regression. We use the Wasserstein distance to construct a ball in the space of probability distributions centered at the uniform distribution on the training samples. If…

Optimization and Control · Mathematics 2015-12-02 Soroosh Shafieezadeh-Abadeh , Peyman Mohajerin Esfahani , Daniel Kuhn

While statistical modeling of distributional data has gained increased attention, the case of multivariate distributions has been somewhat neglected despite its relevance in various applications. This is because the Wasserstein distance,…

Methodology · Statistics 2025-10-21 Han Chen , Yidong Zhou , Hans-Georg Müller

We study optimization problems whereby the optimization variable is a probability measure. Since the probability space is not a vector space, many classical and powerful methods for optimization (e.g., gradients) are of little help. Thus,…

Optimization and Control · Mathematics 2024-06-18 Nicolas Lanzetti , Antonio Terpin , Florian Dörfler

We consider the optimization problem of minimizing a functional defined over a family of probability distributions, where the objective functional is assumed to possess a variational form. Such a distributional optimization problem arises…

Machine Learning · Computer Science 2024-04-02 Zhuoran Yang , Yufeng Zhang , Yongxin Chen , Zhaoran Wang

We propose to align distributional data from the perspective of Wasserstein means. We raise the problem of regularizing Wasserstein means and propose several terms tailored to tackle different problems. Our formulation is based on the…

Machine Learning · Computer Science 2020-02-24 Liang Mi , Wen Zhang , Yalin Wang

Optimal transport is a foundational problem in optimization, that allows to compare probability distributions while taking into account geometric aspects. Its optimal objective value, the Wasserstein distance, provides an important loss…

Machine Learning · Computer Science 2020-02-21 Marin Ballu , Quentin Berthet , Francis Bach

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

Regression analysis with probability measures as input predictors and output response has recently drawn great attention. However, it is challenging to handle multiple input probability measures due to the non-flat Riemannian geometry of…

Methodology · Statistics 2024-05-23 Xiaoyu Chen , Mengfan Fu , Yujing Huang , Xinwei Deng

We present a novel class of projected methods, to perform statistical analysis on a data set of probability distributions on the real line, with the 2-Wasserstein metric. We focus in particular on Principal Component Analysis (PCA) and…

Methodology · Statistics 2021-11-30 Matteo Pegoraro , Mario Beraha

This paper proposes a data-driven distributionally robust shortest path (DRSP) model where the distribution of the travel time in the transportation network can only be partially observed through a finite number of samples. Specifically, we…

Optimization and Control · Mathematics 2019-11-19 Zhuolin Wang , Keyou You , Shiji Song , Yuli Zhang

Optimal transport has found widespread applications in signal processing and machine learning. Among its many equivalent formulations, optimal transport seeks to reconstruct a random variable/vector with a prescribed distribution at the…

Information Theory · Computer Science 2025-03-06 Jun Chen , Jia Wang , Ruibin Li , Han Zhou , Wei Dong , Huan Liu , Yuanhao Yu

Classical optimal transport problem seeks a transportation map that preserves the total mass betwenn two probability distributions, requiring their mass to be the same. This may be too restrictive in certain applications such as color or…

Machine Learning · Statistics 2020-06-15 Laetitia Chapel , Mokhtar Z. Alaya , Gilles Gasso

We introduce the problem of transporting vector-valued distributions. In this, a salient feature is that mass may flow between vectorial entries as well as across space (discrete or continuous). The theory relies on a first step taken to…

Optimization and Control · Mathematics 2017-05-19 Yongxin Chen , Tryphon T. Georgiou , Allen Tannenbaum

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

Statistics Theory · Mathematics 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

We study the problem of estimating a sequence of evolving probability distributions from historical data, where the underlying distribution changes over time in a nonstationary and nonparametric manner. To capture gradual changes, we…

Optimization and Control · Mathematics 2025-12-16 Edward J. Anderson , Dominic S. T. Keehan

Many numerical and learning algorithms rely on the solution of the Monge-Kantorovich problem and Wasserstein distances, which provide appropriate distributional metrics. While the natural approach is to treat the problem as an…

Optimization and Control · Mathematics 2025-12-11 Mohsen Sadr , Peyman Mohajerin Esfahani , Hossein Gorji

Logistic regression models are widely used in the social and behavioral sciences and in high-stakes domains, due to their simplicity and interpretability properties. At the same time, such domains are permeated by distribution shifts, where…

Machine Learning · Computer Science 2025-03-18 Qingshi Sun , Nathan Justin , Andres Gomez , Phebe Vayanos

Optimal transport provides a metric which quantifies the dissimilarity between probability measures. For measures supported in discrete metric spaces, finding the optimal transport distance has cubic time complexity in the size of the…

Machine Learning · Computer Science 2024-01-30 Samantha Chen , Puoya Tabaghi , Yusu Wang

Many scientific systems, such as cellular populations or economic cohorts, are naturally described by probability distributions that evolve over time. Predicting how such a system would have evolved under different forces or initial…

Machine Learning · Statistics 2026-03-26 Tristan Luca Saidi , Gonzalo Mena , Larry Wasserman , Florian Gunsilius

A data-driven formulation of the optimal transport problem is presented and solved using adaptively refined meshes to decompose the problem into a sequence of finite linear programming problems. Both the marginal distributions and their…

Numerical Analysis · Mathematics 2017-10-11 Weikun Chen , Esteban G. Tabak