中文
相关论文

相关论文: A Wasserstein Minimax Framework for Mixed Linear R…

200 篇论文

This monograph develops a comprehensive statistical learning framework that is robust to (distributional) perturbations in the data using Distributionally Robust Optimization (DRO) under the Wasserstein metric. Beginning with fundamental…

机器学习 · 统计学 2021-08-23 Ruidi Chen , Ioannis Ch. Paschalidis

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

统计方法学 · 统计学 2024-02-09 Ryo Okano , Masaaki Imaizumi

We propose a new formulation and learning strategy for computing the Wasserstein geodesic between two probability distributions in high dimensions. By applying the method of Lagrange multipliers to the dynamic formulation of the optimal…

机器学习 · 计算机科学 2021-06-08 Shu Liu , Shaojun Ma , Yongxin Chen , Hongyuan Zha , Haomin Zhou

We propose a learning framework for graph kernels, which is theoretically grounded on regularizing optimal transport. This framework provides a novel optimal transport distance metric, namely Regularized Wasserstein (RW) discrepancy, which…

机器学习 · 计算机科学 2021-10-11 Asiri Wijesinghe , Qing Wang , Stephen Gould

A meta-model is trained on a distribution of similar tasks such that it learns an algorithm that can quickly adapt to a novel task with only a handful of labeled examples. Most of current meta-learning methods assume that the meta-training…

机器学习 · 计算机科学 2019-04-12 Minseop Park , Jungtaek Kim , Saehoon Kim , Yanbin Liu , Seungjin Choi

We consider distributed estimation of the inverse covariance matrix, also called the concentration or precision matrix, in Gaussian graphical models. Traditional centralized estimation often requires global inference of the covariance…

机器学习 · 统计学 2015-06-15 Zhaoshi Meng , Dennis Wei , Ami Wiesel , Alfred O. Hero

While mixture of linear regressions (MLR) is a well-studied topic, prior works usually do not analyze such models for prediction error. In fact, {\em prediction} and {\em loss} are not well-defined in the context of mixtures. In this paper,…

机器学习 · 统计学 2022-05-27 Avishek Ghosh , Arya Mazumdar , Soumyabrata Pal , Rajat Sen

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Logistic regression models are widely used in the social and behavioral sciences and in high-stakes domains, due to their simplicity and interpretability properties. At the same time, such domains are permeated by distribution shifts, where…

机器学习 · 计算机科学 2025-03-18 Qingshi Sun , Nathan Justin , Andres Gomez , Phebe Vayanos

We address the estimation problem for general finite mixture models, with a particular focus on the elliptical mixture models (EMMs). Compared to the widely adopted Kullback-Leibler divergence, we show that the Wasserstein distance provides…

机器学习 · 计算机科学 2020-10-09 Shengxi Li , Zeyang Yu , Min Xiang , Danilo Mandic

We propose a framework, named Aggregated Wasserstein, for computing a dissimilarity measure or distance between two Hidden Markov Models with state conditional distributions being Gaussian. For such HMMs, the marginal distribution at any…

机器学习 · 计算机科学 2017-11-21 Yukun Chen , Jianbo Ye , Jia Li

We consider the problem of mixed linear regression (MLR), where each observed sample belongs to one of $K$ unknown linear models. In practical applications, the proportions of the $K$ components are often imbalanced. Unfortunately, most MLR…

机器学习 · 统计学 2023-01-31 Pini Zilber , Boaz Nadler

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

机器学习 · 统计学 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

统计理论 · 数学 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

Wasserstein Discriminant Analysis (WDA) is a new supervised method that can improve classification of high-dimensional data by computing a suitable linear map onto a lower dimensional subspace. Following the blueprint of classical Linear…

机器学习 · 统计学 2018-09-21 Rémi Flamary , Marco Cuturi , Nicolas Courty , Alain Rakotomamonjy

We study the estimation problem of distribution-on-distribution regression, where both predictors and responses are probability measures. Existing approaches typically rely on a global optimal transport map or tangent-space linearization,…

机器学习 · 统计学 2025-11-17 Inga Girshfeld , Xiaohui Chen

Gaussian mixture models (GMMs) are widely used in machine learning for tasks such as clustering, classification, image reconstruction, and generative modeling. A key challenge in working with GMMs is defining a computationally efficient and…

机器学习 · 计算机科学 2025-08-05 Moritz Piening , Robert Beinert

This paper focuses on the Wasserstein distributionally robust mean-lower semi-absolute deviation (DR-MLSAD) model, where the ambiguity set is a Wasserstein ball centered on the empirical distribution of the training sample. This model can…

最优化与控制 · 数学 2024-03-04 Weimi Zhou , Yong-Jin Liu

We present the first minimax risk bounds for estimators of the spectral measure in multivariate linear factor models, where observations are linear combinations of regularly varying latent factors. Non-asymptotic convergence rates are…

统计理论 · 数学 2024-11-12 Xuhui Zhang , Jose Blanchet , Youssef Marzouk , Viet Anh Nguyen , Sven Wang

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

最优化与控制 · 数学 2026-05-28 Tam Le