中文
相关论文

相关论文: Universal generalization guarantees for Wasserstei…

200 篇论文

Deep neural networks often generalize well despite heavy over-parameterization, challenging classical parameter-based analyses. We study generalization from a representation-centric perspective and analyze how the geometry of learned…

机器学习 · 计算机科学 2026-02-02 Junjie Yu , Zhuoli Ouyang , Haotian Deng , Chen Wei , Wenxiao Ma , Jianyu Zhang , Zihan Deng , Quanying Liu

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

机器学习 · 计算机科学 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung

Learning algorithms for implicit generative models can optimize a variety of criteria that measure how the data distribution differs from the implicit model distribution, including the Wasserstein distance, the Energy distance, and the…

机器学习 · 统计学 2019-08-23 Leon Bottou , Martin Arjovsky , David Lopez-Paz , Maxime Oquab

We propose a scalable robust learning algorithm combining kernel smoothing and robust optimization. Our method is motivated by the convex analysis perspective of distributionally robust optimization based on probability metrics, such as the…

机器学习 · 计算机科学 2022-02-22 Jia-Jie Zhu , Christina Kouridi , Yassine Nemmour , Bernhard Schölkopf

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

机器学习 · 计算机科学 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros

We use distributionally-robust optimization for machine learning to mitigate the effect of data poisoning attacks. We provide performance guarantees for the trained model on the original data (not including the poison records) by training…

机器学习 · 计算机科学 2020-01-30 Farhad Farokhi

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

最优化与控制 · 数学 2022-10-14 Yibo Zeng , Henry Lam

Generalization error bounds are essential to understanding machine learning algorithms. This paper presents novel expected generalization error upper bounds based on the average joint distribution between the output hypothesis and each…

信息论 · 计算机科学 2022-02-25 Gholamali Aminian , Yuheng Bu , Gregory Wornell , Miguel Rodrigues

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

机器学习 · 统计学 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

This work discusses how to derive upper bounds for the expected generalisation error of supervised learning algorithms by means of the chaining technique. By developing a general theoretical framework, we establish a duality between…

机器学习 · 统计学 2022-07-01 Eugenio Clerico , Amitis Shidani , George Deligiannidis , Arnaud Doucet

Recently, learning a model that generalizes well on out-of-distribution (OOD) data has attracted great attention in the machine learning community. In this paper, after defining OOD generalization via Wasserstein distance, we theoretically…

机器学习 · 计算机科学 2021-05-25 Mingyang Yi , Lu Hou , Jiacheng Sun , Lifeng Shang , Xin Jiang , Qun Liu , Zhi-Ming Ma

We develop a general framework for statistical inference with the 1-Wasserstein distance. Recently, the Wasserstein distance has attracted considerable attention and has been widely applied to various machine learning tasks because of its…

统计理论 · 数学 2022-02-16 Masaaki Imaizumi , Hirofumi Ota , Takuo Hamaguchi

We consider machine learning, particularly regression, using locally-differentially private datasets. The Wasserstein distance is used to define an ambiguity set centered at the empirical distribution of the dataset corrupted by local…

机器学习 · 计算机科学 2020-06-25 Farhad Farokhi

Generative Adversarial Networks are a popular method for learning distributions from data by modeling the target distribution as a function of a known distribution. The function, often referred to as the generator, is optimized to minimize…

机器学习 · 计算机科学 2021-11-03 Daria Reshetova , Yikun Bai , Xiugang Wu , Ayfer Ozgur

Building on a recent framework for distributionally robust optimization, we consider estimation of the inverse covariance matrix for multivariate data. We provide a novel notion of a Wasserstein ambiguity set specifically tailored to this…

机器学习 · 统计学 2019-10-08 Pedro Cisneros-Velarde , Sang-Yun Oh , Alexander Petersen

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

统计理论 · 数学 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

Flexible Bayesian models are typically constructed using limits of large parametric models with a multitude of parameters that are often uninterpretable. In this article, we offer a novel alternative by constructing an exponentially tilted…

统计方法学 · 统计学 2023-03-20 Abhisek Chakraborty , Anirban Bhattacharya , Debdeep Pati

We develop a novel computationally efficient and general framework for robust hypothesis testing. The new framework features a new way to construct uncertainty sets under the null and the alternative distributions, which are sets centered…

机器学习 · 统计学 2018-05-29 Rui Gao , Liyan Xie , Yao Xie , Huan Xu

We introduce a distributionally robust maximum likelihood estimation model with a Wasserstein ambiguity set to infer the inverse covariance matrix of a $p$-dimensional Gaussian random vector from $n$ independent samples. The proposed model…

最优化与控制 · 数学 2018-05-21 Viet Anh Nguyen , Daniel Kuhn , Peyman Mohajerin Esfahani

We study a model for adversarial classification based on distributionally robust chance constraints. We show that under Wasserstein ambiguity, the model aims to minimize the conditional value-at-risk of the distance to misclassification,…

机器学习 · 计算机科学 2021-11-05 Nam Ho-Nguyen , Stephen J. Wright