中文
相关论文

相关论文: Exact Generalization Guarantees for (Regularized) …

200 篇论文

We study a class of distributionally robust games where agents are allowed to heterogeneously choose their risk aversion with respect to distributional shifts of the uncertainty. In our formulation, heterogeneous Wasserstein ball…

最优化与控制 · 数学 2025-12-08 Zifan Wang , Georgios Pantazis , Sergio Grammatico , Michael M. Zavlanos , Karl H. Johansson

Sliced Wasserstein distances preserve properties of classic Wasserstein distances while being more scalable for computation and estimation in high dimensions. The goal of this work is to quantify this scalability from three key aspects: (i)…

机器学习 · 统计学 2022-10-18 Sloan Nietert , Ritwik Sadhu , Ziv Goldfeld , Kengo Kato

Generative modeling aims to produce new random examples from an unknown target distribution, given access to a finite collection of examples. Among the leading approaches, denoising diffusion probabilistic models (DDPMs) construct such…

机器学习 · 统计学 2025-06-12 Vahan Arsenyan , Elen Vardanyan , Arnak Dalalyan

Generative Adversarial Networks are a popular method for learning distributions from data by modeling the target distribution as a function of a known distribution. The function, often referred to as the generator, is optimized to minimize…

机器学习 · 计算机科学 2021-11-03 Daria Reshetova , Yikun Bai , Xiugang Wu , Ayfer Ozgur

We study the problem of assessing the robustness of counterfactual explanations for deep learning models. We focus on $\textit{plausible model shifts}$ altering model parameters and propose a novel framework to reason about the robustness…

机器学习 · 计算机科学 2024-07-11 Luca Marzari , Francesco Leofante , Ferdinando Cicalese , Alessandro Farinelli

Logistic regression models are widely used in the social and behavioral sciences and in high-stakes domains, due to their simplicity and interpretability properties. At the same time, such domains are permeated by distribution shifts, where…

机器学习 · 计算机科学 2025-03-18 Qingshi Sun , Nathan Justin , Andres Gomez , Phebe Vayanos

We show that several machine learning estimators, including square-root LASSO (Least Absolute Shrinkage and Selection) and regularized logistic regression can be represented as solutions to distributionally robust optimization (DRO)…

统计理论 · 数学 2020-10-22 Jose Blanchet , Yang Kang , Karthyek Murthy

We consider sensitivity of a generic stochastic optimization problem to model uncertainty. We take a non-parametric approach and capture model uncertainty using Wasserstein balls around the postulated model. We provide explicit formulae for…

最优化与控制 · 数学 2022-01-19 Daniel Bartl , Samuel Drapeau , Jan Obloj , Johannes Wiesel

The Wasserstein distance has emerged as a key metric to quantify distances between probability distributions, with applications in various fields, including machine learning, control theory, decision theory, and biological systems.…

机器学习 · 计算机科学 2026-02-10 Eduardo Figueiredo , Steven Adams , Luca Laurenti

This paper studies distributional model risk in marginal problems, where each marginal measure is assumed to lie in a Wasserstein ball centered at a fixed reference measure with a given radius. Theoretically, we establish several…

最优化与控制 · 数学 2023-07-04 Yanqin Fan , Hyeonseok Park , Gaoqian Xu

Generative Adversarial Networks (GANs) have achieved a great success in unsupervised learning. Despite its remarkable empirical performance, there are limited theoretical studies on the statistical properties of GANs. This paper provides…

机器学习 · 计算机科学 2022-07-22 Minshuo Chen , Wenjing Liao , Hongyuan Zha , Tuo Zhao

We propose a distributionally robust approach to risk-sensitive estimation of an unknown signal x from an observed signal y. The unknown signal and observation are modeled as random vectors whose joint probability distribution is unknown,…

机器学习 · 计算机科学 2026-04-21 Feras Al Taha , Eilyan Bitar

Distributional ambiguity sets provide quantifiable ways to characterize the uncertainty about the true probability distribution of random variables of interest. This makes them a key element in data-driven robust optimization by exploiting…

最优化与控制 · 数学 2019-09-26 Dimitris Boskos , Jorge Cortés , Sonia Martínez

Despite the growing prevalence of artificial neural networks in real-world applications, their vulnerability to adversarial attacks remains a significant concern, which motivates us to investigate the robustness of machine learning models.…

机器学习 · 计算机科学 2024-08-23 Jie Wang , Rui Gao , Yao Xie

Probabilistic time series forecasting has played critical role in decision-making processes due to its capability to quantify uncertainties. Deep forecasting models, however, could be prone to input perturbations, and the notion of such…

机器学习 · 计算机科学 2022-02-25 TaeHo Yoon , Youngsuk Park , Ernest K. Ryu , Yuyang Wang

Problem definition: A key challenge in supervised learning is data scarcity, which can cause prediction models to overfit to the training data and perform poorly out of sample. A contemporary approach to combat overfitting is offered by…

最优化与控制 · 数学 2025-10-10 Reza Belbasi , Aras Selvi , Wolfram Wiesemann

Distribution data refers to a data set where each sample is represented as a probability distribution, a subject area receiving burgeoning interest in the field of statistics. Although several studies have developed…

统计方法学 · 统计学 2024-02-09 Ryo Okano , Masaaki Imaizumi

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

最优化与控制 · 数学 2022-10-14 Yibo Zeng , Henry Lam

In many real-world applications, ensuring the robustness and stability of deep neural networks (DNNs) is crucial, particularly for image classification tasks that encounter various input perturbations. While data augmentation techniques…

机器学习 · 统计学 2025-06-26 Jiaming Hu , Debarghya Mukherjee , Ioannis Ch. Paschalidis

We provide upper bounds of the expected Wasserstein distance between a probability measure and its empirical version, generalizing recent results for finite dimensional Euclidean spaces and bounded functional spaces. Such a generalization…

统计理论 · 数学 2020-01-29 Jing Lei