English
Related papers

Related papers: Exact Generalization Guarantees for (Regularized) …

200 papers

Conformal prediction yields a prediction set with guaranteed $1-\alpha$ coverage of the true target under the i.i.d. assumption, which may not hold and lead to a gap between $1-\alpha$ and the actual coverage. Prior studies bound the gap…

Machine Learning · Computer Science 2025-03-07 Rui Xu , Chao Chen , Yue Sun , Parvathinathan Venkitasubramaniam , Sihong Xie

Wasserstein distributionally robust optimization (DRO) has recently achieved empirical success for various applications in operations research and machine learning, owing partly to its regularization effect. Although connection between…

Machine Learning · Computer Science 2020-11-02 Rui Gao , Xi Chen , Anton J. Kleywegt

Using i.i.d. data to estimate a high-dimensional distribution in Wasserstein distance is a fundamental instance of the curse of dimensionality. We explore how structural knowledge about the data-generating process which gives rise to the…

Statistics Theory · Mathematics 2026-05-22 Daniel Bartl , Stephan Eckstein

Deep neural networks often generalize well despite heavy over-parameterization, challenging classical parameter-based analyses. We study generalization from a representation-centric perspective and analyze how the geometry of learned…

Machine Learning · Computer Science 2026-02-02 Junjie Yu , Zhuoli Ouyang , Haotian Deng , Chen Wei , Wenxiao Ma , Jianyu Zhang , Zihan Deng , Quanying Liu

As opposed to standard empirical risk minimization (ERM), distributionally robust optimization aims to minimize the worst-case risk over a larger ambiguity set containing the original empirical distribution of the training data. In this…

Machine Learning · Computer Science 2021-01-06 Jaeho Lee , Maxim Raginsky

Despite of its importance for safe machine learning, uncertainty quantification for neural networks is far from being solved. State-of-the-art approaches to estimate neural uncertainties are often hybrid, combining parametric models with…

Machine Learning · Computer Science 2021-12-03 Joachim Sicking , Maram Akila , Maximilian Pintz , Tim Wirtz , Asja Fischer , Stefan Wrobel

Performativity means that the deployment of a predictive model incentivizes agents to strategically adapt their behavior, thereby inducing a model-dependent distribution shift. Practitioners often repeatedly retrain the model on data…

Optimization and Control · Mathematics 2026-02-09 Siyi Wang , Zifan Wang , Karl H. Johansson

We propose a distributionally robust classification model with a fairness constraint that encourages the classifier to be fair in view of the equality of opportunity criterion. We use a type-$\infty$ Wasserstein ambiguity set centered at…

Machine Learning · Computer Science 2021-07-13 Yijie Wang , Viet Anh Nguyen , Grani A. Hanasusanto

Robust optimization is a tractable and expressive technique for decision-making under uncertainty, but it can lead to overly conservative decisions when pessimistic assumptions are made on the uncertain parameters. Wasserstein…

Optimization and Control · Mathematics 2026-04-07 Irina Wang , Cole Becker , Bart Van Parys , Bartolomeo Stellato

We study distributionally robust quantile regression using type-$p$ Wasserstein ambiguity sets. We derive a closed-form expression for the worst-case quantile regression loss under general $p$-Wasserstein uncertainty. We further give a…

Statistics Theory · Mathematics 2026-03-17 Chunxu Zhang , Tiantian Mao , Ruodu Wang

Despite superior performance in many situations, deep neural networks are often vulnerable to adversarial examples and distribution shifts, limiting model generalization ability in real-world applications. To alleviate these problems,…

Machine Learning · Computer Science 2023-02-14 Hoang Phan , Trung Le , Trung Phung , Tuan Anh Bui , Nhat Ho , Dinh Phung

We revisit Markowitz's mean-variance portfolio selection model by considering a distributionally robust version, where the region of distributional uncertainty is around the empirical measure and the discrepancy between probability measures…

Methodology · Statistics 2018-02-15 Jose Blanchet , Lin Chen , Xun Yu Zhou

We study stochastic optimization problems with chance and risk constraints, where in the latter, risk is quantified in terms of the conditional value-at-risk (CVaR). We consider the distributionally robust versions of these problems, where…

Optimization and Control · Mathematics 2020-12-17 Ashish Cherukuri , Ashish R. Hota

The robustness of risk measures to changes in underlying loss distributions (distributional uncertainty) is of crucial importance in making well-informed decisions. In this paper, we quantify, for the class of distortion risk measures with…

Risk Management · Quantitative Finance 2023-03-14 Carole Bernard , Silvana M. Pesenti , Steven Vanduffel

This paper expands the notion of robust profit opportunities in financial markets to incorporate distributional uncertainty using Wasserstein distance as the ambiguity measure. Financial markets with risky and risk-free assets are…

Portfolio Management · Quantitative Finance 2020-06-23 Derek Singh , Shuzhong Zhang

We consider distributionally robust optimization problems where the uncertainty is modeled via a structured Wasserstein ambiguity set. Specifically, the ambiguity is restricted to product measures $P^{\otimes N}$, where $P$ lies within a…

Optimization and Control · Mathematics 2026-04-14 Andrey Kharitenko , Marta Fochesato , Anastasios Tsiamis , Niklas Schmid , John Lygeros

We address the challenge of sequential data-driven decision-making under context distributional uncertainty. This problem arises in numerous real-world scenarios where the learner optimizes black-box objective functions in the presence of…

Machine Learning · Computer Science 2025-03-27 Francesco Micheli , Efe C. Balta , Anastasios Tsiamis , John Lygeros

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

Machine Learning · Statistics 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

Score-based generative models (SGMs) is a recent class of deep generative models with state-of-the-art performance in many applications. In this paper, we establish convergence guarantees for a general class of SGMs in 2-Wasserstein…

Machine Learning · Computer Science 2025-02-18 Xuefeng Gao , Hoang M. Nguyen , Lingjiong Zhu

This paper considers the problem of regression over distributions, which is becoming increasingly important in machine learning. Existing approaches often ignore the geometry of the probability space or are computationally expensive. To…

Machine Learning · Computer Science 2025-10-31 Maksim Maslov , Alexander Kugaevskikh , Matthew Ivanov