English
Related papers

Related papers: Distributionally Robust Optimization and Generaliz…

200 papers

Wasserstein distributionally robust optimization (DRO) aims to find robust and generalizable solutions by hedging against data perturbations in Wasserstein distance. Despite its recent empirical success in operations research and machine…

Machine Learning · Computer Science 2022-05-03 Rui Gao

In this paper, we consider learning scenarios where the learned model is evaluated under an unknown test distribution which potentially differs from the training distribution (i.e. distribution shift). The learner has access to a family of…

Machine Learning · Computer Science 2022-02-14 Alekh Agarwal , Tong Zhang

Distributionally robust optimization (DRO) has been introduced for solving stochastic programs where the distribution of the random parameters is unknown and must be estimated by samples from that distribution. A key element of DRO is the…

Optimization and Control · Mathematics 2019-01-09 Xi Chen , Qihang Lin , Guanglin Xu

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

Machine Learning · Statistics 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

It is essential to capture the true probability distribution of uncertain data in the distributionally robust optimization (DRO). The uncertain data presents multimodality in numerous application scenarios, in the sense that the probability…

Optimization and Control · Mathematics 2024-03-14 Yueyao Li , Chenglong Bao , Wenxun Xing

Limiting failures of machine learning systems is of paramount importance for safety-critical applications. In order to improve the robustness of machine learning systems, Distributionally Robust Optimization (DRO) has been proposed as a…

As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability…

Optimization and Control · Mathematics 2022-05-09 Yueyao Li , Wenxun Xing

Distributionally robust optimization (DRO) is a widely used framework for optimizing objective functionals in the presence of both randomness and model-form uncertainty. A key step in the practical solution of many DRO problems is a…

Optimization and Control · Mathematics 2021-04-22 Jeremiah Birrell

Robustness to distributional shift is one of the key challenges of contemporary machine learning. Attaining such robustness is the goal of distributionally robust optimization, which seeks a solution to an optimization problem that is…

Machine Learning · Statistics 2020-03-24 Johannes Kirschner , Ilija Bogunovic , Stefanie Jegelka , Andreas Krause

In data-driven optimization, sample average approximation (SAA) is known to suffer from the so-called optimizer's curse that causes an over-optimistic evaluation of the solution performance. We argue that a special type of distributionallly…

Optimization and Control · Mathematics 2023-10-13 Zhenyuan Liu , Bart P. G. Van Parys , Henry Lam

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in…

Optimization and Control · Mathematics 2022-05-26 Rohit Kannan , Güzin Bayraksan , James R. Luedtke

This manuscript introduces the idea of using Distributionally Robust Optimization (DRO) for the Counterfactual Risk Minimization (CRM) problem. Tapping into a rich existing literature, we show that DRO is a principled tool for…

Machine Learning · Statistics 2019-12-17 Louis Faury , Ugo Tanielian , Flavian Vasile , Elena Smirnova , Elvis Dohmatob

Distributionally robust optimization (DRO) has emerged as a powerful paradigm for reliable decision-making under uncertainty. This paper focuses on DRO with ambiguity sets defined via the Sinkhorn discrepancy: an entropy-regularized…

Machine Learning · Statistics 2025-12-16 Jie Wang

We study distributionally robust optimization (DRO) problems where the ambiguity set is defined using the Wasserstein metric. We show that this class of DRO problems can be reformulated as semi-infinite programs. We give an exchange method…

Optimization and Control · Mathematics 2017-04-14 Fengqiao Luo , Sanjay Mehrotra

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

Machine Learning · Computer Science 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai

There is emerging interest in performing regression between distributions. In contrast to prediction on single instances, these machine learning methods can be useful for population-based studies or on problems that are inherently…

Machine Learning · Computer Science 2019-06-03 Connie Kou , Hwee Kuan Lee , Jorge Sanz , Teck Khim Ng

Wasserstein distributionally robust optimization (WDRO) optimizes against worst-case distributional shifts within a specified uncertainty set, leading to enhanced generalization on unseen adversarial examples, compared to standard…

Machine Learning · Computer Science 2025-03-07 Shuang Liu , Yihan Wang , Yifan Zhu , Yibo Miao , Xiao-Shan Gao

We consider the distributionally robust optimization (DRO) problem with spectral risk-based uncertainty set and $f$-divergence penalty. This formulation includes common risk-sensitive learning objectives such as regularized condition…

Machine Learning · Statistics 2023-10-24 Ronak Mehta , Vincent Roulet , Krishna Pillutla , Zaid Harchaoui

Wasserstein distributionally robust optimization (WDRO) attempts to learn a model that minimizes the local worst-case risk in the vicinity of the empirical data distribution defined by Wasserstein ball. While WDRO has received attention as…

Machine Learning · Statistics 2020-06-23 Yongchan Kwon , Wonyoung Kim , Joong-Ho Won , Myunghee Cho Paik