中文
相关论文

相关论文: Distributional Robustness with IPMs and links to R…

200 篇论文

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

机器学习 · 统计学 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Ch. Paschalidis

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

机器学习 · 统计学 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Paschalidis

We study finite-sample statistical performance guarantees for distributionally robust optimization (DRO) with optimal transport (OT) and OT-regularized divergence model neighborhoods. Specifically, we derive concentration inequalities for…

机器学习 · 统计学 2026-03-31 Jeremiah Birrell , Xiaoxi Shen

The aim of this paper is to address the challenge of gradual domain adaptation within a class of manifold-constrained data distributions. In particular, we consider a sequence of $T\ge2$ data distributions $P_1,\ldots,P_T$ undergoing a…

Adversarially robust optimization (ARO) has emerged as the *de facto* standard for training models that hedge against adversarial attacks in the test stage. While these models are robust against adversarial attacks, they tend to suffer…

最优化与控制 · 数学 2025-06-12 Aras Selvi , Eleonora Kreacic , Mohsen Ghassemi , Vamsi Potluru , Tucker Balch , Manuela Veloso

Overparameterized neural networks can be highly accurate on average on an i.i.d. test set yet consistently fail on atypical groups of the data (e.g., by learning spurious correlations that hold on average but not in such groups).…

机器学习 · 计算机科学 2020-04-03 Shiori Sagawa , Pang Wei Koh , Tatsunori B. Hashimoto , Percy Liang

The effects of treatments are often heterogeneous, depending on the observable characteristics, and it is necessary to exploit such heterogeneity to devise individualized treatment rules (ITRs). Existing estimation methods of such ITRs…

计量经济学 · 经济学 2022-08-09 Daido Kido

Distributionally robust optimization (DRO) has emerged as a powerful paradigm for reliable decision-making under uncertainty. This paper focuses on DRO with ambiguity sets defined via the Sinkhorn discrepancy: an entropy-regularized…

机器学习 · 统计学 2025-12-16 Jie Wang

We show that several machine learning estimators, including square-root LASSO (Least Absolute Shrinkage and Selection) and regularized logistic regression can be represented as solutions to distributionally robust optimization (DRO)…

统计理论 · 数学 2020-10-22 Jose Blanchet , Yang Kang , Karthyek Murthy

As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework…

系统与控制 · 电气工程与系统科学 2025-09-09 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

机器学习 · 统计学 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Distributionally robust stochastic optimization (DRSO) is an approach to optimization under uncertainty in which, instead of assuming that there is a known true underlying probability distribution, one hedges against a chosen set of…

最优化与控制 · 数学 2022-05-03 Rui Gao , Anton J. Kleywegt

Distributionally robust optimization (DRO) provides a framework for training machine learning models that are able to perform well on a collection of related data distributions (the "uncertainty set"). This is done by solving a min-max…

机器学习 · 计算机科学 2021-04-01 Paul Michel , Tatsunori Hashimoto , Graham Neubig

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

机器学习 · 统计学 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

统计理论 · 数学 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

Distributionally Robust Optimization (DRO) is a popular framework for decision-making under uncertainty, but its adversarial nature can lead to overly conservative solutions. To address this, we study ex-ante Distributionally Robust Regret…

最优化与控制 · 数学 2025-04-22 Lukas-Benedikt Fiechtner , Jose Blanchet

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

机器学习 · 统计学 2024-12-31 Linglingzhi Zhu , Yao Xie

While Generative Adversarial Networks (GANs) have empirically produced impressive results on learning complex real-world distributions, recent works have shown that they suffer from lack of diversity or mode collapse. The theoretical work…

机器学习 · 计算机科学 2019-07-02 Yu Bai , Tengyu Ma , Andrej Risteski

Distributionally robust optimization (DRO) studies decision problems under uncertainty where the probability distribution governing the uncertain problem parameters is itself uncertain. A key component of any DRO model is its ambiguity set,…

最优化与控制 · 数学 2025-05-28 Daniel Kuhn , Soroosh Shafiee , Wolfram Wiesemann