中文
相关论文

相关论文: AGRO: Adversarial Discovery of Error-prone groups …

200 篇论文

The performance of machine learning (ML) models critically depends on the quality and representativeness of the training data. In applications with multiple heterogeneous data generating sources, standard ML methods often learn spurious…

Distribution shifts and minority subpopulations frequently undermine the reliability of deep neural networks trained using Empirical Risk Minimization (ERM). Distributionally Robust Optimization (DRO) addresses this by optimizing for the…

机器学习 · 计算机科学 2025-11-11 Aheer Sravon , Devdyuti Mazumder , Md. Ibrahim

Distributionally robust optimization (DRO) can improve the robustness and fairness of learning methods. In this paper, we devise stochastic algorithms for a class of DRO problems including group DRO, subpopulation fairness, and empirical…

机器学习 · 计算机科学 2025-02-03 Tasuku Soma , Khashayar Gatmiry , Sharut Gupta , Stefanie Jegelka

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

最优化与控制 · 数学 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

机器学习 · 统计学 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must involve distributions…

机器学习 · 计算机科学 2025-10-28 Jiaqi Wen , Jianyi Yang

It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability…

最优化与控制 · 数学 2022-05-09 Yueyao Li , Wenxun Xing

In multi-source learning with discrete labels, distributional heterogeneity across domains poses a central challenge to developing predictive models that transfer reliably to unseen domains. We study multi-source unsupervised domain…

统计方法学 · 统计学 2026-01-26 Zijian Guo , Zhenyu Wang , Yifan Hu , Francis Bach

Real-world deployments routinely face distribution shifts, group imbalances, and adversarial perturbations, under which the traditional Empirical Risk Minimization (ERM) framework can degrade severely. Distributionally Robust Optimization…

机器学习 · 计算机科学 2026-02-19 Difei Xu , Meng Ding , Zebin Ma , Huanyi Xie , Youming Tao , Aicha Slaitane , Di Wang

Training machine learning models robust to distribution shifts is critical for real-world applications. Some robust training algorithms (e.g., Group DRO) specialize to group shifts and require group information on all training points. Other…

Recent deep models for solving routing problems always assume a single distribution of nodes for training, which severely impairs their cross-distribution generalization ability. In this paper, we exploit group distributionally robust…

机器学习 · 计算机科学 2022-02-16 Yuan Jiang , Yaoxin Wu , Zhiguang Cao , Jie Zhang

We present a novel framework for distributionally robust optimization (DRO), called cost-aware DRO (CADRO). The key idea of CADRO is to exploit the cost structure in the design of the ambiguity set to reduce conservatism. Particularly, the…

最优化与控制 · 数学 2023-05-17 Mathijs Schuurmans , Panagiotis Patrinos

Distributionally robust optimisation (DRO) minimises the worst-case expected loss over an ambiguity set that can capture distributional shifts in out-of-sample environments. While Huber (linear-vacuous) contamination is a classical…

机器学习 · 统计学 2026-01-30 Mengqi Chen , Thomas B. Berrett , Theodoros Damoulas , Michele Caprio

Limiting failures of machine learning systems is of paramount importance for safety-critical applications. In order to improve the robustness of machine learning systems, Distributionally Robust Optimization (DRO) has been proposed as a…

Spurious correlations in training data often lead to robustness issues since models learn to use them as shortcuts. For example, when predicting whether an object is a cow, a model might learn to rely on its green background, so it would do…

计算机视觉与模式识别 · 计算机科学 2022-12-14 Raghav Mehta , Vítor Albiero , Li Chen , Ivan Evtimov , Tamar Glaser , Zhiheng Li , Tal Hassner

A common goal in statistics and machine learning is to learn models that can perform well against distributional shifts, such as latent heterogeneous subpopulations, unknown covariate shifts, or unmodeled temporal effects. We develop and…

机器学习 · 统计学 2020-07-21 John Duchi , Hongseok Namkoong

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

最优化与控制 · 数学 2025-07-31 Yang Jiao , Kai Yang , Dongjin Song

Knowledge distillation enables fast and effective transfer of features learned from a bigger model to a smaller one. However, distillation objectives are susceptible to sub-population shifts, a common scenario in medical imaging analysis…

计算机视觉与模式识别 · 计算机科学 2023-11-02 Konstantinos Vilouras , Xiao Liu , Pedro Sanchez , Alison Q. O'Neil , Sotirios A. Tsaftaris

We develop and analyze algorithms for distributionally robust optimization (DRO) of convex losses. In particular, we consider group-structured and bounded $f$-divergence uncertainty sets. Our approach relies on an accelerated method that…

最优化与控制 · 数学 2022-03-25 Yair Carmon , Danielle Hausler

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

机器学习 · 计算机科学 2022-12-20 Yang Jiao , Kai Yang , Dongjin Song