中文
相关论文

相关论文: AGRO: Adversarial Discovery of Error-prone groups …

200 篇论文

When training and evaluating machine learning models on a large number of tasks, it is important to not only look at average task accuracy -- which may be biased by easy or redundant tasks -- but also worst-case accuracy (i.e. the…

机器学习 · 计算机科学 2021-10-13 Paul Michel , Sebastian Ruder , Dani Yogatama

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the…

机器学习 · 统计学 2021-05-12 Jose Blanchet , Yang Kang , Fan Zhang , Fei He , Zhangyi Hu

Gaussian process regression (GPR) or kernel ridge regression is a widely used and powerful tool for nonlinear prediction. Therefore, active learning (AL) for GPR, which actively collects data labels to achieve an accurate prediction with…

Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and…

机器学习 · 计算机科学 2019-05-28 Matthew Staib , Stefanie Jegelka

Robust generalization aims to tackle the most challenging data distributions which are rare in the training set and contain severe noises, i.e., photon-limited corruptions. Common solutions such as distributionally robust optimization (DRO)…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Zhuo Huang , Miaoxi Zhu , Xiaobo Xia , Li Shen , Jun Yu , Chen Gong , Bo Han , Bo Du , Tongliang Liu

The paradigm of worst-group loss minimization has shown its promise in avoiding to learn spurious correlations, but requires costly additional supervision on spurious attributes. To resolve this, recent works focus on developing weaker…

机器学习 · 计算机科学 2022-04-06 Junhyun Nam , Jaehyung Kim , Jaeho Lee , Jinwoo Shin

Decision making under uncertainty is challenging since the data-generating process (DGP) is often unknown. Bayesian inference proceeds by estimating the DGP through posterior beliefs about the model's parameters. However, minimising the…

机器学习 · 统计学 2024-09-06 Charita Dellaporta , Patrick O'Hara , Theodoros Damoulas

Distributionally robust optimization (DRO) is an effective approach for data-driven decision-making in the presence of uncertainty. Geometric uncertainty due to sampling or localized perturbations of data points is captured by Wasserstein…

机器学习 · 统计学 2023-11-10 Sloan Nietert , Ziv Goldfeld , Soroosh Shafiee

Machine learning algorithms minimizing average risk are susceptible to distributional shifts. Distributionally Robust Optimization (DRO) addresses this issue by optimizing the worst-case risk within an uncertainty set. However, DRO suffers…

机器学习 · 计算机科学 2023-11-10 Jiashuo Liu , Jiayun Wu , Tianyu Wang , Hao Zou , Bo Li , Peng Cui

Distributionally robust optimization (DRO) has emerged as a powerful paradigm for reliable decision-making under uncertainty. This paper focuses on DRO with ambiguity sets defined via the Sinkhorn discrepancy: an entropy-regularized…

机器学习 · 统计学 2025-12-16 Jie Wang

Machine learning models are known to learn spurious correlations, i.e., features having strong relations with class labels but no causal relation. Relying on those correlations leads to poor performance in the data groups without these…

机器学习 · 计算机科学 2026-04-28 Phuong Quynh Le , Jörg Schlötterer , Christin Seifert

In problems that involve input parameter information gathered from multiple data sources with varying reliability, incorporating decision makers' trust on different sources in optimization models can potentially improve solution…

最优化与控制 · 数学 2026-02-27 Yanru Guo , Ruiwei Jiang , Siqian Shen

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

机器学习 · 统计学 2024-12-31 Linglingzhi Zhu , Yao Xie

We consider the distributionally robust optimization (DRO) problem with spectral risk-based uncertainty set and $f$-divergence penalty. This formulation includes common risk-sensitive learning objectives such as regularized condition…

机器学习 · 统计学 2023-10-24 Ronak Mehta , Vincent Roulet , Krishna Pillutla , Zaid Harchaoui

We consider optimal decision-making problems in an uncertain environment. In particular, we consider the case in which the distribution of the input is unknown, yet there is abundant historical data drawn from the distribution. In this…

最优化与控制 · 数学 2014-10-03 Zizhuo Wang , Peter Glynn , Yinyu Ye

Complex computer simulators are increasingly used across fields of science as generative models tying parameters of an underlying theory to experimental observations. Inference in this setup is often difficult, as simulators rarely admit a…

机器学习 · 统计学 2020-04-17 Gilles Louppe , Joeri Hermans , Kyle Cranmer

This paper studies distributionally robust regret-optimal (DRRO) control with purified output feedback for linear systems subject to additive disturbances and measurement noise. These uncertainties (including the initial system state) are…

最优化与控制 · 数学 2025-11-21 Shuhao Yan , Carsten W. Scherer

In standard adversarial training, models are optimized to fit one-hot labels within allowable adversarial perturbation budgets. However, the ignorance of underlying distribution shifts brought by perturbations causes the problem of robust…

机器学习 · 计算机科学 2024-04-16 Yu-Yu Wu , Hung-Jui Wang , Shang-Tse Chen

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

最优化与控制 · 数学 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

Classifiers trained with Empirical Risk Minimization (ERM) tend to rely on attributes that have high spurious correlation with the target. This can degrade the performance on underrepresented (or 'minority') groups that lack these…