中文
相关论文

相关论文: Distributionally Robust Optimization with Probabil…

200 篇论文

We study a robust alternative to empirical risk minimization called distributionally robust learning (DRL), in which one learns to perform against an adversary who can choose the data distribution from a specified set of distributions. We…

机器学习 · 计算机科学 2019-12-19 Charlie Frogner , Sebastian Claici , Edward Chien , Justin Solomon

Robust and distributionally robust optimization are modeling paradigms for decision-making under uncertainty where the uncertain parameters are only known to reside in an uncertainty set or are governed by any probability distribution from…

最优化与控制 · 数学 2023-07-21 Jianzhe Zhen , Daniel Kuhn , Wolfram Wiesemann

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

最优化与控制 · 数学 2022-10-14 Yibo Zeng , Henry Lam

We develop and analyze algorithms for distributionally robust optimization (DRO) of convex losses. In particular, we consider group-structured and bounded $f$-divergence uncertainty sets. Our approach relies on an accelerated method that…

最优化与控制 · 数学 2022-03-25 Yair Carmon , Danielle Hausler

We consider a residuals-based distributionally robust optimization (DRO) model, where the underlying uncertainty depends on both covariate information and our decisions. We adopt both parametric and nonparametric regression models to learn…

最优化与控制 · 数学 2026-05-21 Qing Zhu , Xian Yu , Guzin Bayraksan

Machine learning algorithms with empirical risk minimization are vulnerable under distributional shifts due to the greedy adoption of all the correlations found in training data. There is an emerging literature on tackling this problem by…

机器学习 · 计算机科学 2022-11-22 Jiashuo Liu , Zheyan Shen , Peng Cui , Linjun Zhou , Kun Kuang , Bo Li

We introduce a new framework, Bayesian Distributionally Robust Optimization (Bayesian-DRO), for data-driven stochastic optimization where the underlying distribution is unknown. Bayesian-DRO contrasts with most of the existing DRO…

最优化与控制 · 数学 2023-02-10 Alexander Shapiro , Enlu Zhou , Yifan Lin

A machine learning model that generalizes well should obtain low errors on unseen test examples. Thus, if we learn an optimal model in training data, it could have better generalization performance in testing tasks. However, learning such a…

计算机视觉与模式识别 · 计算机科学 2023-02-22 Penghao Jiang , Xin Ke , ZiFeng Wang , Chunxi Li

Deep neural classifiers tend to rely on spurious correlations between spurious attributes of inputs and targets to make predictions, which could jeopardize their generalization capability. Training classifiers robust to spurious…

机器学习 · 计算机科学 2024-05-07 Guangtao Zheng , Wenqian Ye , Aidong Zhang

The distributionally robust optimization (DRO)-based graph neural network methods improve recommendation systems' out-of-distribution (OOD) generalization by optimizing the model's worst-case performance. However, these studies fail to…

机器学习 · 计算机科学 2025-01-28 Chu Zhao , Enneng Yang , Yuliang Liang , Jianzhe Zhao , Guibing Guo , Xingwei Wang

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

机器学习 · 统计学 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Training machine learning and statistical models often involves optimizing a data-driven risk criterion. The risk is usually computed with respect to the empirical data distribution, but this may result in poor and unstable out-of-sample…

机器学习 · 统计学 2024-11-11 Nicola Bariletto , Nhat Ho

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

最优化与控制 · 数学 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

This paper provides a non-robust interpretation of the distributionally robust optimization (DRO) problem by relating the distributional uncertainties to the chance probabilities. Our analysis allows a decision-maker to interpret the size…

最优化与控制 · 数学 2020-09-22 Qi Wu , Shumin Ma , Cheuk Hang Leung , Wei Liu , Nanbo Peng

Despite the high performance achieved by deep neural networks on various tasks, extensive studies have demonstrated that small tweaks in the input could fail the model predictions. This issue of deep neural networks has led to a number of…

机器学习 · 计算机科学 2022-02-22 Ming-Chang Chiu , Xuezhe Ma

This paper studies Markov Decision Processes under parameter uncertainty. We adapt the distributionally robust optimization framework, and assume that the uncertain parameters are random variables following an unknown distribution, and…

系统与控制 · 计算机科学 2015-05-14 Pengqian Yu , Huan Xu

Standard Set Representation Learning methods typically excel on curated data but often overlook the challenge of inference-time element corruption. This refers to scenarios where deployed models encounter element-level degradations, such as…

机器学习 · 计算机科学 2026-05-29 Yankai Chen , Hanrong Zhang , Bowei He , Philip S. Yu , Xue , Liu

Trustworthy machine learning aims at combating distributional uncertainties in training data distributions compared to population distributions. Typical treatment frameworks include the Bayesian approach, (min-max) distributionally robust…

机器学习 · 计算机科学 2025-05-05 Shixiong Wang , Haowei Wang , Xinke Li , Jean Honorio

We propose a novel method for semi-supervised learning (SSL) based on data-driven distributionally robust optimization (DRO) using optimal transport metrics. Our proposed method enhances generalization error by using the unlabeled data to…

机器学习 · 统计学 2020-04-21 Jose Blanchet , Yang Kang

We consider the penalized distributionally robust optimization (DRO) problem with a closed, convex uncertainty set, a setting that encompasses learning using $f$-DRO and spectral/$L$-risk minimization. We present Drago, a stochastic…

机器学习 · 统计学 2025-02-12 Ronak Mehta , Jelena Diakonikolas , Zaid Harchaoui