中文
相关论文

相关论文: Stochastic Constrained DRO with a Complexity Indep…

200 篇论文

Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing…

机器学习 · 统计学 2024-04-02 Qi Zhang , Yi Zhou , Ashley Prater-Bennette , Lixin Shen , Shaofeng Zou

Distributionally robust optimization (DRO) is a powerful technique to train robust models against data distribution shift. This paper aims to solve regularized nonconvex DRO problems, where the uncertainty set is modeled by a so-called…

最优化与控制 · 数学 2025-06-30 Yufeng Yang , Yi Zhou , Zhaosong Lu

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

机器学习 · 计算机科学 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang

In this paper, we consider a distributionally robust optimization (DRO) model in which the ambiguity set is defined as the set of distributions whose Kullback-Leibler (KL) divergence to an empirical distribution is bounded. Utilizing the…

最优化与控制 · 数学 2024-11-12 Burak Kocuk

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

机器学习 · 计算机科学 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

A common goal in statistics and machine learning is to learn models that can perform well against distributional shifts, such as latent heterogeneous subpopulations, unknown covariate shifts, or unmodeled temporal effects. We develop and…

机器学习 · 统计学 2020-07-21 John Duchi , Hongseok Namkoong

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

We develop and analyze algorithms for distributionally robust optimization (DRO) of convex losses. In particular, we consider group-structured and bounded $f$-divergence uncertainty sets. Our approach relies on an accelerated method that…

最优化与控制 · 数学 2022-03-25 Yair Carmon , Danielle Hausler

Distributionally robust optimization (DRO) can improve the robustness and fairness of learning methods. In this paper, we devise stochastic algorithms for a class of DRO problems including group DRO, subpopulation fairness, and empirical…

机器学习 · 计算机科学 2025-02-03 Tasuku Soma , Khashayar Gatmiry , Sharut Gupta , Stefanie Jegelka

We consider optimal transport based distributionally robust optimization (DRO) problems with locally strongly convex transport cost functions and affine decision rules. Under conventional convexity assumptions on the underlying loss…

最优化与控制 · 数学 2021-04-27 Jose Blanchet , Karthyek Murthy , Fan Zhang

In this paper we develop a Stochastic Gradient Langevin Dynamics (SGLD) algorithm tailored for solving a certain class of non-convex distributionally robust optimisation (DRO) problems. By deriving non-asymptotic convergence bounds, we…

最优化与控制 · 数学 2026-05-08 Ariel Neufeld , Matthew Ng Cheng En , Ying Zhang

Distributionally robust optimization (DRO) problems are increasingly seen as a viable method to train machine learning models for improved model generalization. These min-max formulations, however, are more difficult to solve. We therefore…

机器学习 · 统计学 2020-11-03 Soumyadip Ghosh , Mark Squillante , Ebisa Wollega

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must involve distributions…

机器学习 · 计算机科学 2025-10-28 Jiaqi Wen , Jianyi Yang

To train machine learning models that are robust to distribution shifts in the data, distributionally robust optimization (DRO) has been proven very effective. However, the existing approaches to learning a distributionally robust model…

机器学习 · 计算机科学 2022-03-21 Farzin Haddadpour , Mohammad Mahdi Kamani , Mehrdad Mahdavi , Amin Karbasi

Recently, there has been a growing interest in distributionally robust optimization (DRO) as a principled approach to data-driven decision making. In this paper, we consider a distributionally robust two-stage stochastic optimization…

最优化与控制 · 数学 2020-12-07 Zhe Zhang , Shabbir Ahmed , Guanghui Lan

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

最优化与控制 · 数学 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

The study of robustness has received much attention due to its inevitability in data-driven settings where many systems face uncertainty. One such example of concern is Bayesian Optimization (BO), where uncertainty is multi-faceted, yet…

机器学习 · 计算机科学 2023-10-31 Hisham Husain , Vu Nguyen , Anton van den Hengel

We propose kernel distributionally robust optimization (Kernel DRO) using insights from the robust optimization theory and functional analysis. Our method uses reproducing kernel Hilbert spaces (RKHS) to construct a wide range of convex…

最优化与控制 · 数学 2021-06-28 Jia-Jie Zhu , Wittawat Jitkrittum , Moritz Diehl , Bernhard Schölkopf

This paper studies Distributionally Robust Optimization (DRO), a fundamental framework for enhancing the robustness and generalization of statistical learning and optimization. An effective ambiguity set for DRO must involve distributions…

机器学习 · 计算机科学 2026-02-10 Jiaqi Wen , Jianyi Yang

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

机器学习 · 统计学 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler
‹ 上一页 1 2 3 10 下一页 ›