English
Related papers

Related papers: Distributionally Robust Optimization

200 papers

We propose kernel distributionally robust optimization (Kernel DRO) using insights from the robust optimization theory and functional analysis. Our method uses reproducing kernel Hilbert spaces (RKHS) to construct a wide range of convex…

Optimization and Control · Mathematics 2021-06-28 Jia-Jie Zhu , Wittawat Jitkrittum , Moritz Diehl , Bernhard Schölkopf

Regularization is a central tool for addressing ill-posedness in inverse problems and statistical estimation, with the choice of a suitable penalty often determining the reliability and interpretability of downstream solutions. While recent…

Optimization and Control · Mathematics 2025-10-07 Oscar Leong , Eliza O'Reilly , Yong Sheng Soh

Robust optimization (RO) provides a principled framework for decision-making under uncertainty, but its performance critically depends on the choice of the uncertainty set. While large sets ensure reliability, they often lead to overly…

Machine Learning · Computer Science 2026-05-15 Shuyi Chen , Wenbin Zhou , Shixiang Zhu

Inspired by its success for their continuous counterparts, the standard approach to deal with mixed-integer recourse (MIR) models under distributional uncertainty is to use distributionally robust optimization (DRO). We argue, however, that…

Optimization and Control · Mathematics 2022-06-28 E. Ruben van Beesten , Ward Romeijnders , David P. Morton

Distributionally robust optimization (DRO) is a powerful technique to train robust models against data distribution shift. This paper aims to solve regularized nonconvex DRO problems, where the uncertainty set is modeled by a so-called…

Optimization and Control · Mathematics 2025-06-30 Yufeng Yang , Yi Zhou , Zhaosong Lu

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

Machine Learning · Computer Science 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

This paper investigates a Multistage Distributionally Robust Optimization (MDRO) approach to water allocation under climate uncertainty. The MDRO is formed by creating sets of conditional distributions (called conditional ambiguity sets) on…

Optimization and Control · Mathematics 2020-05-20 Jangho Park , Guzin Bayraksan

Robust Markov Decision Processes (MDPs) address environmental shift through distributionally robust optimization (DRO) by finding an optimal worst-case policy within an uncertainty set of transition kernels. However, standard DRO approaches…

Machine Learning · Statistics 2026-03-10 Akram S. Awad , Shihab Ahmed , Yue Wang , George K. Atia

Credit scoring has been catalogued by the European Commission and the Executive Office of the US President as a high-risk classification task, a key concern being the potential harms of making loan approval decisions based on models that…

Machine Learning · Computer Science 2024-02-06 Pablo Casas , Christophe Mues , Huan Yu

Robustness to distributional shift is one of the key challenges of contemporary machine learning. Attaining such robustness is the goal of distributionally robust optimization, which seeks a solution to an optimization problem that is…

Machine Learning · Statistics 2020-03-24 Johannes Kirschner , Ilija Bogunovic , Stefanie Jegelka , Andreas Krause

Real-world deployments routinely face distribution shifts, group imbalances, and adversarial perturbations, under which the traditional Empirical Risk Minimization (ERM) framework can degrade severely. Distributionally Robust Optimization…

Machine Learning · Computer Science 2026-02-19 Difei Xu , Meng Ding , Zebin Ma , Huanyi Xie , Youming Tao , Aicha Slaitane , Di Wang

Group distributionally robust optimization (GDRO) aims to develop models that perform well across $m$ distributions simultaneously. Existing GDRO algorithms can only process a fixed number of samples per iteration, either 1 or $m$, and…

Machine Learning · Computer Science 2025-05-22 Haomin Bai , Dingzhi Yu , Shuai Li , Haipeng Luo , Lijun Zhang

Statistical learning under distribution shift is challenging when neither prior knowledge nor fully accessible data from the target distribution is available. Distributionally robust learning (DRL) aims to control the worst-case statistical…

Methodology · Statistics 2024-12-19 Yu Gui , Rina Foygel Barber , Cong Ma

Few-shot learning requires models to generalize under limited supervision while remaining robust to distribution shifts. Existing Sinkhorn Distributionally Robust Optimization (DRO) methods provide theoretical guarantees but rely on a fixed…

Machine Learning · Statistics 2026-02-17 Haixiang Sun , Andrew L. Liu

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

Optimization and Control · Mathematics 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), as the widely employed policy based reinforcement learning (RL) methods, are prone to converge to a sub-optimal solution as they limit the policy representation…

Machine Learning · Computer Science 2020-06-16 Jun Song , Chaoyue Zhao

We study the causal distributionally robust optimization (DRO) in both discrete- and continuous- time settings. The framework captures model uncertainty, with potential models penalized in function of their adapted Wasserstein distance to a…

Probability · Mathematics 2025-05-29 Yifan Jiang , Jan Obloj

This paper introduces Inverse Distributionally Robust Optimization (I-DRO) as a method to infer the conservativeness level of a decision-maker, represented by the size of a Wasserstein metric-based ambiguity set, from the optimal decisions…

Optimization and Control · Mathematics 2024-05-07 Qi Li , Zhirui Liang , Andrey Bernstein , Yury Dvorkin

We consider statistical methods which invoke a min-max distributionally robust formulation to extract good out-of-sample performance in data-driven optimization and learning problems. Acknowledging the distributional uncertainty in learning…

Statistics Theory · Mathematics 2021-08-05 Jose Blanchet , Karthyek Murthy , Viet Anh Nguyen

Local decision rules are commonly understood to be more explainable, due to the local nature of the patterns involved. With numerical optimization methods such as gradient boosting, ensembles of local decision rules can gain good predictive…

Machine Learning · Computer Science 2025-08-27 Xin Du , Subramanian Ramamoorthy , Wouter Duivesteijn , Jin Tian , Mykola Pechenizkiy