English
Related papers

Related papers: A data-driven approach to beating SAA out-of-sampl…

200 papers

Detecting out-of-distribution (OOD) inputs is critical for safely deploying deep learning models in the real world. Existing approaches for detecting OOD examples work well when evaluated on benign in-distribution and OOD samples. However,…

Machine Learning · Computer Science 2021-12-10 Jiefeng Chen , Yixuan Li , Xi Wu , Yingyu Liang , Somesh Jha

We study two-stage distributionally robust optimization (DRO) problems with decision-dependent information discovery (DDID) wherein (a portion of) the uncertain parameters are revealed only if an (often costly) investment is made in the…

Optimization and Control · Mathematics 2025-10-07 Qing Jin , Angelos Georghiou , Phebe Vayanos , Grani A. Hanasusanto

Data-driven distributionally robust optimization is a recently emerging paradigm aimed at finding a solution that is driven by sample data but is protected against sampling errors. An increasingly popular approach, known as Wasserstein…

Optimization and Control · Mathematics 2022-07-20 Jonathan Yu-Meng Li , Tiantian Mao

A fundamental challenge in model-based offline reinforcement learning (RL) lies in the trade-off between generalization and robustness against exploitation errors in out-of-distribution (OOD) regions. While OOD samples may capture valid…

Artificial Intelligence · Computer Science 2026-05-11 Hongqiang Lin , Dongxu Zhang , Yiding Sun , Mingzhe Li , Ning Yang , Haijun Zhang

Reinforcement learning (RL) policies often fail under dynamics that differ from training, a gap not fully addressed by domain randomization or existing adversarial RL methods. Distributionally robust RL provides a formal remedy but still…

Machine Learning · Computer Science 2026-04-16 Mintae Kim , Koushil Sreenath

Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing…

Machine Learning · Statistics 2024-04-02 Qi Zhang , Yi Zhou , Ashley Prater-Bennette , Lixin Shen , Shaofeng Zou

Sample efficiency in Reinforcement Learning (RL) has traditionally been driven by algorithmic enhancements. In this work, we demonstrate that scaling can also lead to substantial improvements. We conduct a thorough investigation into the…

Machine Learning · Computer Science 2024-12-04 Michal Nauman , Mateusz Ostaszewski , Krzysztof Jankowski , Piotr Miłoś , Marek Cygan

Distributionally robust optimization (DRO) is a worst-case framework for stochastic optimization under uncertainty that has drawn fast-growing studies in recent years. When the underlying probability distribution is unknown and observed…

Optimization and Control · Mathematics 2021-08-16 Shengyi He , Henry Lam

Modern machine learning models may be susceptible to learning spurious correlations that hold on average but not for the atypical group of samples. To address the problem, previous approaches minimize the empirical worst-group risk. Despite…

Machine Learning · Computer Science 2023-03-13 Soumya Suvra Ghosal , Yixuan Li

We consider data-driven approaches that integrate a machine learning prediction model within distributionally robust optimization (DRO) given limited joint observations of uncertain parameters and covariates. Our framework is flexible in…

Optimization and Control · Mathematics 2022-05-26 Rohit Kannan , Güzin Bayraksan , James R. Luedtke

Models trained via empirical risk minimization (ERM) are known to rely on spurious correlations between labels and task-independent input features, resulting in poor generalization to distributional shifts. Group distributionally robust…

Machine Learning · Computer Science 2022-12-12 Bhargavi Paranjape , Pradeep Dasigi , Vivek Srikumar , Luke Zettlemoyer , Hannaneh Hajishirzi

Different distribution shifts require different interventions, and algorithms must be grounded in the specific shifts they address. However, methodological development for robust algorithms typically relies on structural assumptions that…

Machine Learning · Computer Science 2025-08-27 Tianyu Wang , Jiashuo Liu , Peng Cui , Hongseok Namkoong

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

Optimization and Control · Mathematics 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

Machine Learning · Statistics 2024-12-31 Linglingzhi Zhu , Yao Xie

We study a single-server appointment scheduling problem with a fixed sequence of appointments, for which we must determine the arrival time for each appointment. We specifically examine two stochastic models. In the first model, we assume…

Optimization and Control · Mathematics 2019-07-09 Ruiwei Jiang , Minseok Ryu , Guanglin Xu

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

Machine Learning · Computer Science 2020-06-08 Aurora Cobo Aguilera , Antonio Artés-Rodríguez , Fernando Pérez-Cruz , Pablo Martínez Olmos

Variable division and optimization (D\&O) is a frequently utilized algorithm design paradigm in Evolutionary Algorithms (EAs). A D\&O EA divides a variable into partial variables and then optimize them respectively. A complicated problem is…

Neural and Evolutionary Computing · Computer Science 2021-01-22 Yi Chen , Aimin Zhou

Distributionally Robust Optimization (DRO) has enabled to prove the equivalence between robustness and regularization in classification and regression, thus providing an analytical reason why regularization generalizes well in statistical…

Optimization and Control · Mathematics 2020-07-15 Esther Derman , Shie Mannor

Combinatorial optimization assumes that all parameters of the optimization problem, e.g. the weights in the objective function is fixed. Often, these weights are mere estimates and increasingly machine learning techniques are used to for…

Machine Learning · Computer Science 2019-11-25 Jaynta Mandi , Emir Demirović , Peter. J Stuckey , Tias Guns

In order to protect the environment and address fossil fuel scarcity, renewable energy is increasingly used for power generation. However, due to the uncertainties it brings to electricity production, deterministic optimization is no longer…

Optimization and Control · Mathematics 2022-12-13 Shuhan Lyu