English
Related papers

Related papers: Scenario-based Regularization: A Tractable Framewo…

200 papers

In this paper, we introduce a framework for contextual distributionally robust optimization (DRO) that considers the causal and continuous structure of the underlying distribution by developing interpretable and tractable decision rules…

Machine Learning · Statistics 2026-04-03 Fenglin Zhang , Jie Wang

Scenario reduction (SR) aims to identify a small yet representative scenario set to depict the underlying uncertainty, which is critical to scenario-based stochastic optimization (SBSO) of power systems. Existing SR techniques commonly aim…

Optimization and Control · Mathematics 2025-06-16 Yingrui Zhuang , Lin Cheng , Ning Qi , Mads R. Almassalkhi , Feng Liu

Distribution shifts and minority subpopulations frequently undermine the reliability of deep neural networks trained using Empirical Risk Minimization (ERM). Distributionally Robust Optimization (DRO) addresses this by optimizing for the…

Machine Learning · Computer Science 2025-11-11 Aheer Sravon , Devdyuti Mazumder , Md. Ibrahim

Wasserstein distributionally robust optimization offers a framework for model fitting in machine learning under potential shifts in the data distribution. We study a regularized variant of this problem in which entropic smoothing produces a…

Optimization and Control · Mathematics 2026-05-28 Tam Le

This paper introduces a drift optimization model of stochastic optimization problems driven by regulated stochastic processes. A broad range of problems across operations research, machine learning, and statistics can be viewed as…

Optimization and Control · Mathematics 2025-06-10 Zihe Zhou , Harsha Honnappa , Raghu Pasupathy

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

Wasserstein distributionally robust optimization (WDRO) strengthens statistical learning under model uncertainty by minimizing the local worst-case risk within a prescribed ambiguity set. Although WDRO has been extensively studied in…

Machine Learning · Statistics 2025-11-12 Changyu Liu , Yuling Jiao , Junhui Wang , Jian Huang

As the complexity of modern control systems increases, it becomes challenging to derive an accurate model of the uncertainty that affects their dynamics. Wasserstein Distributionally Robust Optimization (DRO) provides a powerful framework…

Systems and Control · Electrical Eng. & Systems 2025-09-09 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

We consider stochastic optimization problems which use observed data to estimate essential characteristics of the random quantities involved. Sample average approximation (SAA) or empirical (plug-in) estimation are very popular ways to use…

Statistics Theory · Mathematics 2021-03-16 Darinka Dentcheva , Yang Lin

This paper focuses on the contextual optimization problem where a decision is subject to some uncertain parameters and covariates that have some predictive power on those parameters are available before the decision is made. More…

Optimization and Control · Mathematics 2024-08-12 Zhaoen Li , Maoqi Liu , Zhi-Hai Zhang

Modern stochastic optimization pipelines increasingly rely on learned generative models to represent uncertainty, while downstream decisions are evaluated almost entirely through Monte Carlo scenarios. This shifts the operational object of…

Optimization and Control · Mathematics 2026-05-01 Ziwei Zhang , Jonathan Yu-Meng Li

We consider optimization problems with uncertain constraints that need to be satisfied probabilistically. When data are available, a common method to obtain feasible solutions for such problems is to impose sampled constraints, following…

Optimization and Control · Mathematics 2020-07-09 Henry Lam , Fengpei Li

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

Machine Learning · Computer Science 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

While solutions of Distributionally Robust Optimization (DRO) problems can sometimes have a higher out-of-sample expected reward than the Sample Average Approximation (SAA), there is no guarantee. In this paper, we introduce a class of…

Optimization and Control · Mathematics 2023-06-13 Jun-ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

We study sample average approximations (SAA) of chance constrained programs. SAA methods typically approximate the actual distribution in the chance constraint using an empirical distribution constructed from random samples assumed to be…

Optimization and Control · Mathematics 2022-05-13 Shuhao Yan , Francesca Parise , Eilyan Bitar

Distributionally robust stochastic optimization (DRSO) is an approach to optimization under uncertainty in which, instead of assuming that there is a known true underlying probability distribution, one hedges against a chosen set of…

Optimization and Control · Mathematics 2022-05-03 Rui Gao , Anton J. Kleywegt

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

Machine Learning · Statistics 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

We revisit the sample average approximation (SAA) approach for non-convex stochastic programming. We show that applying the SAA approach to problems with expected value equality constraints does not necessarily result in asymptotic…

Optimization and Control · Mathematics 2024-07-16 Thomas Lew , Riccardo Bonalli , Marco Pavone

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

Performativity means that the deployment of a predictive model incentivizes agents to strategically adapt their behavior, thereby inducing a model-dependent distribution shift. Practitioners often repeatedly retrain the model on data…

Optimization and Control · Mathematics 2026-02-09 Siyi Wang , Zifan Wang , Karl H. Johansson