English
Related papers

Related papers: A data-driven approach to beating SAA out-of-sampl…

200 papers

Many machine learning models, such as logistic regression~(LR) and support vector machine~(SVM), can be formulated as composite optimization problems. Recently, many distributed stochastic optimization~(DSO) methods have been proposed to…

Machine Learning · Statistics 2016-12-13 Shen-Yi Zhao , Ru Xiang , Ying-Hao Shi , Peng Gao , Wu-Jun Li

Real-world deployments routinely face distribution shifts, group imbalances, and adversarial perturbations, under which the traditional Empirical Risk Minimization (ERM) framework can degrade severely. Distributionally Robust Optimization…

Machine Learning · Computer Science 2026-02-19 Difei Xu , Meng Ding , Zebin Ma , Huanyi Xie , Youming Tao , Aicha Slaitane , Di Wang

While traditional distributionally robust optimization (DRO) aims to minimize the maximal risk over a set of distributions, Agarwal and Zhang (2022) recently proposed a variant that replaces risk with excess risk. Compared to DRO, the new…

Optimization and Control · Mathematics 2024-05-29 Lijun Zhang , Haomin Bai , Wei-Wei Tu , Ping Yang , Yao Hu

We study optimization for data-driven decision-making when we have observations of the uncertain parameters within the optimization model together with concurrent observations of covariates. Given a new covariate observation, the goal is to…

Optimization and Control · Mathematics 2022-07-28 Rohit Kannan , Güzin Bayraksan , James R. Luedtke

We examine a stochastic formulation for data-driven optimization wherein the decision-maker is not privy to the true distribution, but has knowledge that it lies in some hypothesis set and possesses a historical data set, from which…

Optimization and Control · Mathematics 2023-09-21 Gar Goei Loke , Taozeng Zhu , Ruiting Zuo

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

Machine Learning · Statistics 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Traditional oversampling methods are generally employed to handle class imbalance in datasets. This oversampling approach is independent of the classifier; thus, it does not offer an end-to-end solution. To overcome this, we propose a…

Machine Learning · Computer Science 2021-08-25 Tanmoy Dam , Md Meftahul Ferdaus , Sreenatha G. Anavatti , Senthilnath Jayavelu , Hussein A. Abbass

Modern data workflows are inherently adaptive, repeatedly querying the same dataset to refine and validate sequential decisions, but such adaptivity can lead to overfitting and invalid statistical inference. Adaptive Data Analysis (ADA)…

Machine Learning · Computer Science 2026-02-10 Joon Suk Huh

We consider a two-stage distributionally robust optimization (DRO) model with multimodal uncertainty, where both the mode probabilities and uncertainty distributions could be affected by the first-stage decisions. To address this setting,…

Optimization and Control · Mathematics 2026-02-03 Xian Yu , Beste Basciftci

We develop an analytical synthesis that bridges data-driven Distributionally Robust Optimization (DRO) and Economic Decision Theory under Ambiguity (DTA). By reinterpreting standard regularization and DRO techniques as data-driven…

Machine Learning · Statistics 2025-02-27 Nicola Bariletto , Khai Nguyen , Nhat Ho

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

Optimization and Control · Mathematics 2022-10-14 Yibo Zeng , Henry Lam

In this study we analyze linear mixed-integer programming problems, in which the distribution of the cost vector is only observable through a finite training data set. In contrast to the related studies, we assume that the number of random…

Optimization and Control · Mathematics 2022-05-20 Sergey S. Ketkov , Andrei S. Shilov

We present a distributionally robust optimization (DRO) approach for the transmission expansion planning problem, considering both long- and short-term uncertainties on the system demand and non-dispatchable renewable generation. On the…

Optimization and Control · Mathematics 2020-03-17 Alexandre Velloso , David Pozo , Alexandre Street

Decision making under uncertainty is challenging since the data-generating process (DGP) is often unknown. Bayesian inference proceeds by estimating the DGP through posterior beliefs about the model's parameters. However, minimising the…

Machine Learning · Statistics 2024-09-06 Charita Dellaporta , Patrick O'Hara , Theodoros Damoulas

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

Optimization and Control · Mathematics 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

This study introduces adaptive robust optimization (ARO) and adaptive robust stochastic optimization (ARSO) approaches to address long- and short-term uncertainties in the optimal sizing and placement of distributed energy resources in…

Optimization and Control · Mathematics 2025-03-25 Fernando García-Muñoz , Cristian Duran-Mateluna

We study the problem of designing optimal learning and decision-making formulations when only historical data is available. Prior work typically commits to a particular class of data-driven formulation and subsequently tries to establish…

Machine Learning · Statistics 2024-03-13 Amine Bennouna , Bart P. G. Van Parys

Diffusion Probabilistic Models (DPMs) have achieved significant success in generative tasks. However, their training and sampling processes suffer from the issue of distribution mismatch. During the denoising process, the input data…

Machine Learning · Computer Science 2025-02-25 Zekun Wang , Mingyang Yi , Shuchen Xue , Zhenguo Li , Ming Liu , Bing Qin , Zhi-Ming Ma

Off-policy evaluation and learning are concerned with assessing a given policy and learning an optimal policy from offline data without direct interaction with the environment. Often, the environment in which the data are collected differs…

Machine Learning · Computer Science 2024-01-18 Yi Shen , Pan Xu , Michael M. Zavlanos