English
Related papers

Related papers: Smoothed $f$-Divergence Distributionally Robust Op…

200 papers

Wasserstein distributionally robust optimization (\textsf{WDRO}) is a popular model to enhance the robustness of machine learning with ambiguous data. However, the complexity of \textsf{WDRO} can be prohibitive in practice since solving its…

Machine Learning · Computer Science 2023-05-10 Ruomin Huang , Jiawei Huang , Wenjie Liu , Hu Ding

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

The Robust Satisficing (RS) model is an emerging approach to robust optimization, offering streamlined procedures and robust generalization across various applications. However, the statistical theory of RS remains unexplored in the…

Machine Learning · Statistics 2024-06-03 Zhiyi Li , Yunbei Xu , Ruohan Zhan

Distributionally Robust Optimization (DRO) has been shown to provide a flexible framework for decision making under uncertainty and statistical estimation. For example, recent works in DRO have shown that popular statistical estimators can…

Machine Learning · Statistics 2020-04-21 Jose Blanchet , Yang Kang , Fan Zhang , Zhangyi Hu

We introduce a robust variant of the Kelly portfolio optimization model, called the Wasserstein-Kelly portfolio optimization. Our model, taking a Wasserstein distributionally robust optimization (DRO) formulation, addresses the fundamental…

Portfolio Management · Quantitative Finance 2023-02-28 Jonathan Yu-Meng Li

We consider optimal decision-making problems in an uncertain environment. In particular, we consider the case in which the distribution of the input is unknown, yet there is abundant historical data drawn from the distribution. In this…

Optimization and Control · Mathematics 2014-10-03 Zizhuo Wang , Peter Glynn , Yinyu Ye

Differentially private (DP) stochastic convex optimization (SCO) is a fundamental problem, where the goal is to approximately minimize the population risk with respect to a convex loss function, given a dataset of $n$ i.i.d. samples from a…

Machine Learning · Computer Science 2022-05-06 Raef Bassily , Cristóbal Guzmán , Anupama Nandi

As a prevalent distributed learning paradigm, Federated Learning (FL) trains a global model on a massive amount of devices with infrequent communication. This paper investigates a class of composite optimization and statistical recovery…

Machine Learning · Computer Science 2022-10-04 Yajie Bao , Michael Crawshaw , Shan Luo , Mingrui Liu

Stochastic Gradient (SG) is the defacto iterative technique to solve stochastic optimization (SO) problems with a smooth (non-convex) objective $f$ and a stochastic first-order oracle. SG's attractiveness is due in part to its simplicity of…

Optimization and Control · Mathematics 2024-03-08 David Newton , Raghu Bollapragada , Raghu Pasupathy , Nung Kwan Yip

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

Machine Learning · Computer Science 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

This paper investigates the robust optimal control of sampled-data stochastic systems with multiplicative noise and distributional ambiguity. We consider a class of discrete-time optimal control problems where the controller \emph{jointly}…

Optimization and Control · Mathematics 2026-02-05 Chung-Han Hsieh

Recently, compositional optimization (CO) has gained popularity because of its applications in distributionally robust optimization (DRO) and many other machine learning problems. Large-scale and distributed availability of data demands the…

Machine Learning · Computer Science 2023-11-22 Prashant Khanduri , Chengyin Li , Rafi Ibn Sultan , Yao Qiang , Joerg Kliewer , Dongxiao Zhu

We study the out-of-sample properties of robust empirical optimization problems with smooth $\phi$-divergence penalties and smooth concave objective functions, and develop a theory for data-driven calibration of the non-negative "robustness…

Machine Learning · Statistics 2020-05-20 Jun-Ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

Distributionally-robust optimization is often studied for a fixed set of distributions rather than time-varying distributions that can drift significantly over time (which is, for instance, the case in finance and sociology due to…

Optimization and Control · Mathematics 2020-10-01 Iman Shames , Farhad Farokhi

Transfer learning is a popular strategy to leverage external knowledge and improve statistical efficiency, particularly with a limited target sample. We propose a novel knowledge-guided Wasserstein Distributionally Robust Optimization…

Machine Learning · Computer Science 2025-02-13 Zitao Wang , Ziyuan Wang , Molei Liu , Nian Si

We consider a residuals-based distributionally robust optimization (DRO) model, where the underlying uncertainty depends on both covariate information and our decisions. We adopt both parametric and nonparametric regression models to learn…

Optimization and Control · Mathematics 2026-05-21 Qing Zhu , Xian Yu , Guzin Bayraksan

The goal of this paper is to develop methodology for the systematic analysis of asymptotic statistical properties of data driven DRO formulations based on their corresponding non-DRO counterparts. We illustrate our approach in various…

Optimization and Control · Mathematics 2023-03-28 Jose Blanchet , Alexander Shapiro

This paper proposes a novel approach to construct data-driven online solutions to optimization problems (P) subject to a class of distributionally uncertain dynamical systems. The introduced framework allows for the simultaneous learning of…

Systems and Control · Electrical Eng. & Systems 2024-07-23 Dan Li , Dariush Fooladivanda , Sonia Martinez

Wasserstein distributionally robust optimization (WDRO) attempts to learn a model that minimizes the local worst-case risk in the vicinity of the empirical data distribution defined by Wasserstein ball. While WDRO has received attention as…

Machine Learning · Statistics 2020-06-23 Yongchan Kwon , Wonyoung Kim , Joong-Ho Won , Myunghee Cho Paik

In many real-world applications, ensuring the robustness and stability of deep neural networks (DNNs) is crucial, particularly for image classification tasks that encounter various input perturbations. While data augmentation techniques…

Machine Learning · Statistics 2025-06-26 Jiaming Hu , Debarghya Mukherjee , Ioannis Ch. Paschalidis