English
Related papers

Related papers: Distributionally Robust Bayesian Optimization with…

200 papers

Robust optimization(RO) is an important tool for handling optimization problem with uncertainty. The main objective of RO is to solve optimization problems due to uncertainty associated with constraints satisfying all realizations of…

Optimization and Control · Mathematics 2025-04-02 Parthasarathi Mondal , Akshay Kumar Ojha

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

Machine Learning · Computer Science 2022-12-20 Yang Jiao , Kai Yang , Dongjin Song

A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models…

Machine Learning · Computer Science 2021-06-15 Chunting Zhou , Xuezhe Ma , Paul Michel , Graham Neubig

Established approaches to obtain generalization bounds in data-driven optimization and machine learning mostly build on solutions from empirical risk minimization (ERM), which depend crucially on the functional complexity of the hypothesis…

Optimization and Control · Mathematics 2022-10-14 Yibo Zeng , Henry Lam

Distributionally robust optimization (DRO) is an effective framework for controlling real-world systems with various uncertainties, typically modeled using distributional uncertainty balls. However, DRO problems often involve infinitely…

Optimization and Control · Mathematics 2025-10-22 Yuma Shida , Yuji Ito

In this work, we develop a novel data-driven Bayesian nonparametric Wasserstein distributionally robust optimization (BNWDRO) framework for decision-making under uncertainty. The proposed framework unifies a Bayesian nonparametric method…

Optimization and Control · Mathematics 2023-11-07 Chao Ning , Xutao Ma

Quick response is a widely adopted strategy to mitigate overproduction in the manufacturing industry, yet recent research reveals a counter-intuitive paradox: while it reduces waste from unsold finished goods, it may incentivize firms to…

Optimization and Control · Mathematics 2026-02-11 Panayotis P. Papavassilopoulos , Grani A. Hanasusanto , Yijie Wang

We study control of constrained linear systems with only partial statistical information about the uncertainty affecting the system dynamics and the sensor measurements. Specifically, given a finite collection of disturbance realizations…

Optimization and Control · Mathematics 2024-07-15 Jean-Sébastien Brouillon , Andrea Martin , John Lygeros , Florian Dörfler , Giancarlo Ferrari Trecate

Duality is a foundational tool in robust and distributionally robust optimization (RO and DRO), underpinning both analytical insights and tractable reformulations. The prevailing approaches in the literature primarily rely on saddle-point…

Optimization and Control · Mathematics 2026-04-02 Louis L. Chen , Jake Roth , Johannes O. Royset

This paper presents a framework for Wasserstein distributionally robust (DR) regret-optimal (RO) control in the context of partially observable systems. DR-RO control considers the regret in LQR cost between a causal and non-causal…

Optimization and Control · Mathematics 2023-07-12 Joudi Hajar , Taylan Kargin , Babak Hassibi

We present a novel framework for distributionally robust optimization (DRO), called cost-aware DRO (CADRO). The key idea of CADRO is to exploit the cost structure in the design of the ambiguity set to reduce conservatism. Particularly, the…

Optimization and Control · Mathematics 2023-05-17 Mathijs Schuurmans , Panagiotis Patrinos

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

As machine learning models are deployed ever more broadly, it becomes increasingly important that they are not only able to perform well on their training distribution, but also yield accurate predictions when confronted with distribution…

Machine Learning · Computer Science 2022-04-14 Paul Michel , Tatsunori Hashimoto , Graham Neubig

Distribution shifts and minority subpopulations frequently undermine the reliability of deep neural networks trained using Empirical Risk Minimization (ERM). Distributionally Robust Optimization (DRO) addresses this by optimizing for the…

Machine Learning · Computer Science 2025-11-11 Aheer Sravon , Devdyuti Mazumder , Md. Ibrahim

Optimizing objectives under constraints, where both the objectives and constraints are black box functions, is a common scenario in real-world applications such as scientific experimental design, design of medical therapies, and industrial…

Machine Learning · Computer Science 2023-10-16 Fengxue Zhang , Zejie Zhu , Yuxin Chen

In recent years, there has been a growing research interest in decision-focused learning, which embeds optimization problems as a layer in learning pipelines and demonstrates a superior performance than the prediction-focused approach.…

Optimization and Control · Mathematics 2024-06-25 Xutao Ma , Chao Ning , Wenli Du

Distributionally Favorable Optimization (DFO) is an important framework for decision-making under uncertainty, with applications across fields such as reinforcement learning, online learning, robust statistics, chance-constrained…

Optimization and Control · Mathematics 2024-02-01 Nan Jiang , Weijun Xie

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

Optimization and Control · Mathematics 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

Bayesian optimization (BO) has gained attention as an efficient algorithm for black-box optimization of expensive-to-evaluate systems, where the BO algorithm iteratively queries the system and suggests new trials based on a probabilistic…

Machine Learning · Computer Science 2026-03-13 Eike Cramer , Luis Kutschat , Oliver Stollenwerk , Joel A. Paulson , Alexander Mitsos

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Ch. Paschalidis