English
Related papers

Related papers: Iterative Sampling Methods for Sinkhorn Distributi…

200 papers

Many machine learning tasks involve subpopulation shift where the testing data distribution is a subpopulation of the training distribution. For such settings, a line of recent work has proposed the use of a variant of empirical risk…

Machine Learning · Computer Science 2021-06-14 Runtian Zhai , Chen Dan , J. Zico Kolter , Pradeep Ravikumar

Wasserstein distributionally robust optimization (\textsf{WDRO}) is a popular model to enhance the robustness of machine learning with ambiguous data. However, the complexity of \textsf{WDRO} can be prohibitive in practice since solving its…

Machine Learning · Computer Science 2023-05-10 Ruomin Huang , Jiawei Huang , Wenjie Liu , Hu Ding

Optimal-Transport Distributionally Robust Optimization (OT-DRO) robustifies data-driven decision-making under uncertainty by capturing the sampling-induced statistical error via optimal transport ambiguity sets. The standard OT-DRO pipeline…

Optimization and Control · Mathematics 2025-09-17 Jonas Ohnemus , Marta Fochesato , Riccardo Zuliani , John Lygeros

Many decision problems in science, engineering and economics are affected by uncertain parameters whose distribution is only indirectly observable through samples. The goal of data-driven decision-making is to learn a decision from finitely…

Machine Learning · Statistics 2024-11-05 Daniel Kuhn , Peyman Mohajerin Esfahani , Viet Anh Nguyen , Soroosh Shafieezadeh-Abadeh

Offline reinforcement learning aims to learn from pre-collected datasets without active exploration. This problem faces significant challenges, including limited data availability and distributional shifts. Existing approaches adopt a…

Machine Learning · Computer Science 2024-10-01 Yue Wang , Jinjun Xiong , Shaofeng Zou

The notion of entropy-regularized optimal transport, also known as Sinkhorn divergence, has recently gained popularity in machine learning and statistics, as it makes feasible the use of smoothed optimal transportation distances for data…

Statistics Theory · Mathematics 2019-11-05 Jérémie Bigot , Elsa Cazelles , Nicolas Papadakis

Wasserstein distributionally robust optimization (WDRO) attempts to learn a model that minimizes the local worst-case risk in the vicinity of the empirical data distribution defined by Wasserstein ball. While WDRO has received attention as…

Machine Learning · Statistics 2020-06-23 Yongchan Kwon , Wonyoung Kim , Joong-Ho Won , Myunghee Cho Paik

A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models…

Machine Learning · Computer Science 2021-06-15 Chunting Zhou , Xuezhe Ma , Paul Michel , Graham Neubig

We propose an online data compression approach for efficiently solving distributionally robust optimization (DRO) problems with streaming data while maintaining out-of-sample performance guarantees. Our method dynamically constructs…

Optimization and Control · Mathematics 2025-09-12 Irina Wang , Marta Fochesato , Bartolomeo Stellato

Classical stochastic control assumes perfect knowledge of the uncertainty affecting the plant. In practice, however, such information is often incomplete. To address this limitation, we consider a distributionally robust control (DRC)…

Systems and Control · Electrical Eng. & Systems 2026-05-06 Riccardo Cescon , Andrea Martin , Giancarlo Ferrari-Trecate

We consider optimal transport based distributionally robust optimization (DRO) problems with locally strongly convex transport cost functions and affine decision rules. Under conventional convexity assumptions on the underlying loss…

Optimization and Control · Mathematics 2021-04-27 Jose Blanchet , Karthyek Murthy , Fan Zhang

This paper investigates group distributionally robust optimization (GDRO) with the goal of learning a model that performs well over $m$ different distributions. First, we formulate GDRO as a stochastic convex-concave saddle-point problem,…

Machine Learning · Computer Science 2024-11-21 Lijun Zhang , Haomin Bai , Peng Zhao , Tianbao Yang , Zhi-Hua Zhou

Wasserstein distributionally robust optimization (DRO) has gained prominence in operations research and machine learning as a powerful method for achieving solutions with favorable out-of-sample performance. Two compelling explanations for…

Machine Learning · Computer Science 2024-12-23 Qinyu Wu , Jonathan Yu-Meng Li , Tiantian Mao

Two-stage risk-averse distributionally robust optimization (DRO) problems are ubiquitous across many engineering and business applications. Despite their promising resilience, two-stage DRO problems are generally computationally…

Optimization and Control · Mathematics 2024-12-24 Yue Lin , Daniel Zhuoyu Long , Viet Anh Nguyen , Jin Qi

We consider the problem of analyzing the probabilistic performance of first-order methods when solving convex optimization problems drawn from an unknown distribution only accessible through samples. By combining performance estimation…

Optimization and Control · Mathematics 2025-12-11 Jisun Park , Vinit Ranjan , Bartolomeo Stellato

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

Optimization and Control · Mathematics 2025-07-31 Yang Jiao , Kai Yang , Dongjin Song

In contextual optimization, a decision-maker leverages contextual information, often referred to as covariates, to better resolve uncertainty and make informed decisions. In this paper, we examine the challenges of contextual…

Optimization and Control · Mathematics 2025-06-26 Tianyu Wang , Ningyuan Chen , Chun Wang

We investigate the use of distributionally robust optimization (DRO) as a tractable tool to recover the asymptotic statistical guarantees provided by the Central Limit Theorem, for maintaining the feasibility of an expected value constraint…

Optimization and Control · Mathematics 2016-05-31 Henry Lam

Empirical risk minimization (ERM) and distributionally robust optimization (DRO) are popular approaches for solving stochastic optimization problems that appear in operations management and machine learning. Existing generalization error…

Optimization and Control · Mathematics 2023-09-26 Garud Iyengar , Henry Lam , Tianyu Wang

As machine learning models are deployed ever more broadly, it becomes increasingly important that they are not only able to perform well on their training distribution, but also yield accurate predictions when confronted with distribution…

Machine Learning · Computer Science 2022-04-14 Paul Michel , Tatsunori Hashimoto , Graham Neubig
‹ Prev 1 4 5 6 7 8 10 Next ›