English
Related papers

Related papers: Distributional Robustness with IPMs and links to R…

200 papers

Credit scoring has been catalogued by the European Commission and the Executive Office of the US President as a high-risk classification task, a key concern being the potential harms of making loan approval decisions based on models that…

Machine Learning · Computer Science 2024-02-06 Pablo Casas , Christophe Mues , Huan Yu

We study distributionally robust optimization (DRO) problems where the ambiguity set is defined using the Wasserstein metric. We show that this class of DRO problems can be reformulated as semi-infinite programs. We give an exchange method…

Optimization and Control · Mathematics 2017-04-14 Fengqiao Luo , Sanjay Mehrotra

This paper investigates group distributionally robust optimization (GDRO) with the goal of learning a model that performs well over $m$ different distributions. First, we formulate GDRO as a stochastic convex-concave saddle-point problem,…

Machine Learning · Computer Science 2024-11-21 Lijun Zhang , Haomin Bai , Peng Zhao , Tianbao Yang , Zhi-Hua Zhou

We study the distributionally robust optimization (DRO) in a dynamic context where the model uncertainty is captured by penalizing potential models in function of their adapted Wasserstein distance to a given reference model. We consider…

Probability · Mathematics 2025-09-30 Yifan Jiang

Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing…

Machine Learning · Statistics 2024-04-02 Qi Zhang , Yi Zhou , Ashley Prater-Bennette , Lixin Shen , Shaofeng Zou

One of the most studied machine learning challenges that recent studies have shown the susceptibility of deep neural networks to is the class imbalance problem. While concerted research efforts in this direction have been notable in recent…

The empirical success of distributional reinforcement learning (RL) highly relies on the choice of distribution divergence equipped with an appropriate distribution representation. In this paper, we propose \textit{Sinkhorn distributional…

Machine Learning · Computer Science 2024-10-16 Ke Sun , Yingnan Zhao , Wulong Liu , Bei Jiang , Linglong Kong

We propose a novel approach for domain generalisation (DG) leveraging risk distributions to characterise domains, thereby achieving domain invariance. In our findings, risk distributions effectively highlight differences between training…

Machine Learning · Computer Science 2023-10-31 Toan Nguyen , Kien Do , Bao Duong , Thin Nguyen

Deep generative models based on Generative Adversarial Networks (GANs) have demonstrated impressive sample quality but in order to work they require a careful choice of architecture, parameter initialization, and selection of…

Machine Learning · Computer Science 2017-11-08 Kevin Roth , Aurelien Lucchi , Sebastian Nowozin , Thomas Hofmann

Distributionally Robust Optimisation (DRO) protects risk-averse decision-makers by considering the worst-case risk within an ambiguity set of distributions based on the empirical distribution or a model. To further guard against finite,…

Machine Learning · Statistics 2025-05-07 Charita Dellaporta , Patrick O'Hara , Theodoros Damoulas

Generative Adversarial Networks (GANs) are one of the most practical methods for learning data distributions. A popular GAN formulation is based on the use of Wasserstein distance as a metric between probability distributions.…

Machine Learning · Computer Science 2018-05-23 Maziar Sanjabi , Jimmy Ba , Meisam Razaviyayn , Jason D. Lee

Machine learning algorithms minimizing average risk are susceptible to distributional shifts. Distributionally Robust Optimization (DRO) addresses this issue by optimizing the worst-case risk within an uncertainty set. However, DRO suffers…

Machine Learning · Computer Science 2023-11-10 Jiashuo Liu , Jiayun Wu , Tianyu Wang , Hao Zou , Bo Li , Peng Cui

Many machine learning tasks involve subpopulation shift where the testing data distribution is a subpopulation of the training distribution. For such settings, a line of recent work has proposed the use of a variant of empirical risk…

Machine Learning · Computer Science 2021-06-14 Runtian Zhai , Chen Dan , J. Zico Kolter , Pradeep Ravikumar

Real-world deployments routinely face distribution shifts, group imbalances, and adversarial perturbations, under which the traditional Empirical Risk Minimization (ERM) framework can degrade severely. Distributionally Robust Optimization…

Machine Learning · Computer Science 2026-02-19 Difei Xu , Meng Ding , Zebin Ma , Huanyi Xie , Youming Tao , Aicha Slaitane , Di Wang

We study an LLM fine-tuning task for designing reward functions for sequential resource allocation problems in public health, guided by human preferences expressed in natural language. This setting presents a challenging testbed for…

Machine Learning · Computer Science 2025-11-19 Cheol Woo Kim , Shresth Verma , Mauricio Tec , Milind Tambe

Many existing group fairness-aware training methods aim to achieve the group fairness by either re-weighting underrepresented groups based on certain rules or using weakly approximated surrogates for the fairness metrics in the objective as…

Machine Learning · Computer Science 2023-03-02 Sangwon Jung , Taeeon Park , Sanghyuk Chun , Taesup Moon

We present a deep learning model for data-driven simulations of random dynamical systems without a distributional assumption. The deep learning model consists of a recurrent neural network, which aims to learn the time marching structure,…

Machine Learning · Computer Science 2022-04-12 Kyongmin Yeo , Zan Li , Wesley M. Gifford

Noisy data are often viewed as a challenge for decision-making. This paper studies a distributionally robust optimization (DRO) that shows how such noise can be systematically incorporated. Rather than applying DRO to the noisy empirical…

Optimization and Control · Mathematics 2025-09-03 Chung-Han Hsieh , Rong Gan

We study the problem of robust distribution estimation under the Wasserstein distance, a popular discrepancy measure between probability distributions rooted in optimal transport (OT) theory. Given $n$ samples from an unknown distribution…

Machine Learning · Statistics 2024-09-25 Sloan Nietert , Rachel Cummings , Ziv Goldfeld

We consider stochastic programs where the distribution of the uncertain parameters is only observable through a finite training dataset. Using the Wasserstein metric, we construct a ball in the space of (multivariate and non-discrete)…

Optimization and Control · Mathematics 2017-06-14 Peyman Mohajerin Esfahani , Daniel Kuhn