English
Related papers

Related papers: Distributionally Robust Deep Learning using Hardne…

200 papers

Data-driven Distributionally Robust Optimization (DD-DRO) via optimal transport has been shown to encompass a wide range of popular machine learning algorithms. The distributional uncertainty size is often shown to correspond to the…

Machine Learning · Statistics 2021-05-12 Jose Blanchet , Yang Kang , Fan Zhang , Fei He , Zhangyi Hu

Distributionally Robust Optimization (DRO), which aims to find an optimal decision that minimizes the worst case cost over the ambiguity set of probability distribution, has been widely applied in diverse applications, e.g., network…

Machine Learning · Computer Science 2022-12-20 Yang Jiao , Kai Yang , Dongjin Song

Distributionally robust optimization (DRO) is a widely used framework for optimizing objective functionals in the presence of both randomness and model-form uncertainty. A key step in the practical solution of many DRO problems is a…

Optimization and Control · Mathematics 2021-04-22 Jeremiah Birrell

Stochastic Optimization (SO) is a classical approach for optimization under uncertainty that typically requires knowledge about the probability distribution of uncertain parameters. As the latter is often unknown, Distributionally Robust…

This paper investigates group distributionally robust optimization (GDRO) with the goal of learning a model that performs well over $m$ different distributions. First, we formulate GDRO as a stochastic convex-concave saddle-point problem,…

Machine Learning · Computer Science 2024-11-21 Lijun Zhang , Haomin Bai , Peng Zhao , Tianbao Yang , Zhi-Hua Zhou

Offline reinforcement learning aims to learn from pre-collected datasets without active exploration. This problem faces significant challenges, including limited data availability and distributional shifts. Existing approaches adopt a…

Machine Learning · Computer Science 2024-10-01 Yue Wang , Jinjun Xiong , Shaofeng Zou

With the capacity to capture high-order collaborative signals, Graph Neural Networks (GNNs) have emerged as powerful methods in Recommender Systems (RS). However, their efficacy often hinges on the assumption that training and testing data…

Information Retrieval · Computer Science 2024-02-22 Bohao Wang , Jiawei Chen , Changdong Li , Sheng Zhou , Qihao Shi , Yang Gao , Yan Feng , Chun Chen , Can Wang

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

In the era of exceptionally data-hungry models, careful selection of the training data is essential to mitigate the extensive costs of deep learning. Data pruning offers a solution by removing redundant or uninformative samples from the…

Machine Learning · Computer Science 2025-02-11 Artem Vysogorets , Kartik Ahuja , Julia Kempe

Topology design is a critical task for the reliability, economic operation, and resilience of distribution systems. This paper proposes a distributionally robust optimization (DRO) model for designing the topology of a new distribution…

Optimization and Control · Mathematics 2018-08-29 Sadra Babaei , Ruiwei Jiang , Chaoyue Zhao

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

Machine Learning · Statistics 2024-12-31 Linglingzhi Zhu , Yao Xie

In this paper, we consider learning scenarios where the learned model is evaluated under an unknown test distribution which potentially differs from the training distribution (i.e. distribution shift). The learner has access to a family of…

Machine Learning · Computer Science 2022-02-14 Alekh Agarwal , Tong Zhang

Modern machine learning models may be susceptible to learning spurious correlations that hold on average but not for the atypical group of samples. To address the problem, previous approaches minimize the empirical worst-group risk. Despite…

Machine Learning · Computer Science 2023-03-13 Soumya Suvra Ghosal , Yixuan Li

We study the problem of learning a single neuron under standard squared loss in the presence of arbitrary label noise and group-level distributional shifts, for a broad family of covariate distributions. Our goal is to identify a…

Machine Learning · Computer Science 2026-01-27 Guyang Cao , Shuyao Li , Sushrut Karmalkar , Jelena Diakonikolas

Stochastic convex optimization algorithms are the most popular way to train machine learning models on large-scale data. Scaling up the training process of these models is crucial, but the most popular algorithm, Stochastic Gradient Descent…

Machine Learning · Statistics 2018-10-30 Ashok Cutkosky , Robert Busa-Fekete

We consider stochastic programs conditional on some covariate information, where the only knowledge of the possible relationship between the uncertain parameters and the covariates is reduced to a finite data sample of their joint…

Optimization and Control · Mathematics 2021-11-23 Adrián Esteban-Pérez , Juan M. Morales

Robust generalization aims to tackle the most challenging data distributions which are rare in the training set and contain severe noises, i.e., photon-limited corruptions. Common solutions such as distributionally robust optimization (DRO)…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zhuo Huang , Miaoxi Zhu , Xiaobo Xia , Li Shen , Jun Yu , Chen Gong , Bo Han , Bo Du , Tongliang Liu

Distributionally Robust Optimization (DRO) provides a framework for decision-making under distributional uncertainty, yet its effectiveness can be compromised by outliers in the training data. This paper introduces a principled approach to…

Machine Learning · Computer Science 2025-11-04 Shuyao Li , Ilias Diakonikolas , Jelena Diakonikolas

In recent years, there is a growing need to train machine learning models on a huge volume of data. Designing efficient distributed optimization algorithms for empirical risk minimization (ERM) has therefore become an active and challenging…

Optimization and Control · Mathematics 2019-11-19 Ching-pei Lee , Kai-Wei Chang

We propose RSO (random search optimization), a gradient free Markov Chain Monte Carlo search based approach for training deep neural networks. To this end, RSO adds a perturbation to a weight in a deep neural network and tests if it reduces…

Machine Learning · Computer Science 2020-05-13 Rohun Tripathi , Bharat Singh