中文
相关论文

相关论文: Distributionally Robust Set Representation Learnin…

200 篇论文

Machine learning (ML) models trained using Empirical Risk Minimization (ERM) often exhibit systematic errors on specific subpopulations of tabular data, known as error slices. Learning robust representation in presence of error slices is…

机器学习 · 计算机科学 2025-11-10 Shantanu Ghosh , Tiankang Xie , Mikhail Kuznetsov

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

机器学习 · 计算机科学 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

We propose a distributionally robust approach to learning hyperparameters for first-order methods in convex optimization. Given a dataset of problem instances, we minimize a Wasserstein distributionally robust version of the performance…

机器学习 · 计算机科学 2026-05-08 Vinit Ranjan , Jisun Park , Bartolomeo Stellato

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

机器学习 · 统计学 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

Many machine learning models, such as logistic regression~(LR) and support vector machine~(SVM), can be formulated as composite optimization problems. Recently, many distributed stochastic optimization~(DSO) methods have been proposed to…

机器学习 · 统计学 2016-12-13 Shen-Yi Zhao , Ru Xiang , Ying-Hao Shi , Peng Gao , Wu-Jun Li

In large-scale distributed scenarios, increasingly complex tasks demand more intelligent collaboration across networks, requiring the joint extraction of structural representations from data samples. However, conventional task-specific…

机器学习 · 计算机科学 2026-04-21 Zhuojun Tian , Chaouki Ben Issaid , Mehdi Bennis

Despite their numerous successes, there are many scenarios where adversarial risk metrics do not provide an appropriate measure of robustness. For example, test-time perturbations may occur in a probabilistic manner rather than being…

机器学习 · 统计学 2021-08-03 Benjie Wang , Stefan Webb , Tom Rainforth

Distributed gradient descent algorithms have come to the fore in modern machine learning, especially in parallelizing the handling of large datasets that are distributed across several workers. However, scant attention has been paid to…

信号处理 · 电气工程与系统科学 2025-02-06 Shuche Wang , Vincent Y. F. Tan

Regularized estimators in the context of group variables have been applied successfully in model and feature selection in order to preserve interpretability. We formulate a Distributionally Robust Optimization (DRO) problem which recovers…

统计理论 · 数学 2017-05-12 Jose Blanchet , Yang Kang

Diffusion-based models have achieved notable empirical successes in reinforcement learning (RL) due to their expressiveness in modeling complex distributions. Despite existing methods being promising, the key challenge of extending existing…

机器学习 · 计算机科学 2024-11-04 Dmitry Shribak , Chen-Xiao Gao , Yitong Li , Chenjun Xiao , Bo Dai

Gaussian Graphical Models (GGMs) are widely used to infer conditional dependence structures in high-dimensional data. However, standard precision matrix estimators are highly sensitive to data contamination, such as extreme outliers and…

应用统计 · 统计学 2026-03-25 Canruo Shen , Xintong Ji , Qiong Li , Wenzhi Yang , Xiaoping Shi

Robust generalization aims to tackle the most challenging data distributions which are rare in the training set and contain severe noises, i.e., photon-limited corruptions. Common solutions such as distributionally robust optimization (DRO)…

计算机视觉与模式识别 · 计算机科学 2023-03-24 Zhuo Huang , Miaoxi Zhu , Xiaobo Xia , Li Shen , Jun Yu , Chen Gong , Bo Han , Bo Du , Tongliang Liu

We consider a machine learning setup where one training dataset is used to train multiple models across slightly different data distributions. This occurs when customized models are needed for various deployment environments. To reduce…

Route planning is essential to mobile robot navigation problems. In recent years, deep reinforcement learning (DRL) has been applied to learning optimal planning policies in stochastic environments without prior knowledge. However, existing…

机器人学 · 计算机科学 2023-04-21 Xi Lin , Paul Szenher , John D. Martin , Brendan Englot

Data corruption, including missing and noisy data, poses significant challenges in real-world machine learning. This study investigates the effects of data corruption on model performance and explores strategies to mitigate these effects…

机器学习 · 计算机科学 2025-05-22 Qi Liu , Wanjing Ma

It is known that the set of perturbed data is key in robust optimization (RO) modelling. Distributionally robust optimization (DRO) is a methodology used for optimization problems affected by random parameters with uncertain probability…

最优化与控制 · 数学 2022-05-09 Yueyao Li , Wenxun Xing

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

机器学习 · 统计学 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing…

机器学习 · 统计学 2024-04-02 Qi Zhang , Yi Zhou , Ashley Prater-Bennette , Lixin Shen , Shaofeng Zou

Modern machine learning models may be susceptible to learning spurious correlations that hold on average but not for the atypical group of samples. To address the problem, previous approaches minimize the empirical worst-group risk. Despite…

机器学习 · 计算机科学 2023-03-13 Soumya Suvra Ghosal , Yixuan Li

Many machine learning tasks involve subpopulation shift where the testing data distribution is a subpopulation of the training distribution. For such settings, a line of recent work has proposed the use of a variant of empirical risk…

机器学习 · 计算机科学 2021-06-14 Runtian Zhai , Chen Dan , J. Zico Kolter , Pradeep Ravikumar