中文
相关论文

相关论文: Distributionally Robust Optimization with Bias and…

200 篇论文

We consider a minimax problem motivated by distributionally robust optimization (DRO) when the worst-case distribution is continuous, leading to significant computational challenges due to the infinite-dimensional nature of the optimization…

机器学习 · 统计学 2024-12-31 Linglingzhi Zhu , Yao Xie

A large class of stochastic programs involve optimizing an expectation taken with respect to an underlying distribution that is unknown in practice. One popular approach to addressing the distributional uncertainty, known as the…

最优化与控制 · 数学 2017-08-30 Di Wu , Helin Zhu , Enlu Zhou

In this study we analyze linear mixed-integer programming problems, in which the distribution of the cost vector is only observable through a finite training data set. In contrast to the related studies, we assume that the number of random…

最优化与控制 · 数学 2022-05-20 Sergey S. Ketkov , Andrei S. Shilov

The performance of machine learning (ML) models critically depends on the quality and representativeness of the training data. In applications with multiple heterogeneous data generating sources, standard ML methods often learn spurious…

Many machine learning algorithms minimize a regularized risk, and stochastic optimization is widely used for this task. When working with massive data, it is desirable to perform stochastic optimization in parallel. Unfortunately, many…

机器学习 · 统计学 2023-11-27 Shin Matsushima , Hyokun Yun , Xinhua Zhang , S. V. N. Vishwanathan

In data-driven optimization, sample average approximation (SAA) is known to suffer from the so-called optimizer's curse that causes an over-optimistic evaluation of the solution performance. We argue that a special type of distributionallly…

最优化与控制 · 数学 2023-10-13 Zhenyuan Liu , Bart P. G. Van Parys , Henry Lam

This paper studies the communication complexity of convex risk-averse optimization over a network. The problem generalizes the well-studied risk-neutral finite-sum distributed optimization problem and its importance stems from the need to…

最优化与控制 · 数学 2023-03-08 Guanghui Lan , Zhe Zhang

Stochastic gradient algorithms are the main focus of large-scale optimization problems and led to important successes in the recent advancement of the deep learning algorithms. The convergence of SGD depends on the careful choice of…

机器学习 · 计算机科学 2017-03-03 Caglar Gulcehre , Jose Sotelo , Marcin Moczulski , Yoshua Bengio

In the era of exceptionally data-hungry models, careful selection of the training data is essential to mitigate the extensive costs of deep learning. Data pruning offers a solution by removing redundant or uninformative samples from the…

机器学习 · 计算机科学 2025-02-11 Artem Vysogorets , Kartik Ahuja , Julia Kempe

We propose a distributionally robust formulation of the traditional risk parity portfolio optimization problem. Distributional robustness is introduced by targeting the discrete probabilities attached to each observation used during…

最优化与控制 · 数学 2021-10-14 Giorgio Costa , Roy H. Kwon

We consider optimal decision-making problems in an uncertain environment. In particular, we consider the case in which the distribution of the input is unknown, yet there is abundant historical data drawn from the distribution. In this…

最优化与控制 · 数学 2014-10-03 Zizhuo Wang , Peter Glynn , Yinyu Ye

A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models…

机器学习 · 计算机科学 2021-06-15 Chunting Zhou , Xuezhe Ma , Paul Michel , Graham Neubig

In recent years, Wasserstein Distributionally Robust Optimization (DRO) has garnered substantial interest for its efficacy in data-driven decision-making under distributional uncertainty. However, limited research has explored the…

机器学习 · 计算机科学 2025-10-01 Ahmad-Reza Ehyaei , Golnoosh Farnadi , Samira Samadi

Recent deep models for solving routing problems always assume a single distribution of nodes for training, which severely impairs their cross-distribution generalization ability. In this paper, we exploit group distributionally robust…

机器学习 · 计算机科学 2022-02-16 Yuan Jiang , Yaoxin Wu , Zhiguang Cao , Jie Zhang

Deep learning requires regularization mechanisms to reduce overfitting and improve generalization. We address this problem by a new regularization method based on distributional robust optimization. The key idea is to modify the…

We consider the problem of training a classification model with group annotated training data. Recent work has established that, if there is distribution shift across different groups, models trained using the standard empirical risk…

机器学习 · 计算机科学 2022-04-21 Vihari Piratla , Praneeth Netrapalli , Sunita Sarawagi

In this paper we wish to tackle stochastic programs affected by ambiguity about the probability law that governs their uncertain parameters. Using optimal transport theory, we construct an ambiguity set that exploits the knowledge about the…

最优化与控制 · 数学 2021-06-15 Adrián Esteban-Pérez , Juan M. Morales

The spectral risk has wide applications in machine learning, especially in real-world decision-making, where people are not only concerned with models' average performance. By assigning different weights to the losses of different sample…

最优化与控制 · 数学 2024-07-23 Yuze Ge , Rujun Jiang

We study the problem of learning-to-learn: inferring a learning algorithm that works well on tasks sampled from an unknown distribution. As class of algorithms we consider Stochastic Gradient Descent on the true risk regularized by the…

机器学习 · 计算机科学 2019-03-26 Giulia Denevi , Carlo Ciliberto , Riccardo Grazzi , Massimiliano Pontil

In domains such as finance, healthcare, and robotics, managing worst-case scenarios is critical, as failure to do so can lead to catastrophic outcomes. Distributional Reinforcement Learning (DRL) provides a natural framework to incorporate…

机器学习 · 计算机科学 2026-02-13 Mehrdad Moghimi , Hyejin Ku