中文
相关论文

相关论文: MixMax: Distributional Robustness in Function Spac…

200 篇论文

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

最优化与控制 · 数学 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

Regularized estimators in the context of group variables have been applied successfully in model and feature selection in order to preserve interpretability. We formulate a Distributionally Robust Optimization (DRO) problem which recovers…

统计理论 · 数学 2017-05-12 Jose Blanchet , Yang Kang

Distributionally robust optimization (DRO) is a powerful technique to train robust models against data distribution shift. This paper aims to solve regularized nonconvex DRO problems, where the uncertainty set is modeled by a so-called…

最优化与控制 · 数学 2025-06-30 Yufeng Yang , Yi Zhou , Zhaosong Lu

Managing insurance and financial risk when data is limited is a key task in the insurance industry. In this paper, we focus on cases where the risk distribution is modeled as a mixture with some components estimable to high precision or…

最优化与控制 · 数学 2026-03-03 N. D. Shyamalkumar , Tianrun Wang

Distributionally robust optimization (DRO) has attracted attention in machine learning due to its connections to regularization, generalization, and robustness. Existing work has considered uncertainty sets based on phi-divergences and…

机器学习 · 计算机科学 2019-05-28 Matthew Staib , Stefanie Jegelka

Many existing group fairness-aware training methods aim to achieve the group fairness by either re-weighting underrepresented groups based on certain rules or using weakly approximated surrogates for the fairness metrics in the objective as…

机器学习 · 计算机科学 2023-03-02 Sangwon Jung , Taeeon Park , Sanghyuk Chun , Taesup Moon

For many machine learning models, a choice of hyperparameters is a crucial step towards achieving high performance. Prevalent meta-learning approaches focus on obtaining good hyperparameters configurations with a limited computational…

机器学习 · 计算机科学 2022-01-31 Katarzyna Woźnica , Mateusz Grzyb , Zuzanna Trafas , Przemysław Biecek

As machine learning models are deployed ever more broadly, it becomes increasingly important that they are not only able to perform well on their training distribution, but also yield accurate predictions when confronted with distribution…

机器学习 · 计算机科学 2022-04-14 Paul Michel , Tatsunori Hashimoto , Graham Neubig

Training sequential recommenders such as SASRec with uniform sample weights achieves good overall performance but can fall short on specific user groups. One such example is popularity bias, where mainstream users receive better…

信息检索 · 计算机科学 2025-01-31 Krishna Acharya , David Wardrope , Timos Korres , Aleksandr Petrov , Anders Uhrenholt

Recently, (Blanchet, Kang, and Murhy 2016, and Blanchet, and Kang 2017) showed that several machine learning algorithms, such as square-root Lasso, Support Vector Machines, and regularized logistic regression, among many others, can be…

机器学习 · 统计学 2020-02-25 Jose Blanchet , Yang Kang , Fan Zhang , Karthyek Murthy

Models trained with empirical risk minimization (ERM) are revealed to easily rely on spurious correlations, resulting in poor generalization. Group distributionally robust optimization (group DRO) can alleviate this problem by minimizing…

计算与语言 · 计算机科学 2023-05-23 Ting Wu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Distributionally robust optimization (DRO) has become a powerful framework for estimation under uncertainty, offering strong out-of-sample performance and principled regularization. In this paper, we propose a DRO-based method for linear…

机器学习 · 统计学 2025-05-06 Liviu Aolaritei , Soroosh Shafiee , Florian Dörfler

Training machine learning models robust to distribution shifts is critical for real-world applications. Some robust training algorithms (e.g., Group DRO) specialize to group shifts and require group information on all training points. Other…

It is essential to capture the true probability distribution of uncertain data in the distributionally robust optimization (DRO). The uncertain data presents multimodality in numerous application scenarios, in the sense that the probability…

最优化与控制 · 数学 2024-03-14 Yueyao Li , Chenglong Bao , Wenxun Xing

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

最优化与控制 · 数学 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

Single-level reformulations of (non-convex) distributionally robust optimization (DRO) problems are often intractable, as they contain semiinfinite dual constraints. Based on such a semiinfinite reformulation, we present a safe…

最优化与控制 · 数学 2025-06-09 J. Dienstbier , F. Liers , J. Rolfes

Distributionally robust optimization (DRO) is a powerful framework for training robust models against data distribution shifts. This paper focuses on constrained DRO, which has an explicit characterization of the robustness level. Existing…

机器学习 · 统计学 2024-04-02 Qi Zhang , Yi Zhou , Ashley Prater-Bennette , Lixin Shen , Shaofeng Zou

While traditional distributionally robust optimization (DRO) aims to minimize the maximal risk over a set of distributions, Agarwal and Zhang (2022) recently proposed a variant that replaces risk with excess risk. Compared to DRO, the new…

最优化与控制 · 数学 2024-05-29 Lijun Zhang , Haomin Bai , Wei-Wei Tu , Ping Yang , Yao Hu

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

计算机视觉与模式识别 · 计算机科学 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Ch. Paschalidis

We develop a Distributionally Robust Optimization (DRO) formulation for Multiclass Logistic Regression (MLR), which could tolerate data contaminated by outliers. The DRO framework uses a probabilistic ambiguity set defined as a ball of…

机器学习 · 统计学 2023-03-28 Ruidi Chen , Boran Hao , Ioannis Paschalidis