English
Related papers

Related papers: Improving Minimax Group Fairness in Sequential Rec…

200 papers

Distributionally robust optimization (DRO) can improve the robustness and fairness of learning methods. In this paper, we devise stochastic algorithms for a class of DRO problems including group DRO, subpopulation fairness, and empirical…

Machine Learning · Computer Science 2025-02-03 Tasuku Soma , Khashayar Gatmiry , Sharut Gupta , Stefanie Jegelka

We consider the problem of training a classification model with group annotated training data. Recent work has established that, if there is distribution shift across different groups, models trained using the standard empirical risk…

Machine Learning · Computer Science 2022-04-21 Vihari Piratla , Praneeth Netrapalli , Sunita Sarawagi

Recommender systems play an essential role in online services by providing personalized item lists to support users' decision-making processes. While collaborative filtering methods can achieve high accuracy, it is crucial to consider not…

Optimization and Control · Mathematics 2026-03-24 Tomoya Yanagi , Shunnosuke Ikeda , Ken Kobayashi , Yuichi Takano

Sequential recommendation (SR) models are typically trained on user-item interactions which are affected by the system exposure bias, leading to the user preference learned from the biased SR model not being fully consistent with the true…

Information Retrieval · Computer Science 2023-12-13 Jiyuan Yang , Yue Ding , Yidan Wang , Pengjie Ren , Zhumin Chen , Fei Cai , Jun Ma , Rui Zhang , Zhaochun Ren , Xin Xin

Knowledge distillation enables fast and effective transfer of features learned from a bigger model to a smaller one. However, distillation objectives are susceptible to sub-population shifts, a common scenario in medical imaging analysis…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Konstantinos Vilouras , Xiao Liu , Pedro Sanchez , Alison Q. O'Neil , Sotirios A. Tsaftaris

Overparameterized neural networks can be highly accurate on average on an i.i.d. test set yet consistently fail on atypical groups of the data (e.g., by learning spurious correlations that hold on average but not in such groups).…

Machine Learning · Computer Science 2020-04-03 Shiori Sagawa , Pang Wei Koh , Tatsunori B. Hashimoto , Percy Liang

Modern deep learning models often achieve high overall performance, but consistently fail on specific subgroups. Group distributionally robust optimization (group DRO) addresses this problem by minimizing the worst-group loss, but it fails…

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

Machine Learning · Computer Science 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

Machine Learning · Statistics 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Distributionally robust optimization (DRO) is a widely-used approach to learn models that are robust against distribution shift. Compared with the standard optimization setting, the objective function in DRO is more difficult to optimize,…

Machine Learning · Computer Science 2021-10-27 Jikai Jin , Bohang Zhang , Haiyang Wang , Liwei Wang

Models trained with empirical risk minimization (ERM) are revealed to easily rely on spurious correlations, resulting in poor generalization. Group distributionally robust optimization (group DRO) can alleviate this problem by minimizing…

Computation and Language · Computer Science 2023-05-23 Ting Wu , Rui Zheng , Tao Gui , Qi Zhang , Xuanjing Huang

Distribution shifts and minority subpopulations frequently undermine the reliability of deep neural networks trained using Empirical Risk Minimization (ERM). Distributionally Robust Optimization (DRO) addresses this by optimizing for the…

Machine Learning · Computer Science 2025-11-11 Aheer Sravon , Devdyuti Mazumder , Md. Ibrahim

To ensure a successful bid while maximizing of profits, generation companies (GENCOs) need a self-scheduling strategy that can cope with a variety of scenarios. So distributionally robust opti-mization (DRO) is a good choice because that it…

Optimization and Control · Mathematics 2021-05-05 Linfeng Yang , Ying Yang , Guo Chen , Zhaoyang Dong

Training machine learning models robust to distribution shifts is critical for real-world applications. Some robust training algorithms (e.g., Group DRO) specialize to group shifts and require group information on all training points. Other…

Machine Learning · Computer Science 2023-10-13 Amrith Setlur , Don Dennis , Benjamin Eysenbach , Aditi Raghunathan , Chelsea Finn , Virginia Smith , Sergey Levine

A central goal of machine learning is to learn robust representations that capture the causal relationship between inputs features and output labels. However, minimizing empirical risk over finite or biased datasets often results in models…

Machine Learning · Computer Science 2021-06-15 Chunting Zhou , Xuezhe Ma , Paul Michel , Graham Neubig

Machine learning models are often required to perform well across several pre-defined settings, such as a set of user groups. Worst-case performance is a common metric to capture this requirement, and is the objective of group…

Machine Learning · Computer Science 2025-02-27 Anvith Thudi , Chris J. Maddison

Many existing group fairness-aware training methods aim to achieve the group fairness by either re-weighting underrepresented groups based on certain rules or using weakly approximated surrogates for the fairness metrics in the objective as…

Machine Learning · Computer Science 2023-03-02 Sangwon Jung , Taeeon Park , Sanghyuk Chun , Taesup Moon

In this paper, we propose a practical online method for solving a class of distributionally robust optimization (DRO) with non-convex objectives, which has important applications in machine learning for improving the robustness of neural…

Machine Learning · Computer Science 2021-11-15 Qi Qi , Zhishuai Guo , Yi Xu , Rong Jin , Tianbao Yang

Stochastic and (distributionally) robust optimization problems often become computationally challenging as the number of scenarios or data points increases. Scenario reduction is therefore a key technique for improving tractability. We…

Optimization and Control · Mathematics 2026-03-10 Kevin-Martin Aigner , Sebastian Denzler , Frauke Liers , Sebastian Pokutta , Kartikey Sharma

Recent work has shown that standard training via empirical risk minimization (ERM) can produce models that achieve high accuracy on average but low accuracy on underrepresented groups due to the prevalence of spurious features. A…

Machine Learning · Computer Science 2023-05-11 Yachuan Liu , Bohan Zhang , Qiaozhu Mei , Paramveer Dhillon
‹ Prev 1 2 3 10 Next ›