English
Related papers

Related papers: Improving Robustness to Multiple Spurious Correlat…

200 papers

Recent works in multiple object tracking use sequence model to calculate the similarity score between the detections and the previous tracklets. However, the forced exposure to ground-truth in the training stage leads to the…

Computer Vision and Pattern Recognition · Computer Science 2020-03-06 Tao Hu , Lichao Huang , Han Shen

Machine learning (ML) methods offer a wide range of configurable hyperparameters that have a significant influence on their performance. While accuracy is a commonly used performance objective, in many settings, it is not sufficient.…

Machine Learning · Computer Science 2023-09-27 Romain Egele , Tyler Chang , Yixuan Sun , Venkatram Vishwanath , Prasanna Balaprakash

Multi-task learning solves multiple correlated tasks. However, conflicts may exist between them. In such circumstances, a single solution can rarely optimize all the tasks, leading to performance trade-offs. To arrive at a set of optimized…

Artificial Intelligence · Computer Science 2024-03-26 Lu Bai , Abhishek Gupta , Yew-Soon Ong

Datasets can be biased due to societal inequities, human biases, under-representation of minorities, etc. Our goal is to certify that models produced by a learning algorithm are pointwise-robust to potential dataset biases. This is a…

Machine Learning · Computer Science 2021-10-12 Anna P. Meyer , Aws Albarghouthi , Loris D'Antoni

Mislabeled, duplicated, or biased data in real-world scenarios can lead to prolonged training and even hinder model convergence. Traditional solutions prioritizing easy or hard samples lack the flexibility to handle such a variety…

Machine Learning · Computer Science 2023-11-08 Zhijie Deng , Peng Cui , Jun Zhu

A critical problem in deep learning is that systems learn inappropriate biases, resulting in their inability to perform well on minority groups. This has led to the creation of multiple algorithms that endeavor to mitigate bias. However, it…

Machine Learning · Computer Science 2024-04-24 Robik Shrestha , Kushal Kafle , Christopher Kanan

In this work we formulate and formally characterize group fairness as a multi-objective optimization problem, where each sensitive group risk is a separate objective. We propose a fairness criterion where a classifier achieves minimax risk…

Machine Learning · Statistics 2020-11-04 Natalia Martinez , Martin Bertran , Guillermo Sapiro

Many machine learning algorithms are trained and evaluated by splitting data from a single source into training and test sets. While such focus on in-distribution learning scenarios has led to interesting advancement, it has not been able…

Computer Vision and Pattern Recognition · Computer Science 2020-07-02 Hyojin Bahng , Sanghyuk Chun , Sangdoo Yun , Jaegul Choo , Seong Joon Oh

Beam parameter optimization in accelerators involves multiple, sometimes competing objectives. Condensing these individual objectives into a single figure of merit unavoidably results in a bias towards particular outcomes, in absence of…

Accelerator Physics · Physics 2022-12-26 Faran Irshad , Stefan Karsch , Andreas Döpp

Recent research has revealed that deep neural networks often take dataset biases as a shortcut to make decisions rather than understand tasks, leading to failures in real-world applications. In this study, we focus on the spurious…

Computation and Language · Computer Science 2023-06-23 Yanrui Du , Jing Yan , Yan Chen , Jing Liu , Sendong Zhao , Qiaoqiao She , Hua Wu , Haifeng Wang , Bing Qin

In recommender systems, a common problem is the presence of various biases in the collected data, which deteriorates the generalization ability of the recommendation models and leads to inaccurate predictions. Doubly robust (DR) learning…

Information Retrieval · Computer Science 2022-12-20 Haoxuan Li , Quanyu Dai , Yuru Li , Yan Lyu , Zhenhua Dong , Xiao-Hua Zhou , Peng Wu

Different conflicting optimization criteria arise naturally in various Deep Learning scenarios. These can address different main tasks (i.e., in the setting of Multi-Task Learning), but also main and secondary tasks such as loss…

Machine Learning · Computer Science 2024-03-27 S. S. Hotegni , M. Berkemeier , S. Peitz

Addressing biases in AI models is crucial for ensuring fair and accurate predictions. However, obtaining large, unbiased datasets for training can be challenging. This paper proposes a comprehensive approach using multiple methods to remove…

Machine Learning · Computer Science 2024-02-15 Ahmed Radwan , Layan Zaafarani , Jetana Abudawood , Faisal AlZahrani , Fares Fourati

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Shortcut mitigation strategies commonly rely on training data annotations, group-balanced held-out data or the presence of all groups, i.e., all combinations of (spurious) attributes and classes, in the training data. However, these…

Machine Learning · Computer Science 2026-05-14 Phuong Quynh Le , Jörg Schlötterer , Sari Sadiya , Gemma Roig , Christin Seifert

Improving the fairness of machine learning models is a nuanced task that requires decision makers to reason about multiple, conflicting criteria. The majority of fair machine learning methods transform the error-fairness trade-off into a…

Neural and Evolutionary Computing · Computer Science 2023-04-25 William G. La Cava

To date, the multi-objective optimization literature has mainly focused on conflicting objectives, studying the Pareto front, or requiring users to balance tradeoffs. Yet, in machine learning practice, there are many scenarios where such…

Machine Learning · Computer Science 2025-03-05 Yonathan Efroni , Ben Kretzu , Daniel Jiang , Jalaj Bhandari , Zheqing , Zhu , Karen Ullrich

Meta-learning methods aim to build learning algorithms capable of quickly adapting to new tasks in low-data regime. One of the most difficult benchmarks of such algorithms is a one-shot learning problem. In this setting many algorithms face…

Machine Learning · Computer Science 2022-10-04 Andrei Boiarov , Kostiantyn Khabarlak , Igor Yastrebov

We study the problem of multiple kernel learning from noisy labels. This is in contrast to most of the previous studies on multiple kernel learning that mainly focus on developing efficient algorithms and assume perfectly labeled training…

Machine Learning · Computer Science 2012-06-22 Tianbao Yang , Mehrdad Mahdavi , Rong Jin , Lijun Zhang , Yang Zhou

Unsupervised feature selection is commonly formulated as a multiobjective optimisation problem that jointly optimises subset quality and subset size. Yet the behaviour of this formulation depends critically on the choice of evaluation…

Machine Learning · Computer Science 2026-05-22 Mathieu Cherpitel , Thomas Bäck , Martijn R. Tannemaat , Anna V. Kononova