English
Related papers

Related papers: Identifying Biased Subgroups in Ranking and Classi…

200 papers

We study statistical discrimination of individuals based on payoff-irrelevant social identities in markets that utilize ratings and recommendations for social learning. Even though rating/recommendation algorithms can be designed to be fair…

Computer Science and Game Theory · Computer Science 2024-11-11 Yeon-Koo Che , Kyungmin Kim , Weijie Zhong

A multitude of classifiers can be trained on the same data to achieve similar performances during test time, while having learned significantly different classification patterns. This phenomenon, which we call prediction discrepancies, is…

Machine Learning · Computer Science 2024-08-01 Xavier Renard , Thibault Laugel , Marcin Detyniecki

As Machine Learning models continue to be relied upon for making automated decisions, the issue of model bias becomes more and more prevalent. In this paper, we approach training a text classifica-tion model and optimize on bias…

Computation and Language · Computer Science 2019-08-19 Apik Ashod Zorian , Chandra Shekar Bikkanur

It has been rightfully emphasized that the use of AI for clinical decision making could amplify health disparities. An algorithm may encode protected characteristics, and then use this information for making predictions due to undesirable…

Machine Learning · Computer Science 2022-07-22 Ben Glocker , Charles Jones , Melanie Bernhardt , Stefan Winzeck

The ability to detect and adapt to changes in data distributions is crucial to maintain the accuracy and reliability of machine learning models. Detection is generally approached by observing the drift of model performance from a global…

Machine Learning · Computer Science 2025-05-22 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Complex statistical machine learning models are increasingly being used or considered for use in high-stakes decision-making pipelines in domains such as financial services, health care, criminal justice and human services. These models are…

Applications · Statistics 2017-07-04 Alexandra Chouldechova , Max G'Sell

The discovery of discriminatory bias in human or automated decision making is a task of increasing importance and difficulty, exacerbated by the pervasive use of machine learning and data mining. Currently, discrimination discovery largely…

Computers and Society · Computer Science 2019-11-05 Bilal Qureshi , Faisal Kamiran , Asim Karim , Salvatore Ruggieri , Dino Pedreschi

Machine learning (ML) models may suffer from significant performance disparities between patient groups. Identifying such disparities by monitoring performance at a granular level is crucial for safely deploying ML to each patient.…

Machine Learning · Computer Science 2025-03-14 Alceu Bissoto , Trung-Dung Hoang , Tim Flühmann , Susu Sun , Christian F. Baumgartner , Lisa M. Koch

Following related work in law and policy, two notions of disparity have come to shape the study of fairness in algorithmic decision-making. Algorithms exhibit treatment disparity if they formally treat members of protected subgroups…

Machine Learning · Statistics 2019-01-14 Zachary C. Lipton , Alexandra Chouldechova , Julian McAuley

Collective behaviours often need to be expressed through numerical features, e.g., for classification or imitation learning. This problem is often addressed by proposing an ad-hoc feature set for a particular swarm behaviour context,…

Robotics · Computer Science 2026-02-16 André Fialho Jesus , Jonas Kuckling

Classical learning theory suggests that the optimal generalization performance of a machine learning model should occur at an intermediate model complexity, with simpler models exhibiting high bias and more complex models exhibiting high…

Machine Learning · Statistics 2020-11-09 Ben Adlam , Jeffrey Pennington

It is widely recognized that deep neural networks are sensitive to bias in the data. This means that during training these models are likely to learn spurious correlations between data and labels, resulting in limited generalization…

Machine Learning · Computer Science 2024-12-06 Vito Paolo Pastore , Massimiliano Ciranni , Davide Marinelli , Francesca Odone , Vittorio Murino

Identifying and mitigating bias in deep learning algorithms has gained significant popularity in the past few years due to its impact on the society. Researchers argue that models trained on balanced datasets with good representation…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Puspita Majumdar , Surbhi Mittal , Richa Singh , Mayank Vatsa

Machine learning models often perform poorly on subgroups that are underrepresented in the training data. Yet, little is understood on the variation in mechanisms that cause subpopulation shifts, and how algorithms generalize across such…

Machine Learning · Computer Science 2023-08-21 Yuzhe Yang , Haoran Zhang , Dina Katabi , Marzyeh Ghassemi

Consider a collection of competing machine learning algorithms. Given their performance on a benchmark of datasets, we would like to identify the best performing algorithm. Specifically, which algorithm is most likely to rank highest on a…

Machine Learning · Computer Science 2025-08-08 Amichai Painsky

Often, what is termed algorithmic bias in machine learning will be due to historic bias in the training data. But sometimes the bias may be introduced (or at least exacerbated) by the algorithm itself. The ways in which algorithms can…

Machine Learning · Computer Science 2021-04-20 Padraig Cunningham , Sarah Jane Delany

While a broad range of techniques have been proposed to tackle distribution shift, the simple baseline of training on an $\textit{undersampled}$ balanced dataset often achieves close to state-of-the-art-accuracy across several popular…

Machine Learning · Computer Science 2023-06-21 Niladri S. Chatterji , Saminul Haque , Tatsunori Hashimoto

Fairness in machine learning has attained significant focus due to the widespread application in high-stake decision-making tasks. Unregulated machine learning classifiers can exhibit bias towards certain demographic groups in data, thus…

Machine Learning · Computer Science 2023-07-04 Bishwamittra Ghosh , Debabrota Basu , Kuldeep S. Meel

Decision making from data involves identifying a set of attributes that contribute to effective decision making through computational intelligence. The presence of missing values greatly influences the selection of right set of attributes…

Machine Learning · Computer Science 2013-07-23 M. Naresh Kumar

The main requisite for fine-grained recognition task is to focus on subtle discriminative details that make the subordinate classes different from each other. We note that existing methods implicitly address this requirement and leave it to…

Computer Vision and Pattern Recognition · Computer Science 2019-12-17 Guolei Sun , Hisham Cholakkal , Salman Khan , Fahad Shahbaz Khan , Ling Shao