English
Related papers

Related papers: Understanding Bias in Machine Learning

200 papers

Machine learning models often inherit biases from historical data, raising critical concerns about fairness and accountability. Conventional fairness interventions typically require access to sensitive attributes like gender or race, but…

Machine Learning · Statistics 2026-04-21 Yixiao Lin , James Booth

Building on the view of machine learning as search, we demonstrate the necessity of bias in learning, quantifying the role of bias (measured relative to a collection of possible datasets, or more generally, information resources) in…

Machine Learning · Computer Science 2019-07-16 George D. Montanez , Jonathan Hayase , Julius Lauw , Dominique Macias , Akshay Trikha , Julia Vendemiatti

Concerns regarding fairness and bias have been raised in recent years due to the growing use of machine learning models in crucial decision-making processes, especially when it comes to delicate characteristics like gender. In order to…

Machine Learning · Computer Science 2024-08-30 Saish Shinde

The widespread use of machine learning and data-driven algorithms for decision making has been steadily increasing over many years. \emph{Bias} in the data can adversely affect this decision-making. We present a new mitigation strategy to…

Machine Learning · Computer Science 2025-07-25 Bruno Scarone , Alfredo Viola , Renée J. Miller , Ricardo Baeza-Yates

Often, what is termed algorithmic bias in machine learning will be due to historic bias in the training data. But sometimes the bias may be introduced (or at least exacerbated) by the algorithm itself. The ways in which algorithms can…

Machine Learning · Computer Science 2021-04-20 Padraig Cunningham , Sarah Jane Delany

The underlying paradigm of big data-driven machine learning reflects the desire of deriving better conclusions from simply analyzing more data, without the necessity of looking at theory and models. Is having simply more data always…

Machine Learning · Computer Science 2018-03-05 Patrick Glauner , Petko Valtchev , Radu State

Machine learned models exhibit bias, often because the datasets used to train them are biased. This presents a serious problem for the deployment of such technology, as the resulting models might perform poorly on populations that are…

Machine Learning · Computer Science 2018-10-02 Daniel McDuff , Roger Cheng , Ashish Kapoor

Artificial Intelligence has the capacity to amplify and perpetuate societal biases and presents profound ethical implications for society. Gender bias has been identified in the context of employment advertising and recruitment tools, due…

Computation and Language · Computer Science 2020-05-19 Susan Leavy , Gerardine Meaney , Karen Wade , Derek Greene

Human biases have been shown to influence the performance of models and algorithms in various fields, including Natural Language Processing. While the study of this phenomenon is garnering focus in recent years, the available resources are…

Computation and Language · Computer Science 2024-08-15 Ana Sofia Evans , Helena Moniz , Luísa Coheur

The widespread adoption of Machine Learning systems, especially in more decision-critical applications such as criminal sentencing and bank loans, has led to increased concerns about fairness implications. Algorithms and metrics have been…

Machine Learning · Computer Science 2023-08-15 Usman Gohar , Lu Cheng

Machine Learning seeks to identify and encode bodies of knowledge within provided datasets. However, data encodes subjective content, which determines the possible outcomes of the models trained on it. Because such subjectivity enables…

Artificial Intelligence · Computer Science 2021-01-29 Zeerak Waseem , Smarika Lulz , Joachim Bingel , Isabelle Augenstein

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

Human perception, memory and decision-making are impacted by tens of cognitive biases and heuristics that influence our actions and decisions. Despite the pervasiveness of such biases, they are generally not leveraged by today's Artificial…

Human-Computer Interaction · Computer Science 2023-12-04 Aditya Gulati , Miguel Angel Lozano , Bruno Lepri , Nuria Oliver

With the widespread and pervasive use of Artificial Intelligence (AI) for automated decision-making systems, AI bias is becoming more apparent and problematic. One of its negative consequences is discrimination: the unfair, or unequal…

Computers and Society · Computer Science 2021-06-07 Xavier Ferrer , Tom van Nuenen , Jose M. Such , Mark Coté , Natalia Criado

Machine learning based systems are reaching society at large and in many aspects of everyday life. This phenomenon has been accompanied by concerns about the ethical issues that may arise from the adoption of these technologies. ML fairness…

Machine Learning · Computer Science 2021-01-01 Luca Oneto , Silvia Chiappa

As quantum machine learning (QML) emerges as a promising field at the intersection of quantum computing and artificial intelligence, it becomes crucial to address the biases and challenges that arise from the unique nature of quantum…

Quantum Physics · Physics 2024-10-01 Nandhini Swaminathan , David Danks

This paper stresses the importance of biases in the field of artificial intelligence (AI) in two regards. First, in order to foster efficient algorithmic decision-making in complex, unstable, and uncertain real-world environments, we argue…

Machine Learning · Computer Science 2023-02-15 Sarah Fabi , Thilo Hagendorff

Machine learning algorithms are routinely used for business decisions that may directly affect individuals, for example, because a credit scoring algorithm refuses them a loan. It is then relevant from an ethical (and legal) point of view…

Machine Learning · Statistics 2025-10-06 Roberta Pappadà , Francesco Pauli

In machine learning, a bias occurs whenever training sets are not representative for the test data, which results in unreliable models. The most common biases in data are arguably class imbalance and covariate shift. In this work, we aim to…

Machine Learning · Computer Science 2018-04-04 Patrick Glauner , Radu State , Petko Valtchev , Diogo Duarte

The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to incorporate biases embedded within. A biased model can then make decisions that disproportionately harm certain groups in society. Much…

Machine Learning · Computer Science 2022-06-28 José Pombal , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro