English
Related papers

Related papers: Defining bias in AI-systems: Biased models are fai…

200 papers

With AI systems widely applied to assist humans in decision-making processes such as talent hiring, school admission, and loan approval; there is an increasing need to ensure that the decisions made are fair. One major challenge for…

Machine Learning · Computer Science 2026-05-05 Zhe Yu , Xiaoyin Xi , Pranam Prakash Shetty

Naively trained AI models can be heavily biased. This can be particularly problematic when the biases involve legally or morally protected attributes such as ethnic background, age or gender. Existing solutions to this problem come at the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Nicholas Rosa , Tom Drummond , Mehrtash Harandi

Artificial intelligence (AI) systems have the potential to revolutionize clinical practices, including improving diagnostic accuracy and surgical decision-making, while also reducing costs and manpower. However, it is important to recognize…

Artificial Intelligence · Computer Science 2024-09-18 Yifan Yang , Mingquan Lin , Han Zhao , Yifan Peng , Furong Huang , Zhiyong Lu

Artificial Intelligence has the potential to exacerbate societal bias and set back decades of advances in equal rights and civil liberty. Data used to train machine learning algorithms may capture social injustices, inequality or…

Computers and Society · Computer Science 2020-08-18 Susan Leavy , Barry O'Sullivan , Eugenia Siapera

Our society is plagued by several biases, including racial biases, caste biases, and gender bias. As a matter of fact, several years ago, most of these notions were unheard of. These biases passed through generations along with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Lavisha Aggarwal , Shruti Bhargava

Decisions made by various Artificial Intelligence (AI) systems greatly influence our day-to-day lives. With the increasing use of AI systems, it becomes crucial to know that they are fair, identify the underlying biases in their…

Computers and Society · Computer Science 2022-03-15 Avinash Agarwal , Harsh Agarwal , Nihaarika Agarwal

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Artificial intelligence surrogates are systems designed to infer preferences when individuals lose decision-making capacity. Fairness in such systems is a domain that has been insufficiently explored. Traditional algorithmic fairness…

Computers and Society · Computer Science 2025-10-21 Muhammad Aurangzeb Ahmad

Automated decision systems are increasingly used for consequential decision making -- for a variety of reasons. These systems often rely on sophisticated yet opaque models, which do not (or hardly) allow for understanding how or why a given…

Artificial Intelligence · Computer Science 2021-03-09 Jakob Schoeffer , Yvette Machowski , Niklas Kuehl

Machine learning models built on datasets containing discriminative instances attributed to various underlying factors result in biased and unfair outcomes. It's a well founded and intuitive fact that existing bias mitigation strategies…

Machine Learning · Computer Science 2022-10-25 Bhushan Chaudhari , Akash Agarwal , Tanmoy Bhowmik

Fairness has emerged as a critical consideration in the landscape of machine learning algorithms, particularly as AI continues to transform decision-making across societal domains. To ensure that these algorithms are free from bias and do…

Machine Learning · Statistics 2025-07-15 Tianhe Zhang , Suhan Liu , Peng Shi

With the increasing pervasive use of machine learning in social and economic settings, there has been an interest in the notion of machine bias in the AI community. Models trained on historic data reflect biases that exist in society and…

Machine Learning · Computer Science 2021-02-02 Kailash Karthik Saravanakumar

With increasing digitalization, Artificial Intelligence (AI) is becoming ubiquitous. AI-based systems to identify, optimize, automate, and scale solutions to complex economic and societal problems are being proposed and implemented. This…

As the use of artificial intelligence (AI) in high-stakes decision-making increases, the ability to contest such decisions is being recognised in AI ethics guidelines as an important safeguard for individuals. Yet, there is little guidance…

Human-Computer Interaction · Computer Science 2021-02-23 Henrietta Lyons , Eduardo Velloso , Tim Miller

We present an overview of the literature on trust in AI and AI trustworthiness and argue for the need to distinguish these concepts more clearly and to gather more empirically evidence on what contributes to people s trusting behaviours. We…

Artificial Intelligence · Computer Science 2023-09-20 Andreas Duenser , David M. Douglas

Fairness is increasingly recognized as a critical component of machine learning systems. However, it is the underlying data on which these systems are trained that often reflects discrimination, suggesting a data management problem. In this…

Databases · Computer Science 2019-10-02 Babak Salimi , Bill Howe , Dan Suciu

To study discrimination in automated decision-making systems, scholars have proposed several definitions of fairness, each expressing a different fair ideal. These definitions require practitioners to make complex decisions regarding which…

Computers and Society · Computer Science 2021-02-23 Kweku Kwegyir-Aggrey , Rebecca Santorella , Sarah M. Brown

Fairness is one of the most commonly identified ethical principles in existing AI guidelines, and the development of fair AI-enabled systems is required by new and emerging AI regulation. But most approaches to addressing the fairness of…

Ensuring fairness in decentralized multi-agent systems presents significant challenges due to emergent biases, systemic inefficiencies, and conflicting agent incentives. This paper provides a comprehensive survey of fairness in multi-agent…

Multiagent Systems · Computer Science 2025-03-04 Rajesh Ranjan , Shailja Gupta , Surya Narayan Singh

A recent flurry of research activity has attempted to quantitatively define "fairness" for decisions based on statistical and machine learning (ML) predictions. The rapid growth of this new field has led to wildly inconsistent terminology…

Applications · Statistics 2020-11-23 Shira Mitchell , Eric Potash , Solon Barocas , Alexander D'Amour , Kristian Lum