English
Related papers

Related papers: Algorithms are not neutral: Bias in collaborative …

200 papers

Why do biased predictions arise? What interventions can prevent them? We evaluate 8.2 million algorithmic predictions of math performance from $\approx$400 AI engineers, each of whom developed an algorithm under a randomly assigned…

General Economics · Economics 2020-12-07 Bo Cowgill , Fabrizio Dell'Acqua , Samuel Deng , Daniel Hsu , Nakul Verma , Augustin Chaintreau

Advancements in machine learning have fuelled the popularity of using AI decision algorithms in procedures such as bail hearings (Feller et al. 2016), medical diagnoses (Rajkomar et al. 2018; Esteva et al. 2019) and recruitment (Heilweil…

Computers and Society · Computer Science 2022-10-18 Bram Vaassen

As algorithmic tools increasingly aid experts in making consequential decisions, the need to understand the precise factors that mediate their influence has grown commensurately. In this paper, we present a crowdsourcing vignette study…

Human-Computer Interaction · Computer Science 2022-05-20 Riccardo Fogliato , Sina Fazelpour , Shantanu Gupta , Zachary Lipton , David Danks

Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure…

Machine Learning · Computer Science 2021-06-01 Runshan Fu , Yangfan Liang , Peter Zhang

It has become trivial to point out how decision-making processes in various social, political and economical sphere are assisted by automated systems. Improved efficiency, the hallmark of these systems, drives the mass scale integration of…

Computers and Society · Computer Science 2019-12-17 Abeba Birhane , Fred Cummins

Often, what is termed algorithmic bias in machine learning will be due to historic bias in the training data. But sometimes the bias may be introduced (or at least exacerbated) by the algorithm itself. The ways in which algorithms can…

Machine Learning · Computer Science 2021-04-20 Padraig Cunningham , Sarah Jane Delany

Algorithmic fairness is a new interdisciplinary field of study focused on how to measure whether a process, or algorithm, may unintentionally produce unfair outcomes, as well as whether or how the potential unfairness of such processes can…

Theoretical Economics · Economics 2022-08-18 John W. Patty , Elizabeth Maggie Penn

Various metrics and interventions have been developed to identify and mitigate unfair outputs of machine learning systems. While individuals and organizations have an obligation to avoid discrimination, the use of fairness-aware machine…

Artificial Intelligence · Computer Science 2024-04-19 Hilde Weerts , Raphaële Xenidis , Fabien Tarissan , Henrik Palmer Olsen , Mykola Pechenizkiy

As Artificial Intelligence (AI) technologies proliferate, concern has centered around the long-term dangers of job loss or threats of machines causing harm to humans. All of this concern, however, detracts from the more pertinent and…

Artificial Intelligence · Computer Science 2018-09-24 Kirsten Lloyd

AI-based systems are widely employed nowadays to make decisions that have far-reaching impacts on individuals and society. Their decisions might affect everyone, everywhere and anytime, entailing concerns about potential human rights…

Current AI systems minimize risk by enforcing ideological neutrality, yet this may introduce automation bias by suppressing cognitive engagement in human decision-making. We conducted randomized trials with 2,500 participants to test…

Human-Computer Interaction · Computer Science 2025-08-21 Shiyang Lai , Junsol Kim , Nadav Kunievsky , Yujin Potter , James Evans

Although many fairness criteria have been proposed to ensure that machine learning algorithms do not exhibit or amplify our existing social biases, these algorithms are trained on datasets that can themselves be statistically biased. In…

Machine Learning · Computer Science 2023-05-04 Yiqiao Liao , Parinaz Naghizadeh

Artificial Intelligence (AI) has been used extensively in automatic decision making in a broad variety of scenarios, ranging from credit ratings for loans to recommendations of movies. Traditional design guidelines for AI models focus…

Artificial Intelligence · Computer Science 2018-09-27 Marisa Vasconcelos , Carlos Cardonha , Bernardo Gonçalves

Predictive modeling is increasingly being employed to assist human decision-makers. One purported advantage of replacing human judgment with computer models in high stakes settings-- such as sentencing, hiring, policing, college admissions,…

Machine Learning · Statistics 2016-10-27 Kristian Lum , James Johndrow

Currently, there is a surge of interest in fair Artificial Intelligence (AI) and Machine Learning (ML) research which aims to mitigate discriminatory bias in AI algorithms, e.g. along lines of gender, age, and race. While most research in…

Computers and Society · Computer Science 2021-07-29 Clarice Wang , Kathryn Wang , Andrew Bian , Rashidul Islam , Kamrun Naher Keya , James Foulds , Shimei Pan

Data-driven algorithms play a large role in decision making across a variety of industries. Increasingly, these algorithms are being used to make decisions that have significant ramifications for people's social and economic well-being,…

Machine Learning · Computer Science 2018-09-26 J. Henry Hinnefeld , Peter Cooman , Nat Mammo , Rupert Deese

We evaluate the folk wisdom that algorithmic decision rules trained on data produced by biased human decision-makers necessarily reflect this bias. We consider a setting where training labels are only generated if a biased decision-maker…

Machine Learning · Computer Science 2020-12-22 Ashesh Rambachan , Jonathan Roth

Ideologically homogeneous online environments - often described as "echo chambers" or "filter bubbles" - are widely seen as drivers of polarization, radicalization, and misinformation. A central debate asks whether such homophily stems…

Social and Information Networks · Computer Science 2025-08-15 Petter Törnberg

We investigate opinion dynamics and information spreading on networks under the influence of content filtering technologies. The filtering mechanism, present in many online social platforms, reduces individuals' exposure to disagreeing…

Physics and Society · Physics 2024-01-26 Antonio F. Peralta , János Kertész , Gerardo Iñiguez

Systems incorporating biometric technologies have become ubiquitous in personal, commercial, and governmental identity management applications. Both cooperative (e.g. access control) and non-cooperative (e.g. surveillance and forensics)…

Computers and Society · Computer Science 2021-03-08 P. Drozdowski , C. Rathgeb , A. Dantcheva , N. Damer , C. Busch