English
Related papers

Related papers: Measuring Machine Learning Harms from Stereotypes …

200 papers

The widespread use of machine learning in credit scoring has brought significant advancements in risk assessment and decision-making. However, it has also raised concerns about potential biases, discrimination, and lack of transparency in…

Artificial intelligence (AI) systems can cause harm to people. This research examines how individuals react to such harm through the lens of blame. Building upon research suggesting that people blame AI systems, we investigated how several…

Computers and Society · Computer Science 2023-04-06 Gabriel Lima , Nina Grgić-Hlača , Meeyoung Cha

Fairness in machine learning has received considerable attention. However, most studies on fair learning focus on either supervised learning or unsupervised learning. Very few consider semi-supervised settings. Yet, in reality, most machine…

Machine Learning · Computer Science 2020-09-15 Tao Zhang , Tianqing Zhu , Mengde Han , Jing Li , Wanlei Zhou , Philip S. Yu

A growing specter in the rise of machine learning is whether the decisions made by machine learning models are fair. While research is already underway to formalize a machine-learning concept of fairness and to design frameworks for…

Machine Learning · Computer Science 2020-09-28 Tao Zhang , Tianqing Zhu , Jing Li , Mengde Han , Wanlei Zhou , Philip S. Yu

Recommender systems have become integral to digital experiences, shaping user interactions and preferences across various platforms. Despite their widespread use, these systems often suffer from algorithmic biases that can lead to unfair…

Information Retrieval · Computer Science 2024-09-12 Yongsu Ahn , Quinn K Wolter , Jonilyn Dick , Janet Dick , Yu-Ru Lin

Search Engines (SE) have been shown to perpetuate well-known gender stereotypes identified in psychology literature and to influence users accordingly. Similar biases were found encoded in Word Embeddings (WEs) learned from large online…

Computers and Society · Computer Science 2020-09-04 Alessandro Fabris , Alberto Purpura , Gianmaria Silvello , Gian Antonio Susto

Algorithmic decision-making (ADM) increasingly shapes people's daily lives. Given that such autonomous systems can cause severe harm to individuals and social groups, fairness concerns have arisen. A human-centric approach demanded by…

Human-Computer Interaction · Computer Science 2021-03-23 Christopher Starke , Janine Baleis , Birte Keller , Frank Marcinkowski

One of the difficulties of artificial intelligence is to ensure that model decisions are fair and free of bias. In research, datasets, metrics, techniques, and tools are applied to detect and mitigate algorithmic unfairness and bias. This…

Supervised machine learning utilizes large datasets, often with ground truth labels annotated by humans. While some data points are easy to classify, others are hard to classify, which reduces the inter-annotator agreement. This causes…

Human-Computer Interaction · Computer Science 2023-02-14 Andrea Papenmeier , Dagmar Kern , Daniel Hienert , Yvonne Kammerer , Christin Seifert

To reduce human error and prejudice, many high-stakes decisions have been turned over to machine algorithms. However, recent research suggests that this does not remove discrimination, and can perpetuate harmful stereotypes. While…

Computers and Society · Computer Science 2019-12-18 Yuzi He , Keith Burghardt , Kristina Lerman

Algorithms are now routinely used to make consequential decisions that affect human lives. Examples include college admissions, medical interventions or law enforcement. While algorithms empower us to harness all information hidden in vast…

Machine Learning · Computer Science 2020-12-10 Bahar Taskesen , Jose Blanchet , Daniel Kuhn , Viet Anh Nguyen

In the machine learning ecosystem, hardware selection is often regarded as a mere utility, overshadowed by the spotlight on algorithms and data. This oversight is particularly problematic in contexts like ML-as-a-service platforms, where…

Machine Learning · Computer Science 2024-09-04 Sree Harsha Nelaturu , Nishaanth Kanna Ravichandran , Cuong Tran , Sara Hooker , Ferdinando Fioretto

Controversies around race and machine learning have sparked debate among computer scientists over how to design machine learning systems that guarantee fairness. These debates rarely engage with how racial identity is embedded in our social…

Machine Learning · Computer Science 2018-11-29 Sebastian Benthall , Bruce D. Haynes

Machine learning algorithms increasingly influence our decisions and interact with us in all parts of our daily lives. Therefore, just as we consider the safety of power plants, highways, and a variety of other engineered socio-technical…

Computers and Society · Computer Science 2017-08-23 Kush R. Varshney , Homa Alemzadeh

Machine learning is a tool for building models that accurately represent input training data. When undesired biases concerning demographic groups are in the training data, well-trained models will reflect those biases. We present a…

Machine Learning · Computer Science 2018-01-25 Brian Hu Zhang , Blake Lemoine , Margaret Mitchell

Reliance on stereotypes is a persistent feature of human decision-making and has been extensively documented in educational settings, where it can shape students' confidence, performance, and long-term human capital accumulation. While…

General Economics · Economics 2025-03-05 Elisa Baldazzi , Pietro Biroli , Marina Della Giusta , Florent Dubois

Recent literature has suggested the potential of using large language models (LLMs) to make classifications for tabular tasks. However, LLMs have been shown to exhibit harmful social biases that reflect the stereotypes and inequalities…

Computation and Language · Computer Science 2024-04-04 Yanchen Liu , Srishti Gautam , Jiaqi Ma , Himabindu Lakkaraju

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

We investigate the effect of automatically generated counter-stereotypes on gender bias held by users of various demographics on social media. Building on recent NLP advancements and social psychology literature, we evaluate two…

Computers and Society · Computer Science 2025-10-28 Svetlana Kiritchenko , Anna Kerkhof , Isar Nejadgholi , Kathleen C. Fraser

This is an empirical study to investigate the impact of scanner effects when using machine learning on multi-site neuroimaging data. We utilize structural T1-weighted brain MRI obtained from two different studies, Cam-CAN and UK Biobank.…

Image and Video Processing · Electrical Eng. & Systems 2019-10-11 Ben Glocker , Robert Robinson , Daniel C. Castro , Qi Dou , Ender Konukoglu