English
Related papers

Related papers: Measuring Machine Learning Harms from Stereotypes …

200 papers

Machine learning models trained on real-world data may inadvertently make biased predictions that negatively impact marginalized communities. Reweighting, which assigns a weight to each data point used during model training, can mitigate…

Machine Learning · Computer Science 2026-03-20 Anil K. Saini , Jose Guadalupe Hernandez , Emily F. Wong , Debanshi Misra , Tiffani J. Bright , Jason H. Moore

The widespread adoption of automatic sentiment and emotion classifiers makes it important to ensure that these tools perform reliably across different populations. Yet their reliability is typically assessed using benchmarks that rely on…

Computation and Language · Computer Science 2026-01-09 Ivan Smirnov , Segun T. Aroyehun , Paul Plener , David Garcia

Does everyone equally benefit from computer vision systems? Answers to this question become more and more important as computer vision systems are deployed at large scale, and can spark major concerns when they exhibit vast performance…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Priya Goyal , Adriana Romero Soriano , Caner Hazirbas , Levent Sagun , Nicolas Usunier

Machine learning models can inherit biases from their training data, leading to discriminatory or inaccurate predictions. This is particularly concerning with the increasing use of large, unsupervised datasets for training foundational…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Iris Dominguez-Catena , Daniel Paternain , Aranzazu Jurio , Mikel Galar

The definition and implementation of fairness in automated decisions has been extensively studied by the research community. Yet, there hides fallacious reasoning, misleading assertions, and questionable practices at the foundations of the…

Computers and Society · Computer Science 2023-06-05 Robert Lee Poe , Soumia Zohra El Mestari

Machine learning algorithms are increasingly used to inform critical decisions. There is a growing concern about bias, that algorithms may produce uneven outcomes for individuals in different demographic groups. In this work, we measure…

Machine Learning · Computer Science 2021-06-01 Runshan Fu , Yangfan Liang , Peter Zhang

Over the past decade, the machine learning security community has developed a myriad of defenses for evasion attacks. An understudied question in that community is: for whom do these defenses defend? This work considers common approaches to…

Machine Learning · Computer Science 2023-08-24 Luke E. Richards , Edward Raff , Cynthia Matuszek

Motivated by concerns surrounding the fairness effects of sharing and transferring fair machine learning tools, we propose two algorithms: Fairness Warnings and Fair-MAML. The first is a model-agnostic algorithm that provides interpretable…

Machine Learning · Computer Science 2019-12-06 Dylan Slack , Sorelle Friedler , Emile Givental

Algorithmic fairness has emphasized the role of biased data in automated decision outcomes. Recently, there has been a shift in attention to sources of bias that implicate fairness in other stages in the ML pipeline. We contend that one…

Machine Learning · Computer Science 2021-09-09 Jessica Zosa Forde , A. Feder Cooper , Kweku Kwegyir-Aggrey , Chris De Sa , Michael Littman

Cutting-edge image generation has been praised for producing high-quality images, suggesting a ubiquitous future in a variety of applications. However, initial studies have pointed to the potential for harm due to predictive bias,…

Computation and Language · Computer Science 2023-05-29 Eddie L. Ungless , Björn Ross , Anne Lauscher

Machine learning has seen an increase in negative publicity in recent years, due to biased, unfair, and uninterpretable models. There is a rising interest in making machine learning models more fair for unprivileged communities, such as…

Machine Learning · Computer Science 2022-11-22 Yochem van Rosmalen , Florian van der Steen , Sebastiaan Jans , Daan van der Weijden

Systems aiming to aid consumers in their decision-making (e.g., by implementing persuasive techniques) are more likely to be effective when consumers trust them. However, recent research has demonstrated that the machine learning algorithms…

Human-Computer Interaction · Computer Science 2021-07-06 Tim Draws , Zoltán Szlávik , Benjamin Timmermans , Nava Tintarev , Kush R. Varshney , Michael Hind

Fairness in machine learning (ML) has become a rapidly growing area of research. But why, in the first place, is unfairness in ML wrong? And why should we care about improving fairness? Most fair-ML research implicitly appeals to…

Machine Learning · Computer Science 2026-02-27 Youjin Kong

The field of automated machine learning (AutoML) introduces techniques that automate parts of the development of machine learning (ML) systems, accelerating the process and reducing barriers for novices. However, decisions derived from ML…

Large-scale Pre-Trained Language Models (PTLMs) capture knowledge from massive human-written data which contains latent societal biases and toxic contents. In this paper, we leverage the primary task of PTLMs, i.e., language modeling, and…

Computation and Language · Computer Science 2023-01-24 Saghar Hosseini , Hamid Palangi , Ahmed Hassan Awadallah

Behavioral sensing technologies are rapidly evolving across a range of well-being applications. Despite its potential, concerns about the responsible use of such technology are escalating. In response, recent research within the sensing…

Human-Computer Interaction · Computer Science 2024-05-07 Han Zhang , Vedant Das Swain , Leijie Wang , Nan Gao , Yilun Sheng , Xuhai Xu , Flora D. Salim , Koustuv Saha , Anind K. Dey , Jennifer Mankoff

Machine learning algorithms are increasingly deployed in critical domains such as finance, healthcare, and criminal justice [1]. The increasing popularity of algorithmic decision-making has stimulated interest in algorithmic fairness within…

Machine Learning · Computer Science 2025-11-18 Animesh Joshi

Machine learning based systems are reaching society at large and in many aspects of everyday life. This phenomenon has been accompanied by concerns about the ethical issues that may arise from the adoption of these technologies. ML fairness…

Machine Learning · Computer Science 2021-01-01 Luca Oneto , Silvia Chiappa

Language models encode and subsequently perpetuate harmful gendered stereotypes. Research has succeeded in mitigating some of these harms, e.g. by dissociating non-gendered terms such as occupations from gendered terms such as 'woman' and…

Computation and Language · Computer Science 2025-05-21 Franziska Sofia Hafner , Ana Valdivia , Luc Rocher

Automated data-driven decision making systems are increasingly being used to assist, or even replace humans in many settings. These systems function by learning from historical decisions, often taken by humans. In order to maximize the…

Machine Learning · Statistics 2017-03-10 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi