English
Related papers

Related papers: Lazy Data Practices Harm Fairness Research

200 papers

Large Language Models (LLMs) are increasingly used in high-stakes fields where their decisions impact rights and equity. However, LLMs' judicial fairness and implications for social justice remain underexplored. When LLMs act as judges, the…

Advances in algorithmic fairness have largely omitted sexual orientation and gender identity. We explore queer concerns in privacy, censorship, language, online safety, health, and employment to study the positive and negative effects of…

Computers and Society · Computer Science 2021-04-29 Nenad Tomasev , Kevin R. McKee , Jackie Kay , Shakir Mohamed

The emergence and growth of research on issues of ethics in AI, and in particular algorithmic fairness, has roots in an essential observation that structural inequalities in society are reflected in the data used to train predictive models…

Computers and Society · Computer Science 2020-02-28 Caitlin Kuhlman , Latifa Jackson , Rumi Chunara

While data-driven predictive models are a strictly technological construct, they may operate within a social context in which benign engineering choices entail implicit, indirect and unexpected real-life consequences. Fairness of such…

Machine Learning · Computer Science 2024-07-11 Kacper Sokol , Meelis Kull , Jeffrey Chan , Flora Salim

Machine learning algorithms are increasingly deployed in critical domains such as finance, healthcare, and criminal justice [1]. The increasing popularity of algorithmic decision-making has stimulated interest in algorithmic fairness within…

Machine Learning · Computer Science 2025-11-18 Animesh Joshi

Studies of dataset development in machine learning call for greater attention to the data practices that make model development possible and shape its outcomes. Many argue that the adoption of theory and practices from archives and data…

Computers and Society · Computer Science 2024-05-07 Eshta Bhardwaj , Harshit Gujral , Siyi Wu , Ciara Zogheib , Tegan Maharaj , Christoph Becker

As we rely on machine learning (ML) models to make more consequential decisions, the issue of ML models perpetuating or even exacerbating undesirable historical biases (e.g., gender and racial biases) has come to the fore of the public's…

Machine Learning · Statistics 2021-04-01 Subha Maity , Songkai Xue , Mikhail Yurochkin , Yuekai Sun

In this paper, we deal with bias mitigation techniques that remove specific data points from the training set to aim for a fair representation of the population in that set. Machine learning models are trained on these pre-processed…

Machine Learning · Computer Science 2024-09-24 Manh Khoi Duong , Stefan Conrad

The problem of algorithmic bias in machine learning has gained a lot of attention in recent years due to its concrete and potentially hazardous implications in society. In much the same manner, biases can also alter modern industrial and…

Machine Learning · Computer Science 2022-10-11 Laurent Risser , Agustin Picard , Lucas Hervier , Jean-Michel Loubes

Machine learning (ML) is increasingly being used in high-stakes applications impacting society. Therefore, it is of critical importance that ML models do not propagate discrimination. Collecting accurate labeled data in societal…

Machine Learning · Computer Science 2020-07-03 Hadis Anahideh , Abolfazl Asudeh , Saravanan Thirumuruganathan

This study investigates the trade-offs between fairness, privacy, and utility in image classification using machine learning (ML). Recent research suggests that generalization techniques can improve the balance between privacy and utility.…

Machine Learning · Computer Science 2024-12-17 Ahmad Hassanpour , Amir Zarei , Khawla Mallat , Anderson Santana de Oliveira , Bian Yang

Machine learning (ML) is playing an increasingly important role in rendering decisions that affect a broad range of groups in society. ML models inform decisions in criminal justice, the extension of credit in banking, and the hiring…

Machine Learning · Computer Science 2022-07-14 Damien Dablain , Bartosz Krawczyk , Nitesh Chawla

The research of machine learning (ML) algorithms for human activity recognition (HAR) has made significant progress with publicly available datasets. However, most research prioritizes statistical metrics over examining negative sample…

Machine Learning · Computer Science 2024-12-13 Daniel Geissler , Dominique Nshimyimana , Vitor Fortes Rey , Sungho Suh , Bo Zhou , Paul Lukowicz

Machine learning (ML) systems are utilized in critical sectors, such as healthcare, law enforcement, and finance. However, these systems are often trained on historical data that contains demographic biases, leading to ML decisions that…

Machine Learning · Computer Science 2025-06-10 Jake Robertson , Noah Hollmann , Samuel Müller , Noor Awad , Frank Hutter

Data-driven software solutions have significantly been used in critical domains with significant socio-economic, legal, and ethical implications. The rapid adoptions of data-driven solutions, however, pose major threats to the…

Software Engineering · Computer Science 2024-12-30 Normen Yu , Luciana Carreon , Gang Tan , Saeid Tizpaz-Niari

Data mining is an increasingly important technology for extracting useful knowledge hidden in large collections of data. There are, however, negative social perceptions about data mining, among which potential privacy violation and…

Databases · Computer Science 2013-07-01 Sara Hajian

A growing body of literature in fairness-aware machine learning (fairML) aims to mitigate machine learning (ML)-related unfairness in automated decision-making (ADM) by defining metrics that measure fairness of an ML model and by proposing…

Machine Learning · Computer Science 2025-07-14 Ludwig Bothmann , Kristina Peters , Bernd Bischl

Evaluating fairness can be challenging in practice because the sensitive attributes of data are often inaccessible due to privacy constraints. The go-to approach that the industry frequently adopts is using off-the-shelf proxy models to…

Machine Learning · Computer Science 2023-02-01 Zhaowei Zhu , Yuanshun Yao , Jiankai Sun , Hang Li , Yang Liu

Despite the growing reliance on fairness benchmarks to evaluate language models, the datasets that underpin these benchmarks remain critically underexamined. This survey addresses that overlooked foundation by offering a comprehensive…

Computation and Language · Computer Science 2025-09-23 Jiale Zhang , Zichong Wang , Avash Palikhe , Zhipeng Yin , Wenbin Zhang

While the need for well-trained, fair ML systems is increasing ever more, measuring fairness for modern models and datasets is becoming increasingly difficult as they grow at an unprecedented pace. One key challenge in scaling common…

Artificial Intelligence · Computer Science 2022-01-19 Alex Bäuerle , Aybuke Gul Turker , Ken Burke , Osman Aka , Timo Ropinski , Christina Greer , Mani Varadarajan