English
Related papers

Related papers: Dataset Representativeness and Downstream Task Fai…

200 papers

There has been increasing awareness of ethical issues in machine learning, and fairness has become an important research topic. Most fairness efforts in computer vision have been focused on human sensing applications and preventing…

Computer Vision and Pattern Recognition · Computer Science 2022-06-06 Zu Kim , André Araujo , Bingyi Cao , Cam Askew , Jack Sim , Mike Green , N'Mah Fodiatu Yilla , Tobias Weyand

There have been tremendous efforts over the past decades dedicated to the generation of realistic graphs in a variety of domains, ranging from social networks to computer networks, from gene regulatory networks to online transaction…

Machine Learning · Computer Science 2023-12-19 Lecheng Zheng , Dawei Zhou , Hanghang Tong , Jiejun Xu , Yada Zhu , Jingrui He

A significant limiting factor in training fair classifiers relates to the presence of dataset bias. In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. If not mitigated, bias leads to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Markos Georgopoulos , James Oldfield , Mihalis A. Nicolaou , Yannis Panagakis , Maja Pantic

Deep neural networks (DNNs) are increasingly used in real-world applications (e.g. facial recognition). This has resulted in concerns about the fairness of decisions made by these models. Various notions and measures of fairness have been…

Machine Learning · Computer Science 2021-01-22 Vedant Nanda , Samuel Dooley , Sahil Singla , Soheil Feizi , John P. Dickerson

To mitigate the effects of undesired biases in models, several approaches propose to pre-process the input dataset to reduce the risks of discrimination by preventing the inference of sensitive attributes. Unfortunately, most of these…

Machine Learning · Computer Science 2023-02-21 Sébastien Gambs , Rosin Claude Ngueveu

Understanding and removing bias from the decisions made by machine learning models is essential to avoid discrimination against unprivileged groups. Despite recent progress in algorithmic fairness, there is still no clear answer as to which…

Large participatory biomedical studies, studies that recruit individuals to join a dataset, are gaining popularity and investment, especially for analysis by modern AI methods. Because they purposively recruit participants, these studies…

Clustering algorithms may unintentionally propagate or intensify existing disparities, leading to unfair representations or biased decision-making. Current fair clustering methods rely on notions of fairness that do not capture any…

Machine Learning · Statistics 2023-12-15 Fritz Bayer , Drago Plecko , Niko Beerenwinkel , Jack Kuipers

Identifying the causes of a model's unfairness is an important yet relatively unexplored task. We look into this problem through the lens of training data - the major source of unfairness. We ask the following questions: How would the…

Machine Learning · Computer Science 2024-02-20 Yuanshun Yao , Yang Liu

As an important problem in modern data analytics, classification has witnessed varieties of applications from different domains. Different from conventional classification approaches, fair classification concerns the issues of unintentional…

Machine Learning · Statistics 2020-12-25 Qing Ye , Weijun Xie

Fairness in deep learning models trained with high-dimensional inputs and subjective labels remains a complex and understudied area. Facial emotion recognition, a domain where datasets are often racially imbalanced, can lead to models that…

Computer Vision and Pattern Recognition · Computer Science 2023-08-10 Alex Fan , Xingshuo Xiao , Peter Washington

Computer vision models have been known to encode harmful biases, leading to the potentially unfair treatment of historically marginalized groups, such as people of color. However, there remains a lack of datasets balanced along demographic…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Nicholas Lui , Bryan Chia , William Berrios , Candace Ross , Douwe Kiela

Statistical samples, in order to be representative, have to be drawn from a population in a random and unbiased way. Nevertheless, it is common practice in the field of model-based diagnosis to make estimations from (biased) best-first…

Artificial Intelligence · Computer Science 2022-08-05 Patrick Rodler , Fatima Elichanova

Pre-training datasets are critical for building state-of-the-art machine learning models, motivating rigorous study on their impact on downstream tasks. In this work, we study the impact of the trade-off between the intra-class diversity…

Machine Learning · Computer Science 2023-12-04 Jieyu Zhang , Bohan Wang , Zhengyu Hu , Pang Wei Koh , Alexander Ratner

The data processing inequality is an information-theoretic principle stating that the information content of a signal cannot be increased by processing the observations. In particular, it suggests that there is no benefit in enhancing the…

Machine Learning · Computer Science 2025-12-25 Roy Turgeman , Tom Tirer

A biased dataset is a dataset that generally has attributes with an uneven class distribution. These biases have the tendency to propagate to the models that train on them, often leading to a poor performance in the minority class. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-05-05 Athiya Deviyani

As algorithms increasingly inform and influence decisions made about individuals, it becomes increasingly important to address concerns that these algorithms might be discriminatory. The output of an algorithm can be discriminatory for many…

Machine Learning · Computer Science 2018-03-19 Úrsula Hébert-Johnson , Michael P. Kim , Omer Reingold , Guy N. Rothblum

Subsampling algorithms are a natural approach to reduce data size before fitting models on massive datasets. In recent years, several works have proposed methods for subsampling rows from a data matrix while maintaining relevant information…

Machine Learning · Computer Science 2023-01-18 Fred Lu , Edward Raff , James Holt

Research in machine learning fairness has historically considered a single binary demographic attribute; however, the reality is of course far more complicated. In this work, we grapple with questions that arise along three stages of the…

Machine Learning · Computer Science 2022-05-11 Angelina Wang , Vikram V. Ramaswamy , Olga Russakovsky

Effective machine learning models can automatically learn useful information from a large quantity of data and provide decisions in a high accuracy. These models may, however, lead to unfair predictions in certain sense among the population…

Machine Learning · Computer Science 2020-06-19 Mingliang Chen , Min Wu