English
Related papers

Related papers: Representation Bias in Data: A Survey on Identific…

200 papers

Web search engines influence perception of social reality by filtering and ranking information. However, their outputs are often subjected to bias that can lead to skewed representation of subjects such as professional occupations or…

Information Retrieval · Computer Science 2021-06-29 Mykola Makhortykh , Aleksandra Urman , Roberto Ulloa

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Bias is known to be an impediment to fair decisions in many domains such as human resources, the public sector, health care etc. Recently, hope has been expressed that the use of machine learning methods for taking such decisions would…

Machine Learning · Computer Science 2019-09-05 Jindong Gu , Daniela Oelke

Face recognition algorithms, when used in the real world, can be very useful, but they can also be dangerous when biased toward certain demographics. So, it is essential to understand how these algorithms are trained and what factors affect…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Manideep Kolla , Aravinth Savadamuthu

As the deployment of automated face recognition (FR) systems proliferates, bias in these systems is not just an academic question, but a matter of public concern. Media portrayals often center imbalance as the main source of bias, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Valeriia Cherepanova , Steven Reich , Samuel Dooley , Hossein Souri , Micah Goldblum , Tom Goldstein

As calls for fair and unbiased algorithmic systems increase, so too does the number of individuals working on algorithmic fairness in industry. However, these practitioners often do not have access to the demographic data they feel they…

Computers and Society · Computer Science 2021-01-26 McKane Andrus , Elena Spitzer , Jeffrey Brown , Alice Xiang

Presence of bias (in datasets or tasks) is inarguably one of the most critical challenges in machine learning applications that has alluded to pivotal debates in recent years. Such challenges range from spurious associations between…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Ehsan Adeli , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Li Fei-Fei , Juan Carlos Niebles , Kilian M. Pohl

The success of machine learning algorithms generally depends on data representation, and we hypothesize that this is because different representations can entangle and hide more or less the different explanatory factors of variation behind…

Machine Learning · Computer Science 2014-04-24 Yoshua Bengio , Aaron Courville , Pascal Vincent

Fairness in artificial intelligence (AI) has become a growing concern due to discriminatory outcomes in AI-based decision-making systems. While various methods have been proposed to mitigate bias, most rely on complete demographic…

Computers and Society · Computer Science 2025-11-18 Zichong Wang , Zhipeng Yin , Roland H. C. Yap , Wenbin Zhang

Computer Vision (CV) has achieved remarkable results, outperforming humans in several tasks. Nonetheless, it may result in significant discrimination if not handled properly as CV systems highly depend on the data they are fed with and can…

Computer Vision and Pattern Recognition · Computer Science 2022-06-24 Simone Fabbrizzi , Symeon Papadopoulos , Eirini Ntoutsi , Ioannis Kompatsiaris

The need to address representation biases and sentencing disparities in legal case data has long been recognized. Here, we study the problem of identifying and measuring biases in large-scale legal case data from an algorithmic fairness…

Computers and Society · Computer Science 2021-09-22 Jackson Sargent , Melanie Weber

A common approach in neuroscience is to study neural representations as a means to understand a system -- increasingly, by relating the neural representations to the internal representations learned by computational models. However, a…

Neurons and Cognition · Quantitative Biology 2025-08-14 Andrew Kyle Lampinen , Stephanie C. Y. Chan , Yuxuan Li , Katherine Hermann

In practice, and especially when training deep neural networks, visual recognition rules are often learned based on various sources of information. On the other hand, the recent deployment of facial recognition systems with uneven…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Stephan Clémençon , Pierre Laforgue , Robin Vogel

In a world increasingly reliant on artificial intelligence, it is more important than ever to consider the ethical implications of artificial intelligence on humanity. One key under-explored challenge is labeler bias, which can create…

Machine Learning · Computer Science 2024-10-25 Luke Haliburton , Sinksar Ghebremedhin , Robin Welsch , Albrecht Schmidt , Sven Mayer

We investigate the prominent class of fair representation learning methods for bias mitigation. Using causal reasoning to define and formalise different sources of dataset bias, we reveal important implicit assumptions inherent to these…

Machine Learning · Computer Science 2025-02-11 Charles Jones , Fabio de Sousa Ribeiro , Mélanie Roschewitz , Daniel C. Castro , Ben Glocker

Due to the widespread use of data-powered systems in our everyday lives, the notions of bias and fairness gained significant attention among researchers and practitioners, in both industry and academia. Such issues typically emerge from the…

Information Retrieval · Computer Science 2021-10-27 Gianluca Demartini , Kevin Roitero , Stefano Mizzaro

Our society is plagued by several biases, including racial biases, caste biases, and gender bias. As a matter of fact, several years ago, most of these notions were unheard of. These biases passed through generations along with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Lavisha Aggarwal , Shruti Bhargava

Real-life tools for decision-making in many critical domains are based on ranking results. With the increasing awareness of algorithmic fairness, recent works have presented measures for fairness in ranking. Many of those definitions…

Machine Learning · Computer Science 2023-07-10 Jinyang Li , Yuval Moskovitch , H. V. Jagadish

As decision-making increasingly relies on Machine Learning (ML) and (big) data, the issue of fairness in data-driven Artificial Intelligence (AI) systems is receiving increasing attention from both research and industry. A large variety of…

Machine Learning · Computer Science 2022-03-08 Tai Le Quy , Arjun Roy , Vasileios Iosifidis , Wenbin Zhang , Eirini Ntoutsi

In this paper, we deal with bias mitigation techniques that remove specific data points from the training set to aim for a fair representation of the population in that set. Machine learning models are trained on these pre-processed…

Machine Learning · Computer Science 2024-09-24 Manh Khoi Duong , Stefan Conrad