English
Related papers

Related papers: Data AUDIT: Identifying Attribute Utility- and Det…

200 papers

Fairness in human-robot interaction critically depends on the reliability of the perceptual models that enable robots to interpret human behavior. While demographic biases have been widely studied in high-level facial analysis tasks, their…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Pablo Parte , Roberto Valle , José M. Buenaposada , Luis Baumela

Artificial intelligence systems, especially those using machine learning, are being deployed in domains from hiring to loan issuance in order to automate these complex decisions. Judging both the effectiveness and fairness of these AI…

Artificial Intelligence · Computer Science 2025-07-04 Disa Sariola , Patrick Button , Aron Culotta , Nicholas Mattei

Dataset bias is a critical challenge in machine learning since it often leads to a negative impact on a model due to the unintended decision rules captured by spurious correlations. Although existing works often handle this issue based on…

Machine Learning · Computer Science 2022-04-05 Seonguk Seo , Joon-Young Lee , Bohyung Han

Recent advances in deep learning and on-device inference could transform routine screening for skin cancers. Along with the anticipated benefits of this technology, potential dangers arise from unforeseen and inherent biases. A significant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Ko Watanabe , Stanislav Frolov , Aya Hassan , David Dembinsky , Adriano Lucieri , Andreas Dengel

Image manipulation detection algorithms designed to identify local anomalies often rely on the manipulated regions being ``sufficiently'' different from the rest of the non-tampered regions in the image. However, such anomalies might not be…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Rosaura G. VidalMata , Priscila Saboia , Daniel Moreira , Grant Jensen , Jason Schlessman , Walter J. Scheirer

Dataset bias, where data points are skewed to certain concepts, is ubiquitous in machine learning datasets. Yet, systematically identifying these biases is challenging without costly, fine-grained attribute annotations. We present…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Jinho Choi , Hyesu Lim , Steffen Schneider , Jaegul Choo

Data imbalance is a well-known issue in the field of machine learning, attributable to the cost of data collection, the difficulty of labeling, and the geographical distribution of the data. In computer vision, bias in data distribution…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Shubham Shrivastava , Xianling Zhang , Sushruth Nagesh , Armin Parchami

Data-trained predictive models see widespread use, but for the most part they are used as black boxes which output a prediction or score. It is therefore hard to acquire a deeper understanding of model behavior, and in particular how…

It has recently been shown that deep learning models for anatomical segmentation in medical images can exhibit biases against certain sub-populations defined in terms of protected attributes like sex or ethnicity. In this context, auditing…

Computer Vision and Pattern Recognition · Computer Science 2023-09-04 Nicolás Gaggion , Rodrigo Echeveste , Lucas Mansilla , Diego H. Milone , Enzo Ferrante

It has been rightfully emphasized that the use of AI for clinical decision making could amplify health disparities. An algorithm may encode protected characteristics, and then use this information for making predictions due to undesirable…

Machine Learning · Computer Science 2022-07-22 Ben Glocker , Charles Jones , Melanie Bernhardt , Stefan Winzeck

With the rapid expansion of machine learning and deep learning (DL), researchers are increasingly employing learning-based algorithms to alleviate diagnostic challenges across diverse medical tasks and applications. While advancements in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Zikang Xu , Fenghe Tang , Quan Quan , Jianrui Ding , Chunping Ning , S. Kevin Zhou

Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Camila Kolling , Victor Araujo , Adriano Veloso , Soraia Raupp Musse

How do we learn from biased data? Historical datasets often reflect historical prejudices; sensitive or protected attributes may affect the observed treatments and outcomes. Classification algorithms tasked with predicting outcomes…

Machine Learning · Computer Science 2018-12-04 David Madras , Elliot Creager , Toniann Pitassi , Richard Zemel

It is widely recognized that deep neural networks are sensitive to bias in the data. This means that during training these models are likely to learn spurious correlations between data and labels, resulting in limited generalization…

Machine Learning · Computer Science 2024-12-06 Vito Paolo Pastore , Massimiliano Ciranni , Davide Marinelli , Francesca Odone , Vittorio Murino

In this study, we introduce the application of causal disparity analysis to unveil intricate relationships and causal pathways between sensitive attributes and the targeted outcomes within real-world observational data. Our methodology…

Computers and Society · Computer Science 2024-08-08 Farnaz Kohankhaki , Shaina Raza , Oluwanifemi Bamgbose , Deval Pandya , Elham Dolatabadi

The problem of algorithmic bias in machine learning has gained a lot of attention in recent years due to its concrete and potentially hazardous implications in society. In much the same manner, biases can also alter modern industrial and…

Machine Learning · Computer Science 2022-10-11 Laurent Risser , Agustin Picard , Lucas Hervier , Jean-Michel Loubes

Algorithms and technologies are essential tools that pervade all aspects of our daily lives. In the last decades, health care research benefited from new computer-based recruiting methods, the use of federated architectures for data…

Computers and Society · Computer Science 2023-01-26 Chiara Criscuolo , Tommaso Dolci , Mattia Salnitri

Does everyone equally benefit from computer vision systems? Answers to this question become more and more important as computer vision systems are deployed at large scale, and can spark major concerns when they exhibit vast performance…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Priya Goyal , Adriana Romero Soriano , Caner Hazirbas , Levent Sagun , Nicolas Usunier

The pervasive application of algorithmic decision-making is raising concerns on the risk of unintended bias in AI systems deployed in critical settings such as healthcare. The detection and mitigation of biased models is a very delicate…

Machine Learning · Computer Science 2020-11-10 Cecilia Panigutti , Alan Perotti , Andrè Panisson , Paolo Bajardi , Dino Pedreschi

Many automatic attribute discovery methods have been developed to extract a set of visual attributes from images for various tasks. However, despite good performance in some image classification tasks, it is difficult to evaluate whether…

Computer Vision and Pattern Recognition · Computer Science 2016-02-08 Liangchen Liu , Arnold Wiliem , Shaokang Chen , Brian C. Lovell