English
Related papers

Related papers: DetoxAI: a Python Toolkit for Debiasing Deep Learn…

200 papers

Because the choice and tuning of the optimizer affects the speed, and ultimately the performance of deep learning, there is significant past and recent research in this area. Yet, perhaps surprisingly, there is no generally agreed-upon…

Machine Learning · Computer Science 2019-03-14 Frank Schneider , Lukas Balles , Philipp Hennig

In today's society, AI systems are increasingly used to make critical decisions such as credit scoring and patient triage. However, great convenience brought by AI systems comes with troubling prevalence of bias against underrepresented…

Machine Learning · Computer Science 2021-05-11 Yan Zhou , Murat Kantarcioglu , Chris Clifton

Deep learning has achieved remarkable success in image classification and segmentation tasks. However, fairness concerns persist, as models often exhibit biases that disproportionately affect demographic groups defined by sensitive…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Milad Masroor , Tahir Hassan , Yu Tian , Kevin Wells , David Rosewarne , Thanh-Toan Do , Gustavo Carneiro

Reliably detecting diseases using relevant biological information is crucial for real-world applicability of deep learning techniques in medical imaging. We debias deep learning models during training against unknown bias - without…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Simon Langer , Oliver Taubmann , Felix Denzinger , Andreas Maier , Alexander Mühlberg

As deep image classification applications, e.g., face recognition, become increasingly prevalent in our daily lives, their fairness issues raise more and more concern. It is thus crucial to comprehensively test the fairness of these…

Machine Learning · Computer Science 2021-12-03 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang

The growing complexity of machine learning and deep learning models has led to an increased reliance on opaque "black box" systems, making it difficult to understand the rationale behind predictions. This lack of transparency is…

Machine Learning · Computer Science 2025-02-06 Pratinav Seth , Yashwardhan Rathore , Neeraj Kumar Singh , Chintan Chitroda , Vinay Kumar Sankarapu

The growing capability and accessibility of machine learning has led to its application to many real-world domains and data about people. Despite the benefits algorithmic systems may bring, models can reflect, inject, or exacerbate implicit…

Machine Learning · Computer Science 2021-10-28 Ángel Alexander Cabrera , Will Epperson , Fred Hohman , Minsuk Kahng , Jamie Morgenstern , Duen Horng Chau

Deep neural networks for image-based screening and computer-aided diagnosis have achieved expert-level performance on various medical imaging modalities, including chest radiographs. Recently, several works have indicated that these…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Ričards Marcinkevičs , Ece Ozkan , Julia E. Vogt

The growing use of automated decision-making in critical applications, such as crime prediction and college admission, has raised questions about fairness in machine learning. How can we decide whether different treatments are reasonable or…

Human-Computer Interaction · Computer Science 2023-02-21 Qianwen Wang , Zhenhua Xu , Zhutian Chen , Yong Wang , Shixia Liu , Huamin Qu

Recent dataset deduplication techniques have demonstrated that content-aware dataset pruning can dramatically reduce the cost of training Vision-Language Pretrained (VLP) models without significant performance losses compared to training on…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Eric Slyman , Stefan Lee , Scott Cohen , Kushal Kafle

The democratization of Data Mining has been widely successful thanks in part to powerful and easy-to-use Machine Learning libraries. These libraries have been particularly tailored to tackle Supervised Learning. However, strong supervision…

Machine Learning · Computer Science 2023-08-21 Pierre Nodet , Vincent Lemaire , Alexis Bondu , Antoine Cornuéjols

The biases and discrimination of machine learning algorithms have attracted significant attention, leading to the development of various algorithms tailored to specific contexts. However, these solutions often fall short of addressing…

Machine Learning · Computer Science 2025-08-05 Yinghui Huang , Zihao Tang , Xiangyu Chang

The rapid advancement of Vision-Language models (VLMs) has raised growing concerns that their black-box reasoning processes could lead to unintended forms of social bias. Current debiasing approaches focus on mitigating surface-level bias…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Na Min An , Yoonna Jang , Yusuke Hirota , Ryo Hachiuma , Isabelle Augenstein , Hyunjung Shim

Artificial Intelligence-generated content has become increasingly popular, yet its malicious use, particularly the deepfakes, poses a serious threat to public trust and discourse. While deepfake detection methods achieve high predictive…

Machine Learning · Computer Science 2025-07-15 Tomasz Szandala , Fatima Ezzeddine , Natalia Rusin , Silvia Giordano , Omran Ayoub

One of the pursued objectives of deep learning is to provide tools that learn abstract representations of reality from the observation of multiple contextual situations. More precisely, one wishes to extract disentangled representations…

Machine Learning · Computer Science 2023-10-24 Pierre Colombo , Nathan Noiry , Guillaume Staerman , Pablo Piantanida

Deep learning crime predictive tools use past crime data and additional behavioral datasets to forecast future crimes. Nevertheless, these tools have been shown to suffer from unfair predictions across minority racial and ethnic groups.…

Computers and Society · Computer Science 2024-06-14 Jiahui Wu , Vanessa Frias-Martinez

The presence of a bias in each image data collection has recently attracted a lot of attention in the computer vision community showing the limits in generalization of any learning method trained on a specific dataset. At the same time,…

Computer Vision and Pattern Recognition · Computer Science 2015-05-07 Tatiana Tommasi , Novi Patricia , Barbara Caputo , Tinne Tuytelaars

Fairness is a core element in the trustworthy deployment of deepfake detection models, especially in the field of digital identity security. Biases in detection models toward different demographic groups, such as gender and race, may lead…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Feng Ding , Wenhui Yi , Yunpeng Zhou , Xinan He , Hong Rao , Shu Hu

Algorithmic fairness has received considerable attention due to the failures of various predictive AI systems that have been found to be unfairly biased against subgroups of the population. Many approaches have been proposed to mitigate…

Machine Learning · Computer Science 2025-03-14 Agathe Fernandes Machado , Suzie Grondin , Philipp Ratz , Arthur Charpentier , François Hu

Predictive systems, in particular machine learning algorithms, can take important, and sometimes legally binding, decisions about our everyday life. In most cases, however, these systems and decisions are neither regulated nor certified.…

Machine Learning · Computer Science 2022-09-09 Kacper Sokol , Alexander Hepburn , Rafael Poyiadzi , Matthew Clifford , Raul Santos-Rodriguez , Peter Flach