English
Related papers

Related papers: Fair Visual Recognition via Intervention with Prox…

200 papers

While task-agnostic debiasing provides notable generalizability and reduced reliance on downstream data, its impact on language modeling ability and the risk of relearning social biases from downstream task-specific data remain as the two…

Computation and Language · Computer Science 2024-06-07 Guangliang Liu , Milad Afshari , Xitong Zhang , Zhiyu Xue , Avrajit Ghosh , Bidhan Bashyal , Rongrong Wang , Kristen Johnson

In this paper, we present an empirical study on image recognition fairness, i.e., extreme class accuracy disparity on balanced data like ImageNet. We experimentally demonstrate that classes are not equal and the fairness issue is prevalent…

Machine Learning · Computer Science 2024-03-14 Jiequan Cui , Beier Zhu , Xin Wen , Xiaojuan Qi , Bei Yu , Hanwang Zhang

Proxy-based metric learning losses are superior to pair-based losses due to their fast convergence and low training complexity. However, existing proxy-based losses focus on learning class-discriminative features while overlooking the…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Zhibo Yang , Muhammet Bastan , Xinliang Zhu , Doug Gray , Dimitris Samaras

Deep-learning models can extract a rich assortment of features from data. Which features a model uses depends not only on \emph{predictivity} -- how reliably a feature indicates training-set labels -- but also on \emph{availability} -- how…

Machine Learning · Computer Science 2024-07-15 Katherine L. Hermann , Hossein Mobahi , Thomas Fel , Michael C. Mozer

As deep image classification applications, e.g., face recognition, become increasingly prevalent in our daily lives, their fairness issues raise more and more concern. It is thus crucial to comprehensively test the fairness of these…

Machine Learning · Computer Science 2021-12-03 Peixin Zhang , Jingyi Wang , Jun Sun , Xinyu Wang

The rapid growth of data in the recent years has led to the development of complex learning algorithms that are often used to make decisions in real world. While the positive impact of the algorithms has been tremendous, there is a need to…

Machine Learning · Computer Science 2022-01-03 Ankit Kulshrestha , Ilya Safro

In recent years, most fairness strategies in machine learning models focus on mitigating unwanted biases by assuming that the sensitive information is observed. However this is not always possible in practice. Due to privacy purposes and…

Machine Learning · Computer Science 2022-10-17 Vincent Grari , Sylvain Lamprier , Marcin Detyniecki

Face recognition and verification are two computer vision tasks whose performance has progressed with the introduction of deep representations. However, ethical, legal, and technical challenges due to the sensitive character of face data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Alexandre Fournier-Montgieux , Michael Soumm , Adrian Popescu , Bertrand Luvison , Hervé Le Borgne

As machine learning algorithms have been widely deployed across applications, many concerns have been raised over the fairness of their predictions, especially in high stakes settings (such as facial recognition and medical imaging). To…

Machine Learning · Computer Science 2021-02-16 Valeriia Cherepanova , Vedant Nanda , Micah Goldblum , John P. Dickerson , Tom Goldstein

Biases in existing datasets used to train algorithmic decision rules can raise ethical and economic concerns due to the resulting disparate treatment of different groups. We propose an algorithm for sequentially debiasing such datasets…

Machine Learning · Computer Science 2023-01-11 Yifan Yang , Yang Liu , Parinaz Naghizadeh

Mitigating social bias in large language models (LLMs) has become an increasingly important research objective. However, existing debiasing methods often incur high human and computational costs, exhibit limited effectiveness, and struggle…

Computation and Language · Computer Science 2025-06-02 Xiaoqing Cheng , Ruizhe Chen , Hongying Zan , Yuxiang Jia , Min Peng

Surveillance systems play a critical role in security and reconnaissance, but their performance is often compromised by low-quality images and videos, leading to reduced accuracy in face recognition. Additionally, existing AI-based facial…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Anees Nashath Shaik , Barbara Villarini , Vasileios Argyriou

Deep learning is increasingly being used in high-stake decision making applications that affect individual lives. However, deep learning models might exhibit algorithmic discrimination behaviors with respect to protected groups, potentially…

Machine Learning · Computer Science 2020-03-20 Mengnan Du , Fan Yang , Na Zou , Xia Hu

Recent discoveries have revealed that deep neural networks might behave in a biased manner in many real-world scenarios. For instance, deep networks trained on a large-scale face recognition dataset CelebA tend to predict blonde hair for…

Machine Learning · Computer Science 2023-11-06 Ruizhe Chen , Jianfei Yang , Huimin Xiong , Jianhong Bai , Tianxiang Hu , Jin Hao , Yang Feng , Joey Tianyi Zhou , Jian Wu , Zuozhu Liu

As AI systems become more embedded in everyday life, the development of fair and unbiased models becomes more critical. Considering the social impact of AI systems is not merely a technical challenge but a moral imperative. As evidenced in…

Machine Learning · Computer Science 2025-10-03 Aida Tayebi , Ali Khodabandeh Yalabadi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay

In recent years, machine learning algorithms have become ubiquitous in a multitude of high-stakes decision-making applications. The unparalleled ability of machine learning algorithms to learn patterns from data also enables them to…

Machine Learning · Computer Science 2022-07-14 José Pombal , André F. Cruz , João Bravo , Pedro Saleiro , Mário A. T. Figueiredo , Pedro Bizarro

Reliably detecting diseases using relevant biological information is crucial for real-world applicability of deep learning techniques in medical imaging. We debias deep learning models during training against unknown bias - without…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Simon Langer , Oliver Taubmann , Felix Denzinger , Andreas Maier , Alexander Mühlberg

Ensuring fairness has emerged as one of the primary concerns in AI and its related algorithms. Over time, the field of machine learning fairness has evolved to address these issues. This paper provides an extensive overview of this field…

Machine Learning · Computer Science 2024-11-15 Quan Zhou

Deep learning (DL) models are widely used to provide a more convenient and smarter life. However, biased algorithms will negatively influence us. For instance, groups targeted by biased algorithms will feel unfairly treated and even fearful…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Xuyang Shen , Jo Plested , Sabrina Caldwell , Tom Gedeon

Recently, much attention has been paid to the societal impact of AI, especially concerns regarding its fairness. A growing body of research has identified unfair AI systems and proposed methods to debias them, yet many challenges remain.…

Artificial Intelligence · Computer Science 2021-04-20 Ziqian Zeng , Rashidul Islam , Kamrun Naher Keya , James Foulds , Yangqiu Song , Shimei Pan