English
Related papers

Related papers: Controllable Feature Whitening for Hyperparameter-…

200 papers

We study fairness in Machine Learning (FairML) through the lens of attribute-based explanations generated for machine learning models. Our hypothesis is: Biased Models have Biased Explanations. To establish that, we first translate existing…

Machine Learning · Computer Science 2020-12-22 Aditya Jain , Manish Ravula , Joydeep Ghosh

Computer vision models learn to perform a task by capturing relevant statistics from training data. It has been shown that models learn spurious age, gender, and race correlations when trained for seemingly unrelated tasks like activity…

Computer Vision and Pattern Recognition · Computer Science 2020-04-03 Zeyu Wang , Klint Qinami , Ioannis Christos Karakozis , Kyle Genova , Prem Nair , Kenji Hata , Olga Russakovsky

As AI systems become more embedded in everyday life, the development of fair and unbiased models becomes more critical. Considering the social impact of AI systems is not merely a technical challenge but a moral imperative. As evidenced in…

Machine Learning · Computer Science 2025-10-03 Aida Tayebi , Ali Khodabandeh Yalabadi , Mehdi Yazdani-Jahromi , Ozlem Ozmen Garibay

There has been a prevalence of applying AI software in both high-stakes public-sector and industrial contexts. However, the lack of transparency has raised concerns about whether these data-informed AI software decisions secure fairness…

Machine Learning · Computer Science 2025-11-17 Xiaoyin Xi , Zhe Yu

Fairness is becoming a rising concern w.r.t. machine learning model performance. Especially for sensitive fields such as criminal justice and loan decision, eliminating the prediction discrimination towards a certain group of population…

Machine Learning · Computer Science 2019-09-09 Xiaoqian Wang , Heng Huang

The performance of deep neural networks for image recognition tasks such as predicting a smiling face is known to degrade with under-represented classes of sensitive attributes. We address this problem by introducing fairness-aware…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Tobias Hänel , Nishant Kumar , Dmitrij Schlesinger , Mengze Li , Erdem Ünal , Abouzar Eslami , Stefan Gumhold

Despite being widely used, face recognition models suffer from bias: the probability of a false positive (incorrect face match) strongly depends on sensitive attributes such as the ethnicity of the face. As a result, these models can…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Tiago Salvador , Stephanie Cairns , Vikram Voleti , Noah Marshall , Adam Oberman

As machine learning has been deployed ubiquitously across applications in modern data science, algorithmic fairness has become a great concern. Among them, imposing fairness constraints during learning, i.e. in-processing fair training, has…

Machine Learning · Computer Science 2023-07-18 Yuzhen Mao , Zhun Deng , Huaxiu Yao , Ting Ye , Kenji Kawaguchi , James Zou

Fairness-aware machine learning has attracted a surge of attention in many domains, such as online advertising, personalized recommendation, and social media analysis in web applications. Fairness-aware machine learning aims to eliminate…

Machine Learning · Computer Science 2023-07-18 Jing Ma , Ruocheng Guo , Aidong Zhang , Jundong Li

Machine learning model bias can arise from dataset composition: correlated sensitive features can distort the downstream classification model's decision boundary and lead to performance differences along these features. Existing de-biasing…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Miao Zhang , Zee fryer , Ben Colman , Ali Shahriyari , Gaurav Bharaj

Many works have shown that deep learning-based medical image classification models can exhibit bias toward certain demographic attributes like race, gender, and age. Existing bias mitigation methods primarily focus on learning debiased…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Yawen Wu , Dewen Zeng , Xiaowei Xu , Yiyu Shi , Jingtong Hu

Why should we trust the detections of deep neural networks for manipulated faces? Understanding the reasons is important for users in improving the fairness, reliability, privacy and trust of the detection models. In this work, we propose…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Yingying Hua , Daichi Zhang , Pengju Wang , Shiming Ge

Real-world datasets are often biased with respect to key demographic factors such as race and gender. Due to the latent nature of the underlying factors, detecting and mitigating bias is especially challenging for unsupervised machine…

Machine Learning · Computer Science 2020-07-01 Kristy Choi , Aditya Grover , Trisha Singh , Rui Shu , Stefano Ermon

Software built on top of machine learning algorithms is becoming increasingly prevalent in a variety of fields, including college admissions, healthcare, insurance, and justice. The effectiveness and efficiency of these systems heavily…

Machine Learning · Computer Science 2023-05-25 Ying Xiao , Shangwen Wang , Sicen Liu , Dingyuan Xue , Xian Zhan , Yepang Liu

Addressing fairness concerns about machine learning models is a crucial step towards their long-term adoption in real-world automated systems. While many approaches have been developed for training fair models from data, little is known…

Machine Learning · Computer Science 2022-06-09 Nikola Konstantinov , Christoph H. Lampert

Fairness of machine learning models in healthcare has drawn increasing attention from clinicians, researchers, and even at the highest level of government. On the other hand, the importance of developing and deploying interpretable or…

Machine Learning · Computer Science 2024-09-04 Mary M. Lucas , Xiaoyang Wang , Chia-Hsuan Chang , Christopher C. Yang , Jacqueline E. Braughton , Quyen M. Ngo

This project explores adversarial training techniques to develop fairer Deep Neural Networks (DNNs) to mitigate the inherent bias they are known to exhibit. DNNs are susceptible to inheriting bias with respect to sensitive attributes such…

Machine Learning · Computer Science 2024-01-05 Allen Minch , Hung Anh Vu , Anne Marie Warren

Datasets often contain biases which unfairly disadvantage certain groups, and classifiers trained on such datasets can inherit these biases. In this paper, we provide a mathematical formulation of how this bias can arise. We do so by…

Machine Learning · Computer Science 2019-01-16 Heinrich Jiang , Ofir Nachum

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

Machine learning models trained on real-world data may inadvertently make biased predictions that negatively impact marginalized communities. Reweighting, which assigns a weight to each data point used during model training, can mitigate…

Machine Learning · Computer Science 2026-03-20 Anil K. Saini , Jose Guadalupe Hernandez , Emily F. Wong , Debanshi Misra , Tiffani J. Bright , Jason H. Moore