English
Related papers

Related papers: Using Backbone Foundation Model for Evaluating Fai…

200 papers

Deep neural networks often inherit social and demographic biases from annotated data during model training, leading to unfair predictions, especially in the presence of sensitive attributes like race, age, gender etc. Existing methods fall…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Anay Majee , Rishabh Iyer

The advent of foundation models (FMs) in healthcare offers unprecedented opportunities to enhance medical diagnostics through automated classification and segmentation tasks. However, these models also raise significant concerns about their…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Ruinan Jin , Zikang Xu , Yuan Zhong , Qiongsong Yao , Qi Dou , S. Kevin Zhou , Xiaoxiao Li

Automated pain detection through machine learning (ML) and deep learning (DL) algorithms holds significant potential in healthcare, particularly for patients unable to self-report pain levels. However, the accuracy and fairness of these…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Dylan Green , Yuting Shang , Jiaee Cheong , Yang Liu , Hatice Gunes

Machine learning (ML) has become a critical tool in public health, offering the potential to improve population health, diagnosis, treatment selection, and health system efficiency. However, biases in data and model design can result in…

Machine Learning · Computer Science 2023-04-12 Shaina Raza

Fairness in medical agents is becoming critical as tool-using clinical AI systems orchestrate specialized vision and language modules for tasks such as chest X-ray question answering. While these medical AI agents can improve flexibility,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Zikang Xu , Ruinan Jin , Xiaoxiao Li

Diffusion models have achieved great progress in face generation. However, these models amplify the bias in the generation process, leading to an imbalance in distribution of sensitive attributes such as age, gender and race. This paper…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Basudha Pal , Arunkumar Kannan , Ram Prabhakar Kathirvel , Alice J. O'Toole , Rama Chellappa

Machine learning has significantly advanced healthcare by aiding in disease prevention and treatment identification. However, accessing patient data can be challenging due to privacy concerns and strict regulations. Generating synthetic,…

While utilizing machine learning models, one of the most crucial aspects is how bias and fairness affect model outcomes for diverse demographics. This becomes especially relevant in the context of machine learning for medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-10-19 Mahsa Dibaji , Neha Gianchandani , Akhil Nair , Mansi Singhal , Roberto Souza , Mariana Bento

Data imbalance is a fundamental challenge in applying language models to biomedical applications, particularly in ICD code prediction tasks where label and demographic distributions are uneven. While state-of-the-art language models have…

Machine Learning · Computer Science 2025-02-17 Precious Jones , Weisi Liu , I-Chan Huang , Xiaolei Huang

Face quality assessment aims at estimating the utility of a face image for the purpose of recognition. It is a key factor to achieve high face recognition performances. Currently, the high performance of these face recognition systems come…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Philipp Terhörst , Jan Niklas Kolf , Naser Damer , Florian Kirchbuchner , Arjan Kuijper

The urging societal demand for fair AI systems has put pressure on the research community to develop predictive models that are not only globally accurate but also meet new fairness criteria, reflecting the lack of disparate mistreatment…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jean-Rémy Conti , Stéphan Clémençon

Bias in Foundation Models (FMs) - trained on vast datasets spanning societal and historical knowledge - poses significant challenges for fairness and equity across fields such as healthcare, education, and finance. These biases, rooted in…

Machine Learning · Computer Science 2025-01-22 Shuzhou Sun , Li Liu , Yongxiang Liu , Zhen Liu , Shuanghui Zhang , Janne Heikkilä , Xiang Li

As machine learning models become increasingly integrated into healthcare, structural inequities and social biases embedded in clinical data can be perpetuated or even amplified by data-driven models. In survival analysis, censoring and…

Generative foundation models can remove visual artifacts through realistic image inpainting, but their impact on medical AI performance remains uncertain. Pediatric hand radiographs often contain non-anatomical markers, and it is unclear…

Face recognition systems are widely deployed in safety-critical applications, including law enforcement, yet they exhibit bias across a range of socio-demographic dimensions, such as gender and race. Conventional wisdom dictates that model…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Samuel Dooley , Rhea Sanjay Sukthanker , John P. Dickerson , Colin White , Frank Hutter , Micah Goldblum

Foundation models are a current focus of attention in both industry and academia. While they have shown their capabilities in a variety of tasks, in-depth research is required to determine their robustness to distribution shift when used as…

Computation and Language · Computer Science 2023-12-12 Xiruo Ding , Zhecheng Sheng , Brian Hur , Feng Chen , Serguei V. S. Pakhomov , Trevor Cohen

Fairness AI aims to detect and alleviate bias across the entire AI development life cycle, encompassing data curation, modeling, evaluation, and deployment-a pivotal aspect of ethical AI implementation. Addressing data bias, particularly…

Machine Learning · Computer Science 2023-12-21 Christina Hastings Blow , Lijun Qian , Camille Gibson , Pamela Obiomon , Xishuang Dong

Machine learning (ML) models are increasingly used to support clinical decision-making. However, real-world medical datasets are often noisy, incomplete, and imbalanced, leading to performance disparities across patient subgroups. These…

The use of machine learning to guide clinical decision making has the potential to worsen existing health disparities. Several recent works frame the problem as that of algorithmic fairness, a framework that has attracted considerable…

Machine Learning · Statistics 2021-06-16 Stephen R. Pfohl , Agata Foryciarz , Nigam H. Shah

Measuring biases of vision systems with respect to protected attributes like gender and age is critical as these systems gain widespread use in society. However, significant correlations between attributes in benchmark datasets make it…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Chandan Singh , Guha Balakrishnan , Pietro Perona