English
Related papers

Related papers: Intersectional Fairness in Vision-Language Models …

200 papers

Multi-modal large language models (MLLMs), such as GPT-4o, excel at integrating text and visual data but face systematic challenges when interpreting ambiguous or incomplete visual stimuli. This study leverages statistical modeling to…

Machine Learning · Computer Science 2024-12-09 Ching-Yi Wang

The opaque nature of deep learning models remains a significant barrier to their clinical adoption in medical imaging. This paper presents a multimodal explainability framework that bridges the gap between convolutional neural network (CNN)…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Paul Valery Nguezet , Elie Tagne Fute , Yusuf Brima , Benoit Martin Azanguezet , Marcellin Atemkeng

In medical image diagnosis, fairness has become increasingly crucial. Without bias mitigation, deploying unfair AI would harm the interests of the underprivileged population and potentially tear society apart. Recent research addresses…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Ching-Hao Chiu , Yu-Jen Chen , Yawen Wu , Yiyu Shi , Tsung-Yi Ho

Recent advances in vision-language models (VLMs) have achieved remarkable performance on standard medical benchmarks, yet their true clinical reasoning ability remains unclear. Existing datasets predominantly emphasize classification…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Miao Jing , Mengting Jia , Junling Lin , Zhongxia Shen , Huan Gao , Mingkun Xu , Shangyang Li

Image generation is a prevailing technique for clinical data augmentation for advancing diagnostic accuracy and reducing healthcare disparities. Diffusion Model (DM) has become a leading method in generating synthetic medical images, but it…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Ruichen Zhang , Yuguang Yao , Zhen Tan , Zhiming Li , Pan Wang , Huan Liu , Jingtong Hu , Sijia Liu , Tianlong Chen

Algorithmic bias in medical imaging can perpetuate health disparities, yet its causes remain poorly understood in segmentation tasks. While fairness has been extensively studied in classification, segmentation remains underexplored despite…

Image and Video Processing · Electrical Eng. & Systems 2025-11-04 Aditya Parikh , Sneha Das , Aasa Feragen

Vision-Language Models (VLMs) have shown solid ability for multimodal understanding of both visual and language contexts. However, existing VLMs often face severe challenges of hallucinations, meaning that VLMs tend to generate responses…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Jinjin Cao , Zhiyang Chen , Zijun Wang , Liyuan Ma , Weijian Luo , Guojun Qi

According to PBS, nearly one-third of Americans lack access to primary care services, and another forty percent delay going to avoid medical costs. As a result, many diseases are left undiagnosed and untreated, even if the disease shows…

Image and Video Processing · Electrical Eng. & Systems 2024-11-22 Allen Yang , Edward Yang

The increasing global prevalence of mental disorders, such as depression and PTSD, requires objective and scalable diagnostic tools. Traditional clinical assessments often face limitations in accessibility, objectivity, and consistency.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-03 Abdelrahaman A. Hassan , Abdelrahman A. Ali , Aya E. Fouda , Radwa J. Hanafy , Mohammed E. Fouda

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

The use of artificial intelligence (AI) in healthcare has become a very active research area in the last few years. While significant progress has been made in image classification tasks, only a few AI methods are actually being deployed in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-18 Ramon Correa , Jiwoong Jason Jeong , Bhavik Patel , Hari Trivedi , Judy W. Gichoya , Imon Banerjee

We propose a margin-based loss for tuning joint vision-language models so that their gradient-based explanations are consistent with region-level annotations provided by humans for relatively smaller grounding datasets. We refer to this…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Ziyan Yang , Kushal Kafle , Franck Dernoncourt , Vicente Ordonez

Diffusion priors have been used for blind face restoration (BFR) by fine-tuning diffusion models (DMs) on restoration datasets to recover low-quality images. However, the naive application of DMs presents several key limitations. (i) The…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Senmao Li , Kai Wang , Joost van de Weijer , Fahad Shahbaz Khan , Chun-Le Guo , Shiqi Yang , Yaxing Wang , Jian Yang , Ming-Ming Cheng

Multimodal Model Editing (MMED) aims to correct erroneous knowledge in multimodal models. Existing evaluation methods, adapted from textual model editing, overstate success by relying on low-similarity or random inputs, obscure overfitting.…

Machine Learning · Computer Science 2025-11-18 Xiaoqi Han , Ru Li , Ran Yi , Hongye Tan , Zhuomin Liang , Víctor Gutiérrez-Basulto , Jeff Z. Pan

Bias in medical artificial intelligence is conventionally viewed as a defect requiring elimination. However, human reasoning inherently incorporates biases shaped by education, culture, and experience, suggesting their presence may be…

Artificial Intelligence · Computer Science 2026-03-05 Farhad Abtahi , Mehdi Astaraki , Fernando Seoane

Unified multimodal large language models (U-MLLMs) have demonstrated impressive performance in visual understanding and generation in an end-to-end pipeline. Compared with generation-only models (e.g., Stable Diffusion), U-MLLMs may raise…

Computation and Language · Computer Science 2025-02-06 Ming Liu , Hao Chen , Jindong Wang , Liwen Wang , Bhiksha Raj Ramakrishnan , Wensheng Zhang

We investigated visual reasoning limitations of both multimodal large language models (MLLMs) and image generation models (IGMs) by creating a novel benchmark to systematically compare failure modes across image-to-text and text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Aahana Basappa , Pranay Goel , Anusri Karra , Anish Karra , Asa Gilmore , Kevin Zhu

The subject of "fairness" in artificial intelligence (AI) refers to assessing AI algorithms for potential bias based on demographic characteristics such as race and gender, and the development of algorithms to address this bias. Most…

Computer Vision and Pattern Recognition · Computer Science 2021-07-02 Esther Puyol-Anton , Bram Ruijsink , Stefan K. Piechnik , Stefan Neubauer , Steffen E. Petersen , Reza Razavi , Andrew P. King

Early detection of melanoma, a potentially lethal type of skin cancer with high prevalence worldwide, improves patient prognosis. In retrospective studies, artificial intelligence (AI) has proven to be helpful for enhancing melanoma…

Recent vision-language models (VLMs) achieve strong zero-shot performance via large-scale image-text pretraining and have been widely adopted in medical image analysis. However, existing VLMs remain notably weak at understanding negated…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Tae Hun Kim , Hyun Gyu Lee