English
Related papers

Related papers: FairCLIP: Harnessing Fairness in Vision-Language L…

200 papers

Large language models (LLMs) are approaching expert-level performance in medical question answering (QA), demonstrating strong potential to improve public healthcare. However, underlying biases related to sensitive attributes such as sex…

Artificial Intelligence · Computer Science 2026-01-13 Ying Xiao , Jie Huang , Ruijuan He , Jing Xiao , Mohammad Reza Mousavi , Yepang Liu , Kezhi Li , Zhenpeng Chen , Jie M. Zhang

Vision-Language (V-L) pre-trained models such as CLIP show prominent capabilities in various downstream tasks. Despite this promise, V-L models are notoriously limited by their inherent social biases. A typical demonstration is that V-L…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Haoyu Zhang , Yangyang Guo , Mohan Kankanhalli

Medical image segmentation remains challenging due to limited annotations for training, ambiguous anatomical features, and domain shifts. While vision-language models such as CLIP offer strong cross-modal representations, their potential…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Taha Koleilat , Hojat Asgariandehkordi , Omid Nejati Manzari , Berardino Barile , Yiming Xiao , Hassan Rivaz

Large pre-trained vision-language models such as CLIP provide compact and general-purpose representations of text and images that are demonstrably effective across multiple downstream zero-shot prediction tasks. However, owing to the nature…

Computer Vision and Pattern Recognition · Computer Science 2024-05-20 Sepehr Dehdashtian , Lan Wang , Vishnu Naresh Boddeti

With the advent of sophisticated machine learning (ML) techniques and the promising results they yield, especially in medical applications, where they have been investigated for different tasks to enhance the decision-making process. Since…

In this paper, we construct two research objectives: i) explore the learned embedding space of BiomedCLIP, an open-source large vision language model, to analyse meaningful class separations, and ii) quantify the limitations of BiomedCLIP…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Nafiz Sadman , Farhana Zulkernine , Benjamin Kwan

Multimodal Large Language Models (MLLMs) have demonstrated remarkable effectiveness in various general-domain scenarios, such as visual question answering and image captioning. Recently, researchers have increasingly focused on empowering…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Yan Shu , Chi Liu , Robin Chen , Derek Li , Bryan Dai

The digitization of healthcare data coupled with advances in computational capabilities has propelled the adoption of machine learning (ML) in healthcare. However, these methods can perpetuate or even exacerbate existing disparities,…

Machine Learning · Computer Science 2024-02-02 Qizhang Feng , Mengnan Du , Na Zou , Xia Hu

Machine learning models trained on real-world data often inherit and amplify biases against certain social groups, raising urgent concerns about their deployment at scale. While numerous bias mitigation methods have been proposed, comparing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Xuwei Tan , Ziyu Hu , Xueru Zhang

Objective: Mitigating algorithmic disparities is a critical challenge in healthcare research, where ensuring equity and fairness is paramount. While large-scale healthcare data exist across multiple institutions, cross-institutional…

Computers and Society · Computer Science 2025-08-15 Siqi Li , Qiming Wu , Xin Li , Di Miao , Chuan Hong , Wenjun Gu , Yuqing Shang , Yohei Okada , Michael Hao Chen , Mengying Yan , Yilin Ning , Marcus Eng Hock Ong , Nan Liu

Current benchmarks for assessing vision-language models (VLMs) often focus on their perception or problem-solving capabilities and neglect other critical aspects such as fairness, multilinguality, or toxicity. Furthermore, they differ in…

Computer Vision and Pattern Recognition · Computer Science 2024-10-25 Tony Lee , Haoqin Tu , Chi Heem Wong , Wenhao Zheng , Yiyang Zhou , Yifan Mai , Josselin Somerville Roberts , Michihiro Yasunaga , Huaxiu Yao , Cihang Xie , Percy Liang

Vertical federated learning (VFL) is a privacy-preserving machine learning paradigm that can learn models from features distributed on different platforms in a privacy-preserving way. Since in real-world applications the data may contain…

Machine Learning · Computer Science 2022-11-01 Tao Qi , Fangzhao Wu , Chuhan Wu , Lingjuan Lyu , Tong Xu , Zhongliang Yang , Yongfeng Huang , Xing Xie

Deep learning methods have demonstrated promising results in predicting BI-RADS scores from mammography images. However, the interpretation of these images can vary, leading to discrepancies even among radiologists. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Halil Ibrahim Gulluk , Olivier Gevaert

Large Vision-Language Models (LVLMs) have been widely adopted in various applications; however, they exhibit significant gender biases. Existing benchmarks primarily evaluate gender bias at the demographic group level, neglecting individual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Yisong Xiao , Aishan Liu , QianJia Cheng , Zhenfei Yin , Siyuan Liang , Jiapeng Li , Jing Shao , Xianglong Liu , Dacheng Tao

Long-tailed multi-label visual recognition poses a significant challenge, as images typically contain multiple labels with highly imbalanced class distributions, leading to biased models that favor head classes while underperforming on tail…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Wei Tang , Zuo-Zheng Wang , Kun Zhang , Tong Wei , Min-Ling Zhang

While Vision-Language Models (VLMs) have achieved notable progress in computational pathology (CPath), the gigapixel scale and spatial heterogeneity of Whole Slide Images (WSIs) continue to pose challenges for multimodal understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Fengchun Liu , Songhan Jiang , Linghan Cai , Ziyue Wang , Yongbing Zhang

Does everyone equally benefit from computer vision systems? Answers to this question become more and more important as computer vision systems are deployed at large scale, and can spark major concerns when they exhibit vast performance…

Computer Vision and Pattern Recognition · Computer Science 2022-02-16 Priya Goyal , Adriana Romero Soriano , Caner Hazirbas , Levent Sagun , Nicolas Usunier

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

Vision-Language Models (VLMs) have achieved remarkable success on multimodal tasks such as image-text retrieval and zero-shot classification, yet they can exhibit demographic biases even when explicit protected attributes are absent during…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Ahsan Habib Akash , Greg Murray , Annahita Amireskandari , Joel Palko , Carol Laxson , Binod Bhattarai , Prashnna Gyawali

Deep learning based visual-linguistic multimodal models such as Contrastive Language Image Pre-training (CLIP) have become increasingly popular recently and are used within text-to-image generative models such as DALL-E and Stable…

Computers and Society · Computer Science 2023-09-12 Abhishek Mandal , Suzanne Little , Susan Leavy