English
Related papers

Related papers: XCoOp: Explainable Prompt Learning for Computer-Ai…

200 papers

Large-scale pre-trained Vision-Language Models (VLMs), such as CLIP, establish the correlation between texts and images, achieving remarkable success on various downstream tasks with fine-tuning. In existing fine-tuning methods, the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Yi Zhang , Ce Zhang , Yushun Tang , Zhihai He

Vision-Language Models (VLMs) transfer visual and textual data into a shared embedding space. In so doing, they enable a wide range of multimodal tasks, while also raising critical questions about the nature of machine 'understanding.' In…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Stefanie Schneider

Explainability domain generalization and rare class reliability are critical challenges in medical AI where deep models often fail under real world distribution shifts and exhibit bias against infrequent clinical conditions This paper…

Artificial Intelligence · Computer Science 2026-01-06 Midhat Urooj , Ayan Banerjee , Sandeep Gupta

Large-scale vision-language models (VLMs), e.g., CLIP, learn broad visual concepts from tedious training data, showing superb generalization ability. Amount of prompt learning methods have been proposed to efficiently adapt the VLMs to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Hongyu Hu , Tiancheng Lin , Jie Wang , Zhenbang Sun , Yi Xu

Large Vision Language Models (VLMs), such as CLIP, have significantly contributed to various computer vision tasks, including object recognition and object detection. Their open vocabulary feature enhances their value. However, their…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Ali Rasekh , Sepehr Kazemi Ranjbar , Milad Heidari , Wolfgang Nejdl

Medical image segmentation is a critical component of clinical workflows, enabling accurate diagnosis, treatment planning, and disease monitoring. However, despite the superior performance of transformer-based models over convolutional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Thuraya Alzubaidi , Sana Ammar , Maryam Alsharqi , Islem Rekik , Muzammil Behzad

Low-shot image classification, where training images are limited or inaccessible, has benefited from recent progress on pre-trained vision-language (VL) models with strong generalizability, e.g. CLIP. Prompt learning methods built with VL…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Zhaoheng Zheng , Jingmin Wei , Xuefeng Hu , Haidong Zhu , Ram Nevatia

A central issue addressed by the rapidly growing research area of eXplainable Artificial Intelligence (XAI) is to provide methods to give explanations for the behaviours of Machine Learning (ML) non-interpretable models after the training.…

Machine Learning · Computer Science 2022-08-24 Andrea Apicella , Salvatore Giugliano , Francesco Isgrò , Roberto Prevete

Convolutional neural networks (CNNs) underpin many modern computer vision systems. With applications ranging from common to critical areas, a need to explain and understand the model and its decisions (XAI) emerged. Prior works suggest that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Vojtěch Kůr , Adam Bajger , Adam Kukučka , Marek Hradil , Vít Musil , Tomáš Brázdil

The field of Explainable Artificial Intelligence (XAI) often focuses on users with a strong technical background, making it challenging for non-experts to understand XAI methods. This paper presents "x-[plAIn]", a new approach to make XAI…

In recent years, deep learning has achieved unprecedented success in various computer vision tasks, particularly in object detection. However, the black-box nature and high complexity of deep neural networks pose significant challenges for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 FatemehSadat Seyedmomeni , Mohammad Ali Keyvanrad

The increasing complexity of machine learning models in computer vision, particularly in face verification, requires the development of explainable artificial intelligence (XAI) to enhance interpretability and transparency. This study…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Miriam Doh , Caroline Mazini Rodrigues , N. Boutry , L. Najman , Matei Mancas , Bernard Gosselin

To bridge the gap between vision and language modalities, Multimodal Large Language Models (MLLMs) usually learn an adapter that converts visual inputs to understandable tokens for Large Language Models (LLMs). However, most adapters…

Computer Vision and Pattern Recognition · Computer Science 2024-05-27 Yue Zhang , Hehe Fan , Yi Yang

There has recently been a surge of work in explanatory artificial intelligence (XAI). This research area tackles the important problem that complex machines and algorithms often cannot provide insights into their behavior and thought…

Artificial Intelligence · Computer Science 2019-02-05 Leilani H. Gilpin , David Bau , Ben Z. Yuan , Ayesha Bajwa , Michael Specter , Lalana Kagal

While mainstream vision-language models (VLMs) have advanced rapidly in understanding image level information, they still lack the ability to focus on specific areas designated by humans. Rather, they typically rely on large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Kangyu Zhu , Ziyuan Qin , Huahui Yi , Zekun Jiang , Qicheng Lao , Shaoting Zhang , Kang Li

Vision-language models (VLMs) like CLIP excel in zero-shot learning but often require resource-intensive training to adapt to new tasks. Prompt learning techniques, such as CoOp and CoCoOp, offer efficient adaptation but tend to overfit to…

Computer Vision and Pattern Recognition · Computer Science 2025-08-08 Phuoc-Nguyen Bui , Khanh-Binh Nguyen , Hyunseung Choo

Recognizing daily activities with unobtrusive sensors in smart environments enables various healthcare applications. Monitoring how subjects perform activities at home and their changes over time can reveal early symptoms of health issues,…

Human-Computer Interaction · Computer Science 2024-08-14 Michele Fiori , Gabriele Civitarese , Claudio Bettini

Robustness has become one of the most critical problems in machine learning (ML). The science of interpreting ML models to understand their behavior and improve their robustness is referred to as explainable artificial intelligence (XAI).…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Patrick Koller , Amil V. Dravid , Guido M. Schuster , Aggelos K. Katsaggelos

Last years have been characterized by an upsurge of opaque automatic decision support systems, such as Deep Neural Networks (DNNs). Although they have great generalization and prediction skills, their functioning does not allow obtaining…

Explaining deep learning models is essential for clinical integration of medical image analysis systems. A good explanation highlights if a model depends on spurious features that undermines generalization and harms a subset of patients or,…

Image and Video Processing · Electrical Eng. & Systems 2025-08-18 Yoni Schirris , Eric Marcus , Jonas Teuwen , Hugo Horlings , Efstratios Gavves