English
Related papers

Related papers: XCoOp: Explainable Prompt Learning for Computer-Ai…

200 papers

Parameter-efficient fine-tuning (PEFT) of vision-language models (VLMs) excels in various vision tasks thanks to the rich knowledge and generalization ability of VLMs. However, recent studies revealed that such fine-tuned VLMs are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Nayeong Kim , Seong Joon Oh , Suha Kwak

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

Modern AI systems frequently rely on opaque black-box models, most notably Deep Neural Networks, whose performance stems from complex architectures with millions of learned parameters. While powerful, their complexity poses a major…

Machine Learning · Computer Science 2026-02-23 David Dembinsky , Adriano Lucieri , Stanislav Frolov , Hiba Najjar , Ko Watanabe , Andreas Dengel

Concept-based interpretability methods are a popular form of explanation for deep learning models which provide explanations in the form of high-level human interpretable concepts. These methods typically find concept activation vectors…

Machine Learning · Computer Science 2024-08-19 Angus Nicolson , Yarin Gal , J. Alison Noble

As the manufacturing industry advances with sensor integration and automation, the opaque nature of deep learning models in machine learning poses a significant challenge for fault detection and diagnosis. And despite the related predictive…

Artificial Intelligence · Computer Science 2024-06-11 Ahmed Maged , Salah Haridy , Herman Shen

Deep learning (DL) has been used in the automatic diagnosis of Mild Cognitive Impairment (MCI) and Alzheimer's Disease (AD) with brain imaging data. However, previous methods have not fully exploited the relation between brain image and…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Luoyao Kang , Haifan Gong , Xiang Wan , Haofeng Li

(Renyi Qu's Master's Thesis) Recent advancements in interpretable models for vision-language tasks have achieved competitive performance; however, their interpretability often suffers due to the reliance on unstructured text outputs from…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Renyi Qu , Mark Yatskar

A key issue in critical contexts such as medical diagnosis is the interpretability of the deep learning models adopted in decision-making systems. Research in eXplainable Artificial Intelligence (XAI) is trying to solve this issue. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-24 Carlo Metta , Andrea Beretta , Riccardo Guidotti , Yuan Yin , Patrick Gallinari , Salvatore Rinzivillo , Fosca Giannotti

Prompt tuning for vision-language models such as CLIP involves optimizing the text prompts used to generate image-text pairs for specific downstream tasks. While hand-crafted or template-based prompts are generally applicable to a wider…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Qian Zhang

Text-to-image models are powerful for producing high-quality images based on given text prompts, but crafting these prompts often requires specialized vocabulary. To address this, existing methods train rewriting models with supervision…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Hongji Yang , Yucheng Zhou , Wencheng Han , Jianbing Shen

As data requirements continue to grow, efficient learning increasingly depends on the curation and distillation of high-value data rather than brute-force scaling of model sizes. In the case of a hyperspectral image (HSI), the challenge is…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Abhiroop Chatterjee , Susmita Ghosh

Multimodal Large Language Models (MLLMs) have shown promise in visual-textual reasoning, with Multimodal Chain-of-Thought (MCoT) prompting significantly enhancing interpretability. However, existing MCoT methods rely on rationale-rich…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yiwen Jiang , Deval Mehta , Siyuan Yan , Yaling Shen , Zimu Wang , Zongyuan Ge

Convolutional neural network based systems have largely failed to be adopted in many high-risk application areas, including healthcare, military, security, transportation, finance, and legal, due to their highly uninterpretable "black-box"…

Image and Video Processing · Electrical Eng. & Systems 2020-06-23 Rodney LaLonde , Drew Torigian , Ulas Bagci

Vision-language models are pre-trained by aligning image-text pairs in a common space to deal with open-set visual concepts. To boost the transferability of the pre-trained models, recent works adopt fixed or learnable prompts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Jiangmeng Li , Wenyi Mo , Wenwen Qiang , Bing Su , Changwen Zheng , Hui Xiong , Ji-Rong Wen

Despite the efficiency of prompt learning in transferring vision-language models (VLMs) to downstream tasks, existing methods mainly learn the prompts in a coarse-grained manner where the learned prompt vectors are shared across all…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jingjing Xie , Yuxin Zhang , Jun Peng , Zhaohong Huang , Liujuan Cao

The use of wearables in medicine and wellness, enabled by AI-based models, offers tremendous potential for real-time monitoring and interpretable event detection. Explainable AI (XAI) is required to assess what models have learned and build…

Signal Processing · Electrical Eng. & Systems 2026-03-16 Maurice Kuschel , Solveig Vieluf , Claus Reinsberger , Tobias Loddenkemper , Tanuj Hasija

Both humans and machine learning models learn from experience, particularly in safety- and reliability-critical domains. While psychology seeks to understand human cognition, the field of Explainable AI (XAI) develops methods to interpret…

Human-Computer Interaction · Computer Science 2025-11-25 Roussel Rahman , Aashwin Ananda Mishra , Wan-Lin Hu

Trained on a vast amount of data, Large Language models (LLMs) have achieved unprecedented success and generalization in modeling fairly complex textual inputs in the abstract space, making them powerful tools for zero-shot learning. Such…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Shervin Ardeshir

Pretrained biomedical vision-language models (VLMs) such as BioMedCLIP perform well on average but often degrade on challenging modalities where inter-class margins are small and acquisition-specific variations are pronounced, especially…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Mainak Singha , Tanisha Gupta , Ankit Jha , Muhammad Haris Khan , Sayantani Ghosh , Biplab Banerjee

In the last years, XAI research has mainly been concerned with developing new technical approaches to explain deep learning models. Just recent research has started to acknowledge the need to tailor explanations to different contexts and…

Artificial Intelligence · Computer Science 2021-10-11 Bettina Finzel , David E. Tafler , Stephan Scheele , Ute Schmid