English
Related papers

Related papers: Mitigating Spurious Background Bias in Multimedia …

200 papers

The increasing complexity of AI models, especially in deep learning, has raised concerns about transparency and accountability, particularly in high-stakes applications like medical diagnostics, where opaque models can undermine trust.…

Cryptography and Security · Computer Science 2024-11-26 Songning Lai , Yu Huang , Jiayu Yang , Gaoxiang Huang , Wenshuo Chen , Yutao Yue

Due to the high stakes in medical decision-making, there is a compelling demand for interpretable deep learning methods in medical image analysis. Concept Bottleneck Models (CBM) have emerged as an active interpretable framework…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Yibo Gao , Zheyao Gao , Xin Gao , Yuanye Liu , Bomin Wang , Xiahai Zhuang

Automated ICD-10 coding from clinical discharge summaries requires models that are both accurate on long-tailed multi-label classification tasks and interpretable to clinicians. Concept Bottleneck Models (CBMs) offer a principled framework…

Machine Learning · Computer Science 2026-05-12 Mohammed Sameer Syed , Xuan Lu

Accurately assessing student knowledge is central to education. Cognitive Diagnosis (CD) models estimate student proficiency at a fixed point in time, while Knowledge Tracing (KT) methods model evolving knowledge states to predict future…

Computation and Language · Computer Science 2026-02-10 Antonin Berthon , Mihaela van der Schaar

With growing demand for interpretability in deep learning, especially in high stakes domains, Concept Bottleneck Models (CBMs) address this by inserting human understandable concepts into the prediction pipeline, but they are generally…

Computer Vision and Pattern Recognition · Computer Science 2025-10-02 Jiakai Lin , Jinchang Zhang , Guoyu Lu

While deep learning models often lack interpretability, concept bottleneck models (CBMs) provide inherent explanations via their concept representations. Moreover, they allow users to perform interventional interactions on these concepts by…

Machine Learning · Computer Science 2024-06-05 David Steinmann , Wolfgang Stammer , Felix Friedrich , Kristian Kersting

The increasing use of neural networks in various applications has lead to increasing apprehensions, underscoring the necessity to understand their operations beyond mere final predictions. As a solution to enhance model transparency,…

Machine Learning · Computer Science 2023-11-21 Ivaxi Sheth , Samira Ebrahimi Kahou

The lack of transparency in the decision-making processes of deep learning systems presents a significant challenge in modern artificial intelligence (AI), as it impairs users' ability to rely on and verify these systems. To address this…

Artificial Intelligence · Computer Science 2024-11-18 David Debot , Pietro Barbiero , Francesco Giannini , Gabriele Ciravegna , Michelangelo Diligenti , Giuseppe Marra

Concept Bottleneck Models (CBNMs) are deep learning models that provide interpretability by enforcing a bottleneck layer where predictions are based exclusively on human-understandable concepts. However, this constraint also restricts…

Machine Learning · Computer Science 2025-10-17 David Debot , Giuseppe Marra

Vision-language co-embedding networks, such as CLIP, provide a latent embedding space with semantic information that is useful for downstream tasks. We hypothesize that the embedding space can be disentangled to separate the information on…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Zhi Li , Hau Phan , Matthew Emigh , Austin J. Brockmeier

Concept bottleneck models (CBM) aim to produce inherently interpretable models that rely on human-understandable concepts for their predictions. However, existing approaches to design interpretable generative models based on CBMs are not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Akshay Kulkarni , Ge Yan , Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

Concept Bottleneck Models (CBMs) enhance interpretability by explaining predictions through human-understandable concepts but typically assume that training and test data share the same distribution. This assumption often fails under domain…

Machine Learning · Computer Science 2025-05-09 Xinyue Xu , Yueying Hu , Hui Tang , Yi Qin , Lu Mi , Hao Wang , Xiaomeng Li

Concept Bottleneck Models (CBMs) have emerged as a cornerstone approach for interpretable machine learning, providing human-understandable intermediate representations through explicit concept activations. However, this interpretability…

Machine Learning · Computer Science 2026-05-26 Aditya Sridhar

Deep learning models have achieved strong performance in medical image analysis, but their internal decision processes remain difficult to interpret. Concept Bottleneck Models (CBMs) partially address this limitation by structuring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Getamesay Dagnaw , Xuefei Yin , Muhammad Hassan Maqsood , Yanming Zhu , Alan Wee-Chung Liew

Recent advances in multimodal large language models (LLMs) have shown extreme effectiveness in visual question answering (VQA). However, the design nature of these end-to-end models prevents them from being interpretable to humans,…

Computation and Language · Computer Science 2024-04-16 Xingyu Fu , Ben Zhou , Sihao Chen , Mark Yatskar , Dan Roth

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

Models based on human-understandable concepts have received extensive attention to improve model interpretability for trustworthy artificial intelligence in the field of medical image analysis. These methods can provide convincing…

Computer Vision and Pattern Recognition · Computer Science 2024-12-25 Hongmei Wang , Junlin Hou , Hao Chen

Deep vision models often rely on biases learned from spurious correlations in datasets. To identify these biases, methods that interpret high-level, human-understandable concepts are more effective than those relying primarily on low-level…

Computer Vision and Pattern Recognition · Computer Science 2025-05-19 David Méndez , Gianpaolo Bontempo , Elisa Ficarra , Roberto Confalonieri , Natalia Díaz-Rodríguez

Multimodal data has significantly advanced recommendation systems by integrating diverse information sources to model user preferences and item characteristics. However, these systems often struggle with redundant and irrelevant…

Information Retrieval · Computer Science 2025-09-25 Hui Wang , Jinghui Qin , Wushao Wen , Qingling Li , Shanshan Zhong , Zhongzhan Huang

Large Vision-Language Models (LVLMs) are pivotal for real-world AI tasks like embodied intelligence due to their strong vision-language reasoning abilities. However, current LVLMs process entire images at the token level, which is…

Computation and Language · Computer Science 2025-05-20 Run Luo , Renke Shan , Longze Chen , Ziqiang Liu , Lu Wang , Min Yang , Xiaobo Xia