English
Related papers

Related papers: Vision-Language Models Encode Clinical Guidelines …

200 papers

Automated essay scoring (AES) has advanced significantly with neural language models, yet most systems remain opaque, offering little visibility into how grades are produced. In educational settings, instructors must be able to understand,…

Computation and Language · Computer Science 2026-04-22 Kumar Satvik Chaudhary , Chengshuai Zhao , Fan Zhang , Garima Agrawal , Yuli Deng , Huan Liu

In zero-shot image recognition tasks, humans demonstrate remarkable flexibility in classifying unseen categories by composing known simpler concepts. However, existing vision-language models (VLMs), despite achieving significant progress…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Hui Liu , Wenya Wang , Kecheng Chen , Jie Liu , Yibing Liu , Tiexin Qin , Peisong He , Xinghao Jiang , Haoliang Li

Concept Bottleneck Models (CBMs) enable interpretable image classification by structuring predictions around human-understandable concepts, but extending this paradigm to video remains challenging due to the difficulty of extracting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Patrick Knab , Sascha Marton , Philipp J. Schubert , Drago Guggiana , Christian Bartelt

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a humanunderstandable concept layer. However, most previous studies focused on cases where the data, including…

Machine Learning · Computer Science 2025-02-04 Lijie Hu , Chenyang Ren , Zhengyu Hu , Hongbin Lin , Cheng-Long Wang , Hui Xiong , Jingfeng Zhang , Di Wang

There is growing interest in concept-based models (CBMs) that combine high-performance and interpretability by acquiring and reasoning with a vocabulary of high-level concepts. A key requirement is that the concepts be interpretable.…

Machine Learning · Computer Science 2022-10-19 Emanuele Marconato , Andrea Passerini , Stefano Teso

Concept bottleneck models (CBMs) ensure interpretability by decomposing predictions into human interpretable concepts. Yet the annotations used for training CBMs that enable this transparency are often noisy, and the impact of such…

Machine Learning · Computer Science 2026-02-02 Seonghwan Park , Jueun Mun , Donghyun Oh , Namhoon Lee

Concept Bottleneck Models (CBMs) and other concept-based interpretable models show great promise for making AI applications more transparent, which is essential in fields like medicine. Despite their success, we demonstrate that CBMs…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Jessica Bader , Leander Girrbach , Stephan Alaniz , Zeynep Akata

The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, these models are often treated as black boxes, with limited systematic investigation of their…

Machine Learning · Computer Science 2026-05-13 Konstantinos P. Panousis , Diego Marcos

While RFML is expected to be a key enabler of future wireless standards, a significant challenge to the widespread adoption of RFML techniques is the lack of explainability in deep learning models. This work investigates the use of CB…

Signal Processing · Electrical Eng. & Systems 2021-01-06 Lauren J. Wong , Sean McPherson

Ensuring fairness in image classification prevents models from perpetuating and amplifying bias. Concept bottleneck models (CBMs) map images to high-level, human-interpretable concepts before making predictions via a sparse, one-layer…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Schrasing Tong , Antoine Salaun , Vincent Yuan , Annabel Adeyeri , Lalana Kagal

Concept bottleneck models are interpretable predictive models that are often used in domains where model trust is a key priority, such as healthcare. They identify a small number of human-interpretable concepts in the data, which they then…

Machine Learning · Computer Science 2024-12-25 Katrina Brown , Marton Havasi , Finale Doshi-Velez

Voice disorders affect a significant portion of the population, and the ability to diagnose them using automated, non-invasive techniques would represent a substantial advancement in healthcare, improving the quality of life of patients.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Davide Ghia , Gabriele Ciravegna , Alkis Koudounas , Marco Fantini , Erika Crosetti , Giovanni Succo , Tania Cerquitelli

Deep learning has demonstrated expert-level performance in melanoma classification, positioning it as a powerful tool in clinical dermatology. However, model opacity and the lack of interpretability remain critical barriers to clinical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Junwen Zheng , Xinran Xu , Li Rong Wang , Chang Cai , Lucinda Siyun Tan , Dingyuan Wang , Hong Liang Tey , Xiuyi Fan

Concept Bottleneck Models (CBMs) map dense feature representations into human-interpretable concepts which are then combined linearly to make a prediction. However, modern CBMs rely on the CLIP model to obtain image-concept annotations, and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-27 Fawaz Sammani , Jonas Fischer , Nikos Deligiannis

As AI models grow larger, the demand for accountability and interpretability has become increasingly critical for understanding their decision-making processes. Concept Bottleneck Models (CBMs) have gained attention for enhancing…

Machine Learning · Computer Science 2024-10-10 Angelos Ragkousis , Sonali Parbhoo

Recent progress in multimodal large language models (MLLMs) has demonstrated promising performance on medical benchmarks and in preliminary trials as clinical assistants. Yet, our pilot audit of diagnostic cases uncovers a critical failure…

Artificial Intelligence · Computer Science 2025-09-30 Hongjun Liu , Yinghao Zhu , Yuhui Wang , Yitao Long , Zeyu Lai , Lequan Yu , Chen Zhao

Vision-Language Models (VLMs) have enabled interpretable medical diagnosis by integrating visual perception with linguistic reasoning. Yet, existing medical chain-of-thought (CoT) models lack explicit mechanisms to represent and enforce…

Artificial Intelligence · Computer Science 2026-05-29 Jianxin Lin , Chunzheng Zhu , Peter J. Kneuertz , Yunfei Bai , Yuan Xue

Deep learning models have gained increasing adoption in medical image analysis. However, these models often produce overconfident predictions, which can compromise clinical accuracy and reliability. Bridging the gap between high-performance…

Image and Video Processing · Electrical Eng. & Systems 2026-03-24 Jutika Borah , Hidam Kumarjit Singh

Vision-language foundation models achieve promising performance in natural image classification, yet their direct application to medical imaging is limited by severe domain shifts, resolution mismatches, and the multi-label nature of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Yitong Li , Morteza Ghahremani , Christian Wachinger

Catastrophic forgetting remains a fundamental challenge in continual learning, in which models often forget previous knowledge when fine-tuned on a new task. This issue is especially pronounced in class incremental learning (CIL), which is…

Machine Learning · Computer Science 2026-04-17 Amirhosein Javadi , Tuomas Oikarinen , Tara Javidi , Tsui-Wei Weng