English
Related papers

Related papers: Towards Achieving Concept Completeness for Textual…

200 papers

Concept bottleneck models (CBM) aim to improve model interpretability by predicting human level "concepts" in a bottleneck within a deep learning model architecture. However, how the predicted concepts are used in predicting the target…

Machine Learning · Computer Science 2025-04-15 Matthew Shen , Aliyah Hsu , Abhineet Agarwal , Bin Yu

As AI models grow larger, the demand for accountability and interpretability has become increasingly critical for understanding their decision-making processes. Concept Bottleneck Models (CBMs) have gained attention for enhancing…

Machine Learning · Computer Science 2024-10-10 Angelos Ragkousis , Sonali Parbhoo

Large-scale vision-language models such as CLIP have achieved remarkable success in zero-shot image recognition, yet their predictions remain largely opaque to human understanding. In contrast, Concept Bottleneck Models provide…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Onat Ozdemir , Anders Christensen , Stephan Alaniz , Zeynep Akata , Emre Akbas

The next-token prediction (NTP) objective has been foundational in the development of modern large language models (LLMs), driving advances in fluency and generalization. However, NTP operates at the \textit{token} level, treating…

Computation and Language · Computer Science 2026-01-23 Laya Iyer , Pranav Somani , Alice Guo , Dan Jurafsky , Chen Shani

Interpreting and explaining the behavior of deep neural networks is critical for many tasks. Explainable AI provides a way to address this challenge, mostly by providing per-pixel relevance to the decision. Yet, interpreting such…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Bowen Wang , Liangzhi Li , Yuta Nakashima , Hajime Nagahara

Large, publicly available clinical datasets have emerged as a novel resource for understanding disease heterogeneity and to explore personalization of therapy. These datasets are derived from data not originally collected for research…

Machine Learning · Computer Science 2025-08-14 Anish Narain , Ritam Majumdar , Nikita Narayanan , Dominic Marshall , Sonali Parbhoo

The field of Artificial Intelligence (AI) continues to drive transformative innovations, with significant progress in conversational interfaces, autonomous vehicles, and intelligent content creation. Since the launch of ChatGPT in late…

Computation and Language · Computer Science 2025-01-13 Hussain Ahmad , Diksha Goel

Despite the transformative impact of deep learning across multiple domains, the inherent opacity of these models has driven the development of Explainable Artificial Intelligence (XAI). Among these efforts, Concept Bottleneck Models (CBMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Songning Lai , Jiayu Yang , Yu Huang , Lijie Hu , Tianlang Xue , Zhangyi Hu , Jiaxu Li , Haicheng Liao , Yutao Yue

We propose an automated genomic interpretation module that transforms raw DNA sequences into actionable, interpretable decisions suitable for integration into medical automation and robotic systems. Our framework combines Chaos Game…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zijun Li , Jinchang Zhang , Ming Zhang , Guoyu Lu

Concept Bottleneck Models (CBMs) and other concept-based interpretable models show great promise for making AI applications more transparent, which is essential in fields like medicine. Despite their success, we demonstrate that CBMs…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Jessica Bader , Leander Girrbach , Stephan Alaniz , Zeynep Akata

Concept bottleneck models map from raw inputs to concepts, and then from concepts to targets. Such models aim to incorporate pre-specified, high-level concepts into the learning procedure, and have been motivated to meet three desiderata:…

Machine Learning · Computer Science 2021-05-11 Andrei Margeloiu , Matthew Ashman , Umang Bhatt , Yanzhi Chen , Mateja Jamnik , Adrian Weller

Recent advances in Large Language Models (LLMs) have significantly enhanced their capabilities, highlighting the need for comprehensive evaluation frameworks that extend beyond task-specific benchmarks. However, existing benchmarks often…

Computation and Language · Computer Science 2025-09-30 Haosi Mo , Xinyu Ma , Xuebo Liu , Derek F. Wong , Yu Li , Jie Liu , Min Zhang

Transforming unstructured text into structured and meaningful forms, organized by useful category labels, is a fundamental step in text mining for downstream analysis and application. However, most existing methods for producing label…

Recently, interpretable machine learning has re-explored concept bottleneck models (CBM). An advantage of this model class is the user's ability to intervene on predicted concept values, affecting the downstream output. In this work, we…

Machine Learning · Computer Science 2024-10-29 Sonia Laguna , Ričards Marcinkevičs , Moritz Vandenhirtz , Julia E. Vogt

Continuous prompts have become widely adopted for augmenting performance across a wide range of natural language tasks. However, the underlying mechanism of this enhancement remains obscure. Previous studies rely on individual words for…

Computation and Language · Computer Science 2024-12-06 Qian Chen , Dongyang Li , Xiaofeng He

Concept bottleneck models perform classification by first predicting which of a list of human provided concepts are true about a datapoint. Then a downstream model uses these predicted concept labels to predict the target label. The…

Machine Learning · Computer Science 2022-11-08 Joshua Lockhart , Nicolas Marchesotti , Daniele Magazzeni , Manuela Veloso

Concept Bottleneck Models (CBMs) in medical imaging aim to improve model interpretability by predicting intermediate clinical concepts before final diagnoses. However, most existing CBMs treat concepts as discriminative predictors of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Amy Rafferty , Rishi Ramaesh , Ajitha Rajan

We propose a Topic Compositional Neural Language Model (TCNLM), a novel method designed to simultaneously capture both the global semantic meaning and the local word ordering structure in a document. The TCNLM learns the global semantic…

Machine Learning · Computer Science 2018-02-27 Wenlin Wang , Zhe Gan , Wenqi Wang , Dinghan Shen , Jiaji Huang , Wei Ping , Sanjeev Satheesh , Lawrence Carin

Despite their success in various domains, the growing dependence on GNNs raises a critical concern about the nature of the combinatorial reasoning underlying their predictions, which is often hidden within their black-box architectures.…

Machine Learning · Computer Science 2026-03-03 Yue Niu , Zhaokai Sun , Jiayi Yang , Xiaofeng Cao , Rui Fan , Xin Sun , Hanli Wang , Wei Ye

While deep learning models often lack interpretability, concept bottleneck models (CBMs) provide inherent explanations via their concept representations. Moreover, they allow users to perform interventional interactions on these concepts by…

Machine Learning · Computer Science 2024-06-05 David Steinmann , Wolfgang Stammer , Felix Friedrich , Kristian Kersting