English
Related papers

Related papers: Causally Reliable Concept Bottleneck Models

200 papers

Language Bottleneck Models (LBMs) are proposed to achieve interpretable image recognition by classifying images based on textual concept bottlenecks. However, current LBMs simply list all concepts together as the bottleneck layer, leading…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Jianyang Zhang , Qianli Luo , Guowu Yang , Wenjing Yang , Weide Liu , Guosheng Lin , Fengmao Lv

Machine learning models have had discernible achievements in a myriad of applications. However, most of these models are black-boxes, and it is obscure how the decisions are made by them. This makes the models unreliable and untrustworthy.…

Machine Learning · Computer Science 2020-03-23 Raha Moraffah , Mansooreh Karami , Ruocheng Guo , Adrienne Raglin , Huan Liu

Despite their success in various domains, the growing dependence on GNNs raises a critical concern about the nature of the combinatorial reasoning underlying their predictions, which is often hidden within their black-box architectures.…

Machine Learning · Computer Science 2026-03-03 Yue Niu , Zhaokai Sun , Jiayi Yang , Xiaofeng Cao , Rui Fan , Xin Sun , Hanli Wang , Wei Ye

Concept-based interpretability methods aim to explain deep neural network model predictions using a predefined set of semantic concepts. These methods evaluate a trained model on a new, "probe" dataset and correlate model predictions with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Ruth Fong , Olga Russakovsky

Conceptual reasoning, the ability to reason in abstract and high-level perspectives, is key to generalization in human cognition. However, limited study has been done on large language models' capability to perform conceptual reasoning. In…

Computation and Language · Computer Science 2024-04-02 Ben Zhou , Hongming Zhang , Sihao Chen , Dian Yu , Hongwei Wang , Baolin Peng , Dan Roth , Dong Yu

Interpretability is a crucial factor in building reliable models for various medical applications. Concept Bottleneck Models (CBMs) enable interpretable image classification by utilizing human-understandable concepts as intermediate…

Computer Vision and Pattern Recognition · Computer Science 2023-08-24 Injae Kim , Jongha Kim , Joonmyung Choi , Hyunwoo J. Kim

Despite strong average-case performance, deep learning models often exhibit systematic errors on specific population groups, known as error slices. Identifying these groups and the root causes of their failures is critical for model…

Machine Learning · Computer Science 2026-05-29 Yael Konforti , Mateo Espinosa Zarlenga , Elaf Almahmoud , Mateja Jamnik

The ability to robustly identify causal relationships is essential for autonomous decision-making and adaptation to novel scenarios. However, accurately inferring causal structure requires integrating both world knowledge and abstract…

Machine Learning · Computer Science 2025-06-17 Khurram Yamin , Shantanu Gupta , Gaurav R. Ghosal , Zachary C. Lipton , Bryan Wilder

Causal reasoning is one of the primary bottlenecks that Large Language Models (LLMs) must overcome to attain human-level intelligence. Recent studies indicate that LLMs display near-random performance on reasoning tasks. To address this, we…

Logic in Computer Science · Computer Science 2025-11-10 Abdolmahdi Bagheri , Matin Alinejad , Mahdi Dehshiri , Kevin Bello , Alireza Akhondi-Asl

The main challenges limiting the adoption of deep learning-based solutions in medical workflows are the availability of annotated data and the lack of interpretability of such systems. Concept Bottleneck Models (CBMs) tackle the latter by…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Cristiano Patrício , Isabel Rio-Torto , Jaime S. Cardoso , Luís F. Teixeira , João C. Neves

Large language models (LLMs) have mastered abundant simple and explicit commonsense knowledge through pre-training, enabling them to achieve human-like performance in simple commonsense reasoning. Nevertheless, LLMs struggle to reason with…

Computation and Language · Computer Science 2025-06-10 Kai Xiong , Xiao Ding , Yixin Cao , Yuxiong Yan , Li Du , Yufei Zhang , Jinglong Gao , Jiaqian Liu , Bing Qin , Ting Liu

Deep generative models have shown tremendous capability in data density estimation and data generation from finite samples. While these models have shown impressive performance by learning correlations among features in the data, some…

Machine Learning · Computer Science 2024-05-24 Aneesh Komanduri , Xintao Wu , Yongkai Wu , Feng Chen

Deep networks have shown remarkable performance across a wide range of tasks, yet getting a global concept-level understanding of how they function remains a key challenge. Many post-hoc concept-based approaches have been introduced to…

Machine Learning · Computer Science 2026-04-15 Amin Parchami-Araghi , Sukrut Rao , Jonas Fischer , Bernt Schiele

Concept-based eXplainable AI (C-XAI) is a rapidly growing research field that enhances AI model interpretability by leveraging intermediate, human-understandable concepts. This approach not only enhances model transparency but also enables…

Machine Learning · Computer Science 2025-04-08 Francesco De Santis , Gabriele Ciravegna , Philippe Bich , Danilo Giordano , Tania Cerquitelli

We introduce Graph Concept Bottleneck (GCB) as a new paradigm for self-explainable text-attributed graph learning. GCB maps graphs into a subspace, concept bottleneck, where each concept is a meaningful phrase, and predictions are made…

Machine Learning · Computer Science 2026-04-15 Xiaoxue Han , Libo Zhang , Zining Zhu , Yue Ning

Large, publicly available clinical datasets have emerged as a novel resource for understanding disease heterogeneity and to explore personalization of therapy. These datasets are derived from data not originally collected for research…

Machine Learning · Computer Science 2025-08-14 Anish Narain , Ritam Majumdar , Nikita Narayanan , Dominic Marshall , Sonali Parbhoo

Concept Bottleneck Models (CBNMs) are deep learning models that provide interpretability by enforcing a bottleneck layer where predictions are based exclusively on human-understandable concepts. However, this constraint also restricts…

Machine Learning · Computer Science 2025-10-17 David Debot , Giuseppe Marra

Reasoning, a crucial aspect of NLP research, has not been adequately addressed by prevailing models including Large Language Model. Conversation reasoning, as a critical component of it, remains largely unexplored due to the absence of a…

Computation and Language · Computer Science 2024-01-17 Hang Chen , Bingyu Liao , Jing Luo , Wenjing Zhu , Xinyu Yang

Modern neural networks rarely have a single way to be right. For many tasks, multiple models can achieve identical performance while relying on different features or reasoning patterns, a property known as the Rashomon Effect. However,…

Machine Learning · Computer Science 2025-11-26 Shihan Feng , Cheng Zhang , Michael Xi , Ethan Hsu , Lesia Semenova , Chudi Zhong

Causal generative modeling is essential for developing reliable and transparent AI systems capable of counterfactual reasoning. While existing approaches focus on integrating causal constraints during the training of generative models, they…

Machine Learning · Computer Science 2026-05-25 Aneesh Komanduri , Xintao Wu