中文
相关论文

相关论文: Measuring Leakage in Concept-Based Methods: An Inf…

200 篇论文

Concept bottleneck models (CBM) are a popular way of creating more interpretable neural networks by having hidden layer neurons correspond to human-understandable concepts. However, existing CBMs and their variants have two crucial…

机器学习 · 计算机科学 2023-06-06 Tuomas Oikarinen , Subhro Das , Lam M. Nguyen , Tsui-Wei Weng

In this paper, we investigate how concept-based models (CMs) respond to out-of-distribution (OOD) inputs. CMs are interpretable neural architectures that first predict a set of high-level concepts (e.g., stripes, black) and then predict a…

机器学习 · 计算机科学 2025-08-05 Mateo Espinosa Zarlenga , Gabriele Dominici , Pietro Barbiero , Zohreh Shams , Mateja Jamnik

Concept Bottleneck Models (CBMs) tackle the opacity of neural architectures by constructing and explaining their predictions using a set of high-level concepts. A special property of these models is that they permit concept interventions,…

Concept Bottleneck Models (CBMs) have garnered much attention for their ability to elucidate the prediction process through a humanunderstandable concept layer. However, most previous studies focused on cases where the data, including…

机器学习 · 计算机科学 2025-02-04 Lijie Hu , Chenyang Ren , Zhengyu Hu , Hongbin Lin , Cheng-Long Wang , Hui Xiong , Jingfeng Zhang , Di Wang

Despite their remarkable performance on a wide range of visual tasks, machine learning technologies often succumb to data distribution shifts. Consequently, a range of recent work explores techniques for detecting these shifts.…

机器学习 · 计算机科学 2021-05-04 Maleakhi A. Wijaya , Dmitry Kazhdan , Botty Dimanov , Mateja Jamnik

Concept Bottleneck Models (CBMs) decompose image classification into a process governed by interpretable, human-readable concepts. Recent advances in CBMs have used Large Language Models (LLMs) to generate candidate concepts. However, a…

计算与语言 · 计算机科学 2025-06-03 Yiwen Jiang , Deval Mehta , Wei Feng , Zongyuan Ge

Concept Bottleneck Models (CBMs) aim to improve interpretability in Deep Learning by structuring predictions through human-understandable concepts, but they provide no way to verify whether learned concepts align with the human's intended…

机器学习 · 计算机科学 2026-05-22 Stefano Colamonaco , David Debot , Pietro Barbiero , Giuseppe Marra

The concept bottleneck model (CBM) is an interpretable-by-design framework that makes decisions by first predicting a set of interpretable concepts, and then predicting the class label based on the given concepts. Existing CBMs are trained…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Andong Tan , Fengtao Zhou , Hao Chen

Concept bottleneck models (CBMs), which predict human-interpretable concepts (e.g., nucleus shapes in cell images) before predicting the final output (e.g., cell type), provide insights into the decision-making processes of the model.…

计算机视觉与模式识别 · 计算机科学 2024-07-10 Winnie Pang , Xueyi Ke , Satoshi Tsutsui , Bihan Wen

With the increasing demands for accountability, interpretability is becoming an essential capability for real-world AI applications. However, most methods utilize post-hoc approaches rather than training the interpretable model. In this…

计算机视觉与模式识别 · 计算机科学 2022-02-04 Yoshihide Sawada , Keigo Nakamura

We propose an operational measure of information leakage in a non-stochastic setting to formalize privacy against a brute-force guessing adversary. We use uncertain variables, non-probabilistic counterparts of random variables, to construct…

信息论 · 计算机科学 2021-01-29 Farhad Farokhi , Ni Ding

Despite their success, Large-Language Models (LLMs) still face criticism due to their lack of interpretability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insights as they only…

Machine learning accelerates molecular property prediction, yet state-of-the-art Large Language Models and Graph Neural Networks operate as black boxes. In drug discovery, where safety is critical, this opacity risks masking false…

机器学习 · 计算机科学 2026-03-03 Oscar Rivera , Ziqing Wang , Matthieu Dagommer , Abhishek Pandey , Kaize Ding

The widespread adoption of deep learning models in computer vision has intensified concerns about interpretability. Despite strong performance, these models are often treated as black boxes, with limited systematic investigation of their…

机器学习 · 计算机科学 2026-05-13 Konstantinos P. Panousis , Diego Marcos

The recent mass adoption of DNNs, even in safety-critical scenarios, has shifted the focus of the research community towards the creation of inherently intrepretable models. Concept Bottleneck Models (CBMs) constitute a popular approach…

机器学习 · 计算机科学 2023-08-22 Konstantinos P. Panousis , Dino Ienco , Diego Marcos

Concept Bottleneck Models (CBM) are inherently interpretable models that factor model decisions into human-readable concepts. They allow people to easily understand why a model is failing, a critical feature for high-stakes applications.…

计算机视觉与模式识别 · 计算机科学 2023-04-27 Yue Yang , Artemis Panagopoulou , Shenghao Zhou , Daniel Jin , Chris Callison-Burch , Mark Yatskar

Information flow analysis is a powerful technique for reasoning about the sensitive information exposed by a program during its execution. While past work has proposed information theoretic metrics (e.g., Shannon entropy, min-entropy,…

密码学与安全 · 计算机科学 2010-09-22 Ji Zhu , Mudhakar Srivatsa

Extreme ocean phenomena are challenging not only to predict but to diagnose, as accurate forecasts alone do not reveal the underlying physical drivers. While recent machine learning approaches achieve strong predictive skill, they remain…

机器学习 · 计算机科学 2026-05-14 Sanah Suri , Kieran Ringel , Maike Sonnewald

Concept Bottleneck Models (CBMs) offer inherent interpretability by initially translating images into human-comprehensible concepts, followed by a linear combination of these concepts for classification. However, the annotation of concepts…

计算机视觉与模式识别 · 计算机科学 2025-06-24 Hangzhou He , Lei Zhu , Xinliang Zhang , Shuang Zeng , Qian Chen , Yanye Lu

Concept bottleneck models (CBMs) have emerged as critical tools in domains where interpretability is paramount. These models rely on predefined textual descriptions, referred to as concepts, to inform their decision-making process and offer…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Maor Dikter , Tsachi Blau , Chaim Baskin