中文
相关论文

相关论文: Failing Conceptually: Concept-Based Explanations o…

200 篇论文

In machine learning, concept drift is an evolution of information that invalidates the current data model. It happens when the statistical properties of the input data change over time in unforeseen ways. Concept drift detection is crucial…

机器学习 · 计算机科学 2024-06-21 Honorius Galmeanu , Razvan Andonie

Deploying AI-powered systems requires trustworthy models supporting effective human interactions, going beyond raw prediction accuracy. Concept bottleneck models promote trustworthiness by conditioning classification tasks on an…

Concept Bottleneck Models (CBMs) tackle the opacity of neural architectures by constructing and explaining their predictions using a set of high-level concepts. A special property of these models is that they permit concept interventions,…

Distribution shift, a change in the statistical properties of data over time, poses a critical challenge for deep learning anomaly detection systems. Existing anomaly detection systems often struggle to adapt to these shifts. Specifically,…

密码学与安全 · 计算机科学 2026-05-19 Ehssan Mousavipour , Andrey Dimanchev , Majid Ghaderi

Out-of-distribution (OOD) detection plays a crucial role in ensuring the safe deployment of deep neural network (DNN) classifiers. While a myriad of methods have focused on improving the performance of OOD detectors, a critical gap remains…

机器学习 · 计算机科学 2023-06-07 Jihye Choi , Jayaram Raghuram , Ryan Feng , Jiefeng Chen , Somesh Jha , Atul Prakash

This paper studies the problem of concept-based interpretability of transformer representations for videos. Concretely, we seek to explain the decision-making process of video transformers based on high-level, spatiotemporal concepts that…

计算机视觉与模式识别 · 计算机科学 2024-04-11 Matthew Kowal , Achal Dave , Rares Ambrus , Adrien Gaidon , Konstantinos G. Derpanis , Pavel Tokmakov

Concept Bottleneck Models (CBMs) are neural networks designed to conjoin high performance with ante-hoc interpretability. CBMs work by first mapping inputs (e.g., images) to high-level concepts (e.g., visible objects and their properties)…

Concept Bottleneck Models (CBMs) map the inputs onto a set of interpretable concepts (``the bottleneck'') and use the concepts to make predictions. A concept bottleneck enhances interpretability since it can be investigated to understand…

机器学习 · 计算机科学 2023-02-03 Mert Yuksekgonul , Maggie Wang , James Zou

Despite their success, Large-Language Models (LLMs) still face criticism due to their lack of interpretability. Traditional post-hoc interpretation methods, based on attention and gradient-based analysis, offer limited insights as they only…

A failure detection system is the first step towards predictive maintenance strategies. A popular data-driven method to detect incipient failures and anomalies is the training of normal behaviour models by applying a machine learning…

机器学习 · 计算机科学 2021-06-21 Iñigo Martinez , Elisabeth Viles , Iñaki Cabrejas

Concept bottleneck models (CBMs) are inherently interpretable models that make predictions based on human-understandable visual cues, referred to as concepts. As obtaining dense concept annotations with human labeling is demanding and…

计算机视觉与模式识别 · 计算机科学 2025-08-21 Sujin Jeon , Hyundo Lee , Eungseo Kim , Sanghack Lee , Byoung-Tak Zhang , Inwoo Hwang

Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Deepika SN Vemuri , Gautham Bellamkonda , Aditya Pola , Vineeth N Balasubramanian

The task of out-of-distribution (OOD) detection is notoriously ill-defined. Earlier works focused on new-class detection, aiming to identify label-altering data distribution shifts, also known as "semantic shift." However, recent works…

计算机视觉与模式识别 · 计算机科学 2024-03-20 William Yang , Byron Zhang , Olga Russakovsky

Concept Bottleneck Models (CBM) map images to human-interpretable concepts before making class predictions. Recent approaches automate CBM construction by prompting Large Language Models (LLMs) to generate text concepts and employing Vision…

计算机视觉与模式识别 · 计算机科学 2024-08-27 Nithish Muthuchamy Selvaraj , Xiaobao Guo , Adams Wai-Kin Kong , Alex Kot

Concept-based explanations have emerged as a popular way of extracting human-interpretable representations from deep discriminative models. At the same time, the disentanglement learning literature has focused on extracting similar…

机器学习 · 计算机科学 2021-04-15 Dmitry Kazhdan , Botty Dimanov , Helena Andres Terre , Mateja Jamnik , Pietro Liò , Adrian Weller

As complex machine learning models are increasingly used in sensitive applications like banking, trading or credit scoring, there is a growing demand for reliable explanation mechanisms. Local feature attribution methods have become a…

机器学习 · 计算机科学 2022-09-08 Johannes Haug , Alexander Braun , Stefan Zürn , Gjergji Kasneci

Continual learning from data streams is among the most important topics in contemporary machine learning. One of the biggest challenges in this domain lies in creating algorithms that can continuously adapt to arriving data. However,…

机器学习 · 计算机科学 2021-04-22 Łukasz Korycki , Bartosz Krawczyk

Given a sequence of random (directed and weighted) graphs, we address the problem of online monitoring and detection of changes in the underlying data distribution. Our idea is to endow sequential change-point detection (CPD) techniques…

机器学习 · 计算机科学 2022-02-03 Bernardo Marenco , Paola Bermolen , Marcelo Fiori , Federico Larroca , Gonzalo Mateos

Multimodal LLMs (MLLMs) have reached remarkable levels of proficiency in understanding multimodal inputs. However, understanding and interpreting the behavior of such complex models is a challenging task, not to mention the dynamic shifts…

人工智能 · 计算机科学 2025-08-14 Pegah Khayatan , Mustafa Shukor , Jayneel Parekh , Arnaud Dapogny , Matthieu Cord

Concept bottleneck models (CBMs) are inherently interpretable and intervenable neural network models, which explain their final label prediction by the intermediate prediction of high-level semantic concepts. However, they require target…

机器学习 · 计算机科学 2026-04-06 Shin'ya Yamaguchi , Kosuke Nishida , Daiki Chijiwa , Yasutoshi Ida