中文
相关论文

相关论文: Guarding the Gate: ConceptGuard Battles Concept-Le…

200 篇论文

AI systems are rapidly advancing in capability, and frontier model developers broadly acknowledge the need for safeguards against serious misuse. However, this paper demonstrates that fine-tuning, whether via open weights or closed…

密码学与安全 · 计算机科学 2025-09-23 Brendan Murphy , Dillon Bowen , Shahrad Mohammadzadeh , Tom Tseng , Julius Broomfield , Adam Gleave , Kellin Pelrine

Concept-based explanation methods, such as concept bottleneck models (CBMs), aim to improve the interpretability of machine learning models by linking their decisions to human-understandable concepts, under the critical assumption that such…

人工智能 · 计算机科学 2025-02-03 Halil Ibrahim Aysel , Xiaohao Cai , Adam Prugel-Bennett

Concept Bottleneck Models (CBMs) enhance the interpretability of neural networks by basing predictions on human-understandable concepts. However, current CBMs typically rely on concept sets extracted from large language models or extensive…

计算机视觉与模式识别 · 计算机科学 2025-07-03 Katharina Prasse , Patrick Knab , Sascha Marton , Christian Bartelt , Margret Keuper

Concept Bottleneck Models (CBMs) map the black-box visual representations extracted by deep neural networks onto a set of interpretable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making…

机器学习 · 计算机科学 2024-04-18 Chenming Shang , Shiji Zhou , Hengyuan Zhang , Xinzhe Ni , Yujiu Yang , Yuwang Wang

The deployment of Large Reasoning Models (LRMs) in high-stakes decision-making pipelines has introduced a novel and opaque attack surface: reasoning backdoors. In these attacks, the model's intermediate Chain-of-Thought (CoT) is manipulated…

密码学与安全 · 计算机科学 2026-03-04 Zhen Guo , Shanghao Shi , Hao Li , Shamim Yazdani , Ning Zhang , Reza Tourani

Concept Bottleneck Models (CBMs) are a prominent framework for interpretable AI that map learned visual features to a set of meaningful concepts for task-specific downstream predictions. Their sequential structure enhances transparency by…

In the context of image classification, Concept Bottleneck Models (CBMs) first embed images into a set of human-understandable concepts, followed by an intrinsically interpretable classifier that predicts labels based on these intermediate…

计算机视觉与模式识别 · 计算机科学 2025-10-02 Haifei Zhang , Patrick Barry , Eduardo Brandao

The demand for reliable AI systems has intensified the need for interpretable deep neural networks. Concept bottleneck models (CBMs) have gained attention as an effective approach by leveraging human-understandable concepts to enhance…

计算机视觉与模式识别 · 计算机科学 2024-09-24 Sangwon Kim , Dasom Ahn , Byoung Chul Ko , In-su Jang , Kwang-Ju Kim

Deep Neural Networks (DNNs) are often considered black boxes due to their opaque decision-making processes. To reduce their opacity Concept Models (CMs), such as Concept Bottleneck Models (CBMs), were introduced to predict human-defined…

人机交互 · 计算机科学 2025-12-02 Jack Furby , Dan Cunnington , Dave Braines , Alun Preece

Deep neural networks have achieved remarkable success in computer vision; however, their black-box nature in decision-making limits interpretability and trust, particularly in safety-critical applications. Interpretability is crucial in…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Ran Eisenberg , Amit Rozner , Ethan Fetaya , Ofir Lindenbaum

Deploying AI-powered systems requires trustworthy models supporting effective human interactions, going beyond raw prediction accuracy. Concept bottleneck models promote trustworthiness by conditioning classification tasks on an…

Recently impressive performance has been achieved in Concept Bottleneck Models (CBM) by utilizing the image-text alignment learned by a large pre-trained vision-language model (i.e. CLIP). However, there exist two key limitations in concept…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Minghong Zhong , Guoshuai Zou , Kanghao Chen , Dexia Chen , Ruixuan Wang

Interpretable models are designed to make decisions in a human-interpretable manner. Representatively, Concept Bottleneck Models (CBM) follow a two-step process of concept prediction and class prediction based on the predicted concepts. CBM…

机器学习 · 计算机科学 2023-06-05 Eunji Kim , Dahuin Jung , Sangha Park , Siwon Kim , Sungroh Yoon

Concept Bottleneck Models (CBMs) are neural networks designed to conjoin high performance with ante-hoc interpretability. CBMs work by first mapping inputs (e.g., images) to high-level concepts (e.g., visible objects and their properties)…

Concept Bottleneck Models (CBMs) aim to deliver interpretable and interventionable predictions by bridging features and labels with human-understandable concepts. While recent CBMs show promising potential, they suffer from information…

机器学习 · 计算机科学 2024-02-12 Ao Sun , Yuanyuan Yuan , Pingchuan Ma , Shuai Wang

Over the past few years, the emergence of backdoor attacks has presented significant challenges to deep learning systems, allowing attackers to insert backdoors into neural networks. When data with a trigger is processed by a backdoor…

密码学与安全 · 计算机科学 2025-03-07 Haiyang Yu , Tian Xie , Jiaping Gui , Pengyang Wang , Ping Yi , Yue Wu

Concept bottleneck models (CBMs) are interpretable models that first predict a set of semantically meaningful features, i.e., concepts, from observations that are subsequently used to condition a downstream task. However, the model's…

机器学习 · 计算机科学 2023-12-04 Renos Zabounidis , Ini Oguntola , Konghao Zhao , Joseph Campbell , Simon Stepputtis , Katia Sycara

Continual learning (CL) aims to enable learning systems to acquire new knowledge constantly without forgetting previously learned information. CL faces the challenge of mitigating catastrophic forgetting while maintaining interpretability…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Lu Yu , Haoyu Han , Zhe Tao , Hantao Yao , Changsheng Xu

The concept bottleneck model (CBM), as a technique improving interpretability via linking predictions to human-understandable concepts, makes high-risk and life-critical medical image classification credible. Typically, existing CBM methods…

计算机视觉与模式识别 · 计算机科学 2025-06-17 Chunjiang Wang , Kun Zhang , Yandong Liu , Zhiyang He , Xiaodong Tao , S. Kevin Zhou

Concept-bottleneck models (CBMs) are neural classifiers that compute predictions from high-level concepts extracted from the input. CBMs ensure stakeholders can understand the concepts -- and the predictions they entail -- by learning these…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Nicola Debole , Andrea Passerini , Stefano Teso , Andrea Pugnana , Emanuele Marconato