English
Related papers

Related papers: Understanding and Enhancing Robustness of Concept-…

200 papers

Recent research studies revealed that neural networks are vulnerable to adversarial attacks. State-of-the-art defensive techniques add various adversarial examples in training to improve models' adversarial robustness. However, these…

Machine Learning · Computer Science 2019-09-13 Chang Song , Zuoguan Wang , Hai Li

Recently, interpretable models called self-explaining models (SEMs) have been proposed with the goal of providing interpretability robustness. We evaluate the interpretability robustness of SEMs and show that explanations provided by SEMs…

Machine Learning · Computer Science 2020-07-03 Haizhong Zheng , Earlence Fernandes , Atul Prakash

Despite the transformative impact of deep learning across multiple domains, the inherent opacity of these models has driven the development of Explainable Artificial Intelligence (XAI). Among these efforts, Concept Bottleneck Models (CBMs)…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Songning Lai , Jiayu Yang , Yu Huang , Lijie Hu , Tianlang Xue , Zhangyi Hu , Jiaxu Li , Haicheng Liao , Yutao Yue

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Concept Bottleneck Models (CBMs) provide explicit interpretations for deep neural networks through concepts and allow intervention with concepts to adjust final predictions. Existing CBMs assume concepts are conditionally independent given…

Machine Learning · Computer Science 2026-05-04 Haotian Xu , Tsui-Wei Weng , Lam M. Nguyen , Tengfei Ma

Robustness in deep neural networks and machine learning algorithms in general is an open research challenge. In particular, it is difficult to ensure algorithmic performance is maintained on out-of-distribution inputs or anomalous instances…

Machine Learning · Computer Science 2022-11-23 Natalie Abreu , Nathan Vaska , Victoria Helus

Throughout the past five years, the susceptibility of neural networks to minimal adversarial perturbations has moved from a peculiar phenomenon to a core issue in Deep Learning. Despite much attention, however, progress towards more robust…

Machine Learning · Statistics 2019-12-13 Wieland Brendel , Jonas Rauber , Matthias Kümmerer , Ivan Ustyuzhaninov , Matthias Bethge

Concept bottleneck models (CBMs) ensure interpretability by decomposing predictions into human interpretable concepts. Yet the annotations used for training CBMs that enable this transparency are often noisy, and the impact of such…

Machine Learning · Computer Science 2026-02-02 Seonghwan Park , Jueun Mun , Donghyun Oh , Namhoon Lee

Recent work has demonstrated that deep neural networks are vulnerable to adversarial examples---inputs that are almost indistinguishable from natural data and yet classified incorrectly by the network. In fact, some of the latest findings…

Machine Learning · Statistics 2019-09-06 Aleksander Madry , Aleksandar Makelov , Ludwig Schmidt , Dimitris Tsipras , Adrian Vladu

Deep neural networks are vulnerable to adversarial examples - small input perturbations that result in incorrect predictions. We study this problem for models of source code, where we want the network to be robust to source-code…

Machine Learning · Computer Science 2022-08-23 Goutham Ramakrishnan , Jordan Henkel , Zi Wang , Aws Albarghouthi , Somesh Jha , Thomas Reps

Concept Bottleneck Models (CBMs) aim for ante-hoc interpretability by learning a bottleneck layer that predicts interpretable concepts before the decision. State-of-the-art approaches typically select which concepts to learn via human…

Machine Learning · Computer Science 2026-03-10 Antonio De Santis , Schrasing Tong , Marco Brambilla , Lalana Kagal

Concept-based explainability methods provide insight into deep learning systems by constructing explanations using human-understandable concepts. While the literature on human reasoning demonstrates that we exploit relationships between…

Machine Learning · Computer Science 2024-05-29 Naveen Raman , Mateo Espinosa Zarlenga , Mateja Jamnik

Deep Neural Networks (DNNs) are often considered black boxes due to their opaque decision-making processes. To reduce their opacity Concept Models (CMs), such as Concept Bottleneck Models (CBMs), were introduced to predict human-defined…

Human-Computer Interaction · Computer Science 2025-12-02 Jack Furby , Dan Cunnington , Dave Braines , Alun Preece

Deep neural networks have been proven to be vulnerable to adversarial examples and various methods have been proposed to defend against adversarial attacks for natural language processing tasks. However, previous defense methods have…

Machine Learning · Computer Science 2024-03-01 Fangyuan Zhang , Huichi Zhou , Shuangjiao Li , Hongtao Wang

Deep neural network-based image compression has been extensively studied. However, the model robustness which is crucial to practical application is largely overlooked. We propose to examine the robustness of prevailing learned image…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Tong Chen , Zhan Ma

The Concept Bottleneck Models (CBMs) of Koh et al. [2020] provide a means to ensure that a neural network based classifier bases its predictions solely on human understandable concepts. The concept labels, or rationales as we refer to them,…

Machine Learning · Computer Science 2022-12-20 Joshua Lockhart , Daniele Magazzeni , Manuela Veloso

In the last a few decades, deep neural networks have achieved remarkable success in machine learning, computer vision, and pattern recognition. Recent studies however show that neural networks (both shallow and deep) may be easily fooled by…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Zhuang Qian , Kaizhu Huang , Qiu-Feng Wang , Xu-Yao Zhang

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

Deep neural networks have proven to be quite effective in a wide variety of machine learning tasks, ranging from improved speech recognition systems to advancing the development of autonomous vehicles. However, despite their superior…

Machine Learning · Computer Science 2016-12-14 Qinglong Wang , Wenbo Guo , Alexander G. Ororbia , Xinyu Xing , Lin Lin , C. Lee Giles , Xue Liu , Peng Liu , Gang Xiong

Deploying AI-powered systems requires trustworthy models supporting effective human interactions, going beyond raw prediction accuracy. Concept bottleneck models promote trustworthiness by conditioning classification tasks on an…