English
Related papers

Related papers: PACE: Posthoc Architecture-Agnostic Concept Extrac…

200 papers

This paper introduces the Pandemic PACT Advanced Categorisation Engine (PPACE) along with its associated dataset. PPACE is a fine-tuned model developed to automatically classify research abstracts from funded biomedical projects according…

This paper summarizes our endeavors in the past few years in terms of explaining image classifiers, with the aim of including negative results and insights we have gained. The paper starts with describing the explainable neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-03-14 Li Fuxin , Zhongang Qi , Saeed Khorram , Vivswan Shitole , Prasad Tadepalli , Minsuk Kahng , Alan Fern

Providing explanations along with predictions is crucial in some text processing tasks. Therefore, we propose a new self-interpretable model that performs output prediction and simultaneously provides an explanation in terms of the presence…

Machine Learning · Computer Science 2019-09-30 Diane Bouchacourt , Ludovic Denoyer

Currently available methods for extracting saliency maps identify parts of the input which are the most important to a specific fixed classifier. We show that this strong dependence on a given classifier hinders their performance. To…

Machine Learning · Computer Science 2020-07-21 Konrad Zolna , Krzysztof J. Geras , Kyunghyun Cho

Concept Bottleneck Models (CBMs) have recently been proposed to address the 'black-box' problem of deep neural networks, by first mapping images to a human-understandable concept space and then linearly combining concepts for…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Sukrut Rao , Sweta Mahajan , Moritz Böhle , Bernt Schiele

Due to their black-box and data-hungry nature, deep learning techniques are not yet widely adopted for real-world applications in critical domains, like healthcare and justice. This paper presents Memory Wrap, a plug-and-play extension to…

Machine Learning · Computer Science 2023-10-30 Biagio La Rosa , Roberto Capobianco , Daniele Nardi

We propose a Convolutional Neural Network-based approach to learn, detect,and extract patterns in sequential trajectory data, known here as Social Pattern Extraction Convolution (Social-PEC). A set of experiments carried out on the human…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Dapeng Zhao , Jean Oh

Deep convolutional neural networks (CNN) proved to be highly accurate to perform anatomical segmentation of medical images. However, some of the most popular CNN architectures for image segmentation still rely on post-processing strategies…

Image and Video Processing · Electrical Eng. & Systems 2019-06-07 Agostina J. Larrazabal , Cesar Martinez , Enzo Ferrante

Counterfactual explanations (CEs) aim to enhance the interpretability of machine learning models by illustrating how alterations in input features would affect the resulting predictions. Common CE approaches require an additional model and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Matan Atad , David Schinz , Hendrik Moeller , Robert Graf , Benedikt Wiestler , Daniel Rueckert , Nassir Navab , Jan S. Kirschke , Matthias Keicher

A major challenge in Explainable AI is in correctly interpreting activations of hidden neurons: accurate interpretations would help answer the question of what a deep learning system internally detects as relevant in the input, demystifying…

Artificial Intelligence · Computer Science 2026-02-23 Abhilekha Dalal , Rushrukh Rayan , Adrita Barua , Eugene Y. Vasserman , Md Kamruzzaman Sarker , Pascal Hitzler

As artificial intelligence increasingly drives critical decisions, the ability to genuinely explain how neural networks make predictions is essential for trust. Yet, most current explanation methods offer post-hoc rationalizations rather…

Machine Learning · Computer Science 2026-05-08 Corentin Lobet , Francesca Chiaromonte

Deep Neural Networks (DNNs) have achieved remarkable performance on a range of tasks. A key step to further empowering DNN-based approaches is improving their explainability. In this work we present CME: a concept-based model extraction…

Machine Learning · Computer Science 2020-10-27 Dmitry Kazhdan , Botty Dimanov , Mateja Jamnik , Pietro Liò , Adrian Weller

Ensuring trustworthiness in open-world visual recognition requires models that are interpretable, fair, and robust to distribution shifts. Yet modern vision systems are increasingly deployed as proprietary black-box APIs, exposing only…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Simone Carnemolla , Chiara Russo , Simone Palazzo , Quentin Bouniot , Daniela Giordano , Zeynep Akata , Matteo Pennisi , Concetto Spampinato

Neural networks are becoming a popular tool for solving many real-world problems such as object recognition and machine translation, thanks to its exceptional performance as an end-to-end solution. However, neural networks are complex…

Machine Learning · Computer Science 2020-09-29 Guoliang Dong , Jingyi Wang , Jun Sun , Yang Zhang , Xinyu Wang , Ting Dai , Jin Song Dong , Xingen Wang

Convolutional Neural Networks (CNNs) continue to achieve great success in classification tasks as innovative techniques and complex multi-path architecture topologies are introduced. Neural Architecture Search (NAS) aims to automate the…

Neural and Evolutionary Computing · Computer Science 2023-12-14 Trevor Londt , Xiaoying Gao , Peter Andreae , Yi Mei

As machine learning algorithms are increasingly applied to high impact yet high risk tasks, such as medical diagnosis or autonomous driving, it is critical that researchers can explain how such algorithms arrived at their predictions. In…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Ruth Fong , Andrea Vedaldi

The interpretability of model has become one of the obstacles to its wide application in the high-stake fields. The usual way to obtain interpretability is to build a black-box first and then explain it using the post-hoc methods. However,…

Machine Learning · Computer Science 2023-04-04 Zihao Chen , Xiaomeng Wang , Yuanjiang Huang , Tao Jia

EXplainable AI (XAI) is an essential topic to improve human understanding of deep neural networks (DNNs) given their black-box internals. For computer vision tasks, mainstream pixel-based XAI methods explain DNN decisions by identifying…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Ao Sun , Pingchuan Ma , Yuanyuan Yuan , Shuai Wang

Deep neural networks have shown exceptional performance in various tasks, but their lack of robustness, reliability, and tendency to be overconfident pose challenges for their deployment in safety-critical applications like autonomous…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Steven Landgraf , Markus Hillemann , Kira Wursthorn , Markus Ulrich

The success of deep neural networks for pan-sharpening is commonly in a form of black box, lacking transparency and interpretability. To alleviate this issue, we propose a novel model-driven deep unfolding framework with image reasoning…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Man Zhou , Jie Huang , Naishan Zheng , Chongyi Li