English
Related papers

Related papers: ConceptLens: from Pixels to Understanding

200 papers

Implicit Neural Representations (INRs) are powerful to parameterize continuous signals in computer vision. However, almost all INRs methods are limited to low-level tasks, e.g., image/video compression, super-resolution, and image…

Computer Vision and Pattern Recognition · Computer Science 2023-12-04 Yiran Song , Qianyu Zhou , Lizhuang Ma

Deep neural networks (DNNs) detect patterns in data and have shown versatility and strong performance in many computer vision applications. However, DNNs alone are susceptible to obvious mistakes that violate simple, common sense concepts…

Artificial Intelligence · Computer Science 2022-12-05 Youngwon Choi , M. Wasil Wahi-Anwar , Matthew S. Brown

Although deep learning models perform remarkably well across a range of tasks such as language translation and object recognition, it remains unclear what high-level logic, if any, they follow. Understanding this logic may lead to more…

Databases · Computer Science 2019-01-08 Thibault Sellam , Kevin Lin , Ian Yiran Huang , Yiru Chen , Michelle Yang , Carl Vondrick , Eugene Wu

In this paper we introduce diagNNose, an open source library for analysing the activations of deep neural networks. diagNNose contains a wide array of interpretability techniques that provide fundamental insights into the inner workings of…

Computation and Language · Computer Science 2020-11-16 Jaap Jumelet

In many practical applications, deep neural networks have been typically deployed to operate as a black box predictor. Despite the high amount of work on interpretability and high demand on the reliability of these systems, they typically…

Artificial Intelligence · Computer Science 2020-12-07 Martin Stano , Wanda Benesova , Lukas Samuel Martak

Concept-based explanations permit to understand the predictions of a deep neural network (DNN) through the lens of concepts specified by users. Existing methods assume that the examples illustrating a concept are mapped in a fixed direction…

Machine Learning · Computer Science 2022-09-30 Jonathan Crabbé , Mihaela van der Schaar

Modern deep networks are highly complex and their inferential outcome very hard to interpret. This is a serious obstacle to their transparent deployment in safety-critical or bias-aware applications. This work contributes to post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Konstantinos P. Panousis , Sotirios Chatzis

Recent research on graph neural network (GNN) models successfully applied GNNs to classical graph algorithms and combinatorial optimisation problems. This has numerous benefits, such as allowing applications of algorithms when preconditions…

Machine Learning · Computer Science 2021-07-16 Dobrik Georgiev , Pietro Barbiero , Dmitry Kazhdan , Petar Veličković , Pietro Liò

This paper evaluates whether training a decision tree based on concepts extracted from a concept-based explainer can increase interpretability for Convolutional Neural Networks (CNNs) models and boost the fidelity and performance of the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Gayda Mutahar , Tim Miller

Deep neural networks (DNNs) have achieved unprecedented performance on a wide range of complex tasks, rapidly outpacing our understanding of the nature of their solutions. This has caused a recent surge of interest in methods for rendering…

Machine Learning · Statistics 2017-06-30 Samuel Ritter , David G. T. Barrett , Adam Santoro , Matt M. Botvinick

We introduce Discovering Conceptual Network Explanations (DCNE), a new approach for generating human-comprehensible visual explanations to enhance the interpretability of deep neural image classifiers. Our method automatically finds visual…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Neehar Kondapaneni , Markus Marks , Oisin Mac Aodha , Pietro Perona

Explaining the decisions of Deep Neural Networks (DNNs) for medical images has become increasingly important. Existing attribution methods have difficulty explaining the meaning of pixels while existing concept-based methods are limited by…

Artificial Intelligence · Computer Science 2024-08-20 Weiji Kong , Xun Gong , Juan Wang

Voice disorders affect a significant portion of the population, and the ability to diagnose them using automated, non-invasive techniques would represent a substantial advancement in healthcare, improving the quality of life of patients.…

Audio and Speech Processing · Electrical Eng. & Systems 2025-07-25 Davide Ghia , Gabriele Ciravegna , Alkis Koudounas , Marco Fantini , Erika Crosetti , Giovanni Succo , Tania Cerquitelli

Computational modeling of artwork meaning is complex and difficult. This is because art interpretation is multidimensional and highly subjective. This paper experimentally investigated the degree to which a state-of-the-art Deep…

Computer Vision and Pattern Recognition · Computer Science 2024-01-22 Mahan Agha Zahedi , Niloofar Gholamrezaei , Alex Doboli

This demonstration paper presents $\mathbf{LayLens}$, a tool aimed to make deepfake understanding easier for users of all educational backgrounds. While prior works often rely on outputs containing technical jargon, LayLens bridges the gap…

Multimedia · Computer Science 2025-08-13 Abhijeet Narang , Parul Gupta , Liuyijia Su , Abhinav Dhall

Although the remarkable performance of deep neural networks (DNNs) in image classification, their vulnerability to adversarial attacks remains a critical challenge. Most existing detection methods rely on complex and poorly interpretable…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhigang Yang , Yuan Liu , Jiawei Zhang , Puning Zhang , Xinqiang Ma

Despite decades of development, existing IDSs still face challenges in improving detection accuracy, evasion, and detection of unknown attacks. To solve these problems, many researchers have focused on designing and developing IDSs that use…

Cryptography and Security · Computer Science 2025-01-28 Mofe O. Jeje

Machine learning about language can be improved by supplying it with specific knowledge and sources of external information. We present here a new version of the linked open data resource ConceptNet that is particularly well suited to be…

Computation and Language · Computer Science 2018-12-12 Robyn Speer , Joshua Chin , Catherine Havasi

Concept probing has recently gained popularity as a way for humans to peek into what is encoded within artificial neural networks. In concept probing, additional classifiers are trained to map the internal representations of a model into…

Machine Learning · Computer Science 2025-07-28 Manuel de Sousa Ribeiro , Afonso Leote , João Leite

Deep neural networks (DNNs) have demonstrated impressive performance on a wide array of tasks, but they are usually considered opaque since internal structure and learned parameters are not interpretable. In this paper, we re-examine the…

Computer Vision and Pattern Recognition · Computer Science 2017-08-21 Yinpeng Dong , Hang Su , Jun Zhu , Fan Bao