English
Related papers

Related papers: Discovering and Explaining the Representation Bott…

200 papers

Sometimes it is not enough for a DNN to produce an outcome. For example, in applications such as healthcare, users need to understand the rationale of the decisions. Therefore, it is imperative to develop algorithms to learn models with…

Machine Learning · Computer Science 2019-01-29 Yinpeng Dong , Fan Bao , Hang Su , Jun Zhu

One hypothesis for the success of deep neural networks (DNNs) is that they are highly expressive, which enables them to be applied to many problems, and they have a strong inductive bias towards solutions that are simple, known as…

Quantum Physics · Physics 2024-07-04 Jessica Pointing

This paper provides a unified view to explain different adversarial attacks and defense methods, \emph{i.e.} the view of multi-order interactions between input variables of DNNs. Based on the multi-order interaction, we discover that…

Machine Learning · Computer Science 2021-11-09 Jie Ren , Die Zhang , Yisen Wang , Lu Chen , Zhanpeng Zhou , Yiting Chen , Xu Cheng , Xin Wang , Meng Zhou , Jie Shi , Quanshi Zhang

Understanding internal feature representations of deep neural networks (DNNs) is a fundamental step toward model interpretability. Inspired by neuroscience methods that probe biological neurons using visual stimuli, recent deep learning…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Hongbo Zhu , Angelo Cangelosi

Determining the similarities and differences between humans and artificial intelligence (AI) is an important goal both in computational cognitive neuroscience and machine learning, promising a deeper understanding of human cognition and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Florian P. Mahner , Lukas Muttenthaler , Umut Güçlü , Martin N. Hebart

Our ability to interact with the world around us relies on being able to infer what actions objects afford -- often referred to as affordances. The neural mechanisms of object-action associations are realized in the visuomotor pathway where…

Neurons and Cognition · Quantitative Biology 2020-02-24 Aria Yuan Wang , Michael J. Tarr

Despite their great success, there is still no comprehensive theoretical understanding of learning with Deep Neural Networks (DNNs) or their inner organization. Previous work proposed to analyze DNNs in the \textit{Information Plane}; i.e.,…

Machine Learning · Computer Science 2017-05-02 Ravid Shwartz-Ziv , Naftali Tishby

Deep neural networks (DNNs) are vulnerable to adversarial examples where inputs with imperceptible perturbations mislead DNNs to incorrect results. Despite the potential risk they bring, adversarial examples are also valuable for providing…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Chongzhi Zhang , Aishan Liu , Xianglong Liu , Yitao Xu , Hang Yu , Yuqing Ma , Tianlin Li

In this work, we introduce a novel probabilistic representation of deep learning, which provides an explicit explanation for the Deep Neural Networks (DNNs) in three aspects: (i) neurons define the energy of a Gibbs distribution; (ii) the…

Machine Learning · Computer Science 2019-08-27 Xinjie Lan , Kenneth E. Barner

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

This paper proposes a method to visualize the discrimination power of intermediate-layer visual patterns encoded by a DNN. Specifically, we visualize (1) how the DNN gradually learns regional visual patterns in each intermediate layer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-08 Mingjie Li , Shaobo Wang , Quanshi Zhang

Deep neural networks perform well on classification tasks where data streams are i.i.d. and labeled data is abundant. Challenges emerge with non-stationary training data streams such as continual learning. One powerful approach that has…

Recently, a series of studies have tried to extract interactions between input variables modeled by a DNN and define such interactions as concepts encoded by the DNN. However, strictly speaking, there still lacks a solid guarantee whether…

Machine Learning · Computer Science 2024-09-16 Mingjie Li , Quanshi Zhang

Deep neural networks have become increasingly successful at solving classic perception problems such as object recognition, semantic segmentation, and scene understanding, often reaching or surpassing human-level accuracy. This success is…

Computer Vision and Pattern Recognition · Computer Science 2016-08-09 Joshua C. Peterson , Joshua T. Abbott , Thomas L. Griffiths

In natural language processing (NLP), deep neural networks (DNNs) could model complex interactions between context and have achieved impressive results on a range of NLP tasks. Prior works on feature interaction attribution mainly focus on…

Computation and Language · Computer Science 2023-10-27 Xiaolei Lu , Jianghong Ma , Haode Zhang

Deeply learned representations are the state-of-the-art descriptors for face recognition methods. These representations encode latent features that are difficult to explain, compromising the confidence and interpretability of their…

Computer Vision and Pattern Recognition · Computer Science 2021-05-18 Matheus Alves Diniz , William Robson Schwartz

Deep neural networks (DNNs), the agents of deep learning (DL), require a massive number of parallel/sequential operations, which makes it difficult to comprehend them and impedes proper diagnosis. Without better knowledge of DNNs' internal…

Machine Learning · Computer Science 2024-11-19 Jung Hoon Lee , Sujith Vijayan

With the continue development of Convolutional Neural Networks (CNNs), there is a growing concern regarding representations that they encode internally. Analyzing these internal representations is referred to as model interpretation. While…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Hamed Behzadi-Khormouji , José Oramas

This paper provides a unified view to explain different adversarial attacks and defense methods, i.e. the view of multi-order interactions between input variables of DNNs. Based on the multi-order interaction, we discover that adversarial…

Machine Learning · Computer Science 2021-11-10 Jie Ren , Die Zhang , Yisen Wang , Lu Chen , Zhanpeng Zhou , Yiting Chen , Xu Cheng , Xin Wang , Meng Zhou , Jie Shi , Quanshi Zhang

Interpreting the decision logic behind effective deep convolutional neural networks (CNN) on images complements the success of deep learning models. However, the existing methods can only interpret some specific decision logic on individual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Peter Cho-Ho Lam , Lingyang Chu , Maxim Torgonskiy , Jian Pei , Yong Zhang , Lanjun Wang