English
Related papers

Related papers: Layerwise Knowledge Extraction from Deep Convoluti…

200 papers

Modern deep networks are highly complex and their inferential outcome very hard to interpret. This is a serious obstacle to their transparent deployment in safety-critical or bias-aware applications. This work contributes to post-hoc…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Konstantinos P. Panousis , Sotirios Chatzis

We propose a novel perspective to understand deep neural networks in an interpretable disentanglement form. For each semantic class, we extract a class-specific functional subnetwork from the original full model, with compressed structure…

Machine Learning · Computer Science 2019-10-08 Yulong Wang , Xiaolin Hu , Hang Su

Knowledge discovery is defined as non-trivial extraction of implicit, previously unknown and potentially useful information from given data. Knowledge extraction from web documents deals with unstructured, free-format documents whose number…

Neural and Evolutionary Computing · Computer Science 2007-05-23 Vitaly Schetinin

We propose a novel way to incorporate expert knowledge into the training of deep neural networks. Many approaches encode domain constraints directly into the network architecture, requiring non-trivial or domain-specific engineering. In…

Machine Learning · Computer Science 2021-11-03 Nicholas Hoernle , Rafael Michael Karampatsis , Vaishak Belle , Kobi Gal

The current deep neural network algorithm still stays in the end-to-end training supervision method like Image-Label pairs, which makes traditional algorithm is difficult to explain the reason for the results, and the prediction logic is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yishuang Tian , Ning Wang , Liang Zhang

Deep learning models for natural language processing (NLP) are inherently complex and often viewed as black box in nature. This paper develops an approach for interpreting convolutional neural networks for text classification problems by…

Computation and Language · Computer Science 2021-07-12 Wei Zhao , Rahul Singh , Tarun Joshi , Agus Sudjianto , Vijayan N. Nair

The purpose of feature extraction on convolutional neural networks is to reuse deep representations learnt for a pre-trained model to solve a new, potentially unrelated problem. However, raw feature extraction from all layers is unfeasible…

Neural and Evolutionary Computing · Computer Science 2019-11-11 Victor Gimenez-Abalos , Armand Vilalta , Dario Garcia-Gasulla , Jesus Labarta , Eduard Ayguadé

Deep learning based methods hold state-of-the-art results in image denoising, but remain difficult to interpret due to their construction from poorly understood building blocks such as batch-normalization, residual learning, and feature…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Nikola Janjušević , Amirhossein Khalilian-Gourtani , Yao Wang

Our main contribution is to show that the behaviour of kernels across multiple layers of a convolutional neural network can be approximated using a logic program. The extracted logic programs yield accuracies that correlate with those of…

Machine Learning · Computer Science 2020-10-20 Joe Townsend , Theodoros Kasioumis , Hiroya Inakoshi

Neural networks are becoming a popular tool for solving many real-world problems such as object recognition and machine translation, thanks to its exceptional performance as an end-to-end solution. However, neural networks are complex…

Machine Learning · Computer Science 2020-09-29 Guoliang Dong , Jingyi Wang , Jun Sun , Yang Zhang , Xinyu Wang , Ting Dai , Jin Song Dong , Xingen Wang

Deep neural networks are widely used in practical applications of AI, however, their inner structure and complexity made them generally not easily interpretable. Model transparency and interpretability are key requirements for multiple…

Machine Learning · Computer Science 2026-01-13 Luca Bergamin , Roberto Confalonieri , Fabio Aiolli

The ubiquity of neural networks (NNs) in real-world applications, from healthcare to natural language processing, underscores their immense utility in capturing complex relationships within high-dimensional data. However, NNs come with…

Machine Learning · Computer Science 2024-07-08 Chang Yue , Niraj K. Jha

There has been significant focus on creating neuro-symbolic models for interpretable image classification using Convolutional Neural Networks (CNNs). These methods aim to replace the CNN with a neuro-symbolic model consisting of the CNN,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Parth Padalkar , Jaeseong Lee , Shiyi Wei , Gopal Gupta

Recently, the market on deep learning including not only software but also hardware is developing rapidly. Big data is collected through IoT devices and the industry world will analyze them to improve their manufacturing process. Deep…

Neural and Evolutionary Computing · Computer Science 2018-07-12 Shin Kamada , Takumi Ichimura

Deep learning is recognized to be capable of discovering deep features for representation learning and pattern recognition without requiring elegant feature engineering techniques by taking advantage of human ingenuity and prior knowledge.…

Machine Learning · Computer Science 2020-04-02 Zhi Han , Siquan Yu , Shao-Bo Lin , Ding-Xuan Zhou

In Explainable AI, rule extraction translates model knowledge into logical rules, such as IF-THEN statements, crucial for understanding patterns learned by black-box models. This could significantly aid in fields like disease diagnosis,…

Machine Learning · Computer Science 2024-08-16 Yu Chen , Tianyu Cui , Alexander Capstick , Nan Fletcher-Loyd , Payam Barnaghi

We propose a general framework called Network Dissection for quantifying the interpretability of latent representations of CNNs by evaluating the alignment between individual hidden units and a set of semantic concepts. Given any CNN model,…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 David Bau , Bolei Zhou , Aditya Khosla , Aude Oliva , Antonio Torralba

Although backpropagation ANNs generally predict better than decision trees do for pattern classification problems, they are often regarded as black boxes, i.e., their predictions cannot be explained as those of decision trees. In many…

Neural and Evolutionary Computing · Computer Science 2010-09-28 S. M. Kamruzzaman , Md. Monirul Islam

Interpretability of Deep Neural Networks has become a major area of exploration. Although these networks have achieved state of the art accuracy in many tasks, it is extremely difficult to interpret and explain their decisions. In this work…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Akshay Badola , Cherian Roy , Vineet Padmanabhan , Rajendra Lal

Complex nonlinear models such as deep neural network (DNNs) have become an important tool for image classification, speech recognition, natural language processing, and many other fields of application. These models however lack…