English
Related papers

Related papers: DeepSeer: Interactive RNN Explanation and Debuggin…

200 papers

Ensuring both transparency and safety is critical when deploying Deep Neural Networks (DNNs) in high-risk applications, such as medicine. The field of explainable AI (XAI) has proposed various methods to comprehend the decision-making…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Maximilian Dreyer , Reduan Achtibat , Wojciech Samek , Sebastian Lapuschkin

While machine learning techniques have been successfully applied in several fields, the black-box nature of the models presents challenges for interpreting and explaining the results. We develop a new framework called Adaptive Explainable…

Machine Learning · Statistics 2020-06-03 Jie Chen , Joel Vaughan , Vijayan N. Nair , Agus Sudjianto

The increasing complexity and frequency of cyber-threats demand intrusion detection systems (IDS) that are not only accurate but also interpretable. This paper presented a novel IDS framework that integrated Explainable Artificial…

Image decomposition aims to analyze an image into elementary components, which is essential for numerous downstream tasks and also by nature provides certain interpretability to the analysis. Deep learning can be powerful for such tasks,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Sihan Wang , Shangqi Gao , Fuping Wu , Xiahai Zhuang

We introduce a new model, the Recurrent Entity Network (EntNet). It is equipped with a dynamic long-term memory which allows it to maintain and update a representation of the state of the world as it receives new data. For language…

Computation and Language · Computer Science 2017-05-11 Mikael Henaff , Jason Weston , Arthur Szlam , Antoine Bordes , Yann LeCun

Explainable AI (XAI) is an active research area to interpret a neural network's decision by ensuring transparency and trust in the task-specified learned models. Recently, perturbation-based model analysis has shown better interpretation,…

Computer Vision and Pattern Recognition · Computer Science 2021-02-17 Mahesh Sudhakar , Sam Sattarzadeh , Konstantinos N. Plataniotis , Jongseong Jang , Yeonjeong Jeong , Hyunwoo Kim

RNN models have achieved the state-of-the-art performance in a wide range of text mining tasks. However, these models are often regarded as black-boxes and are criticized due to the lack of interpretability. In this paper, we enhance the…

Computation and Language · Computer Science 2019-03-28 Mengnan Du , Ninghao Liu , Fan Yang , Shuiwang Ji , Xia Hu

Explainable artificial intelligence (XAI) aims to develop transparent explanatory approaches for "black-box" deep learning models. However,it remains difficult for existing methods to achieve the trade-off of the three key criteria in…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Changqi Sun , Hao Xu , Yuntian Chen , Dongxiao Zhang

Time series models with recurrent neural networks (RNNs) can have high accuracy but are unfortunately difficult to interpret as a result of feature-interactions, temporal-interactions, and non-linear transformations. Interpretability is…

Machine Learning · Computer Science 2021-09-17 Asif Rahman , Yale Chang , Jonathan Rubin

Predicting the performance of deep learning (DL) models, such as execution time and resource utilization, is crucial for Neural Architecture Search (NAS), DL cluster schedulers, and other technologies that advance deep learning. The…

Performance · Computer Science 2025-02-04 Xinlong Zhao , Jiande Sun , Jia Zhang , Sujuan Hou , Shuai Li , Tong Liu , Ke Liu

A large set of the explainable Artificial Intelligence (XAI) literature is emerging on feature relevance techniques to explain a deep neural network (DNN) output or explaining models that ingest image source data. However, assessing how XAI…

Artificial Intelligence · Computer Science 2020-12-21 Alexandre Heuillet , Fabien Couthouis , Natalia Díaz-Rodríguez

The lack of interpretability and trust is a much-criticised feature of deep neural networks. In fully connected nets, the signalling between inner layers is scrambled because backpropagation training does not require perceptrons to be…

Signal Processing · Electrical Eng. & Systems 2021-01-28 Jake L. Amey , Jake Keeley , Tajwar Choudhury , Ilya Kuprov

In this paper, we propose Describe-and-Dissect (DnD), a novel method to describe the roles of hidden neurons in vision networks. DnD utilizes recent advancements in multimodal deep learning to produce complex natural language descriptions,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Nicholas Bai , Rahul A. Iyer , Tuomas Oikarinen , Akshay Kulkarni , Tsui-Wei Weng

Micro-segmentation of customers in the finance sector is a non-trivial task and has been an atypical omission from recent scientific literature. Where traditional segmentation classifies customers based on coarse features such as…

Machine Learning · Computer Science 2021-12-13 Charl Maree , Christian W. Omlin

While deep learning models have demonstrated remarkable success in numerous domains, their black-box nature remains a significant limitation, especially in critical fields such as medical image analysis and inference. Existing…

Machine Learning · Computer Science 2025-05-13 David Zucker

As large language models (LLMs) become more capable, there is an urgent need for interpretable and transparent tools. Current methods are difficult to implement, and accessible tools to analyze model internals are lacking. To bridge this…

Machine Learning · Computer Science 2023-11-30 Albert Garde , Esben Kran , Fazl Barez

While there has been a recent explosion of work on ExplainableAI ExAI on deep models that operate on imagery and tabular data, textual datasets present new challenges to the ExAI community. Such challenges can be attributed to the lack of…

Computation and Language · Computer Science 2022-10-14 Julia El Zini , Mariette Awad

Deep Neural Networks (DNN) have found numerous applications in various domains, including fraud detection, medical diagnosis, facial recognition, and autonomous driving. However, DNN-based systems often suffer from reliability issues due to…

Software Engineering · Computer Science 2025-01-23 Sigma Jahan , Mehil B Shah , Parvez Mahbub , Mohammad Masudur Rahman

Recurrent Neural Networks (RNNs) offer fast inference on long sequences but are hard to optimize and slow to train. Deep state-space models (SSMs) have recently been shown to perform remarkably well on long sequence modeling tasks, and have…

Machine Learning · Computer Science 2023-03-14 Antonio Orvieto , Samuel L Smith , Albert Gu , Anushan Fernando , Caglar Gulcehre , Razvan Pascanu , Soham De

Issues regarding explainable AI involve four components: users, laws & regulations, explanations and algorithms. Together these components provide a context in which explanation methods can be evaluated regarding their adequacy. The goal of…

Artificial Intelligence · Computer Science 2018-03-30 Gabrielle Ras , Marcel van Gerven , Pim Haselager