English
Related papers

Related papers: Unveiling Black-boxes: Explainable Deep Learning M…

200 papers

Automatic legal text classification systems have been proposed in the literature to address knowledge extraction from judgments and detect their aspects. However, most of these systems are black boxes even when their models are…

With the availability of large databases and recent improvements in deep learning methodology, the performance of AI systems is reaching or even exceeding the human level on an increasing number of complex tasks. Impressive examples of this…

Artificial Intelligence · Computer Science 2017-08-29 Wojciech Samek , Thomas Wiegand , Klaus-Robert Müller

Despite their success in speech processing, neural networks often operate as black boxes, prompting the question: what informs their decisions, and how can we interpret them? This work examines this issue in the context of lexical stress. A…

Computation and Language · Computer Science 2026-02-13 Itai Allouche , Itay Asael , Rotem Rousso , Vered Dassa , Ann Bradlow , Seung-Eun Kim , Matthew Goldrick , Joseph Keshet

The lack of interpretability has hindered the large-scale adoption of AI technologies. However, the fundamental idea of interpretability, as well as how to put it into practice, remains unclear. We provide notions of interpretability based…

Machine Learning · Computer Science 2021-11-18 Hangcheng Dong , Bingguo Liu , Fengdong Chen , Dong Ye , Guodong Liu

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Deep Learning (DL) models are often black boxes, making their decision-making processes difficult to interpret. This lack of transparency has driven advancements in eXplainable Artificial Intelligence (XAI), a field dedicated to clarifying…

Machine Learning · Computer Science 2024-12-04 Adam Wróbel , Mikołaj Janusz , Bartosz Zieliński , Dawid Rymarczyk

With the advent of larger and more complex deep learning models, such as in Natural Language Processing (NLP), model qualities like explainability and interpretability, albeit highly desirable, are becoming harder challenges to tackle and…

Computation and Language · Computer Science 2024-01-30 Amrita Bhattacharjee , Raha Moraffah , Joshua Garland , Huan Liu

Deep Neural Networks (DNNs) deliver state-of-the-art performance in many image recognition and understanding applications. However, despite their outstanding performance, these models are black-boxes and it is hard to understand how they…

Computer Vision and Pattern Recognition · Computer Science 2019-08-14 Moustafa Alzantot , Amy Widdicombe , Simon Julier , Mani Srivastava

Deep neural network (DNN) models have achieved phenomenal success for applications in many domains, ranging from academic research in science and engineering to industry and business. The modeling power of DNN is believed to have come from…

Machine Learning · Computer Science 2024-10-08 Beomseok Seo , Lin Lin , Jia Li

Deep neural networks (DNNs) have become a proven and indispensable machine learning tool. As a black-box model, it remains difficult to diagnose what aspects of the model's input drive the decisions of a DNN. In countless real-world…

Machine Learning · Computer Science 2021-09-14 Gabrielle Ras , Ning Xie , Marcel van Gerven , Derek Doran

Deep learning (DL) has proven to be an effective machine learning and computer vision technique. DL-based image segmentation, object recognition and classification will aid many in-situ Mars rover tasks such as path planning and artifact…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Daniel Lundstrom , Alexander Huyen , Arya Mevada , Kyongsik Yun , Thomas Lu

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

Neural networks are widely regarded as black-box models, creating significant challenges in understanding their inner workings, especially in natural language processing (NLP) applications. To address this opacity, model explanation…

Computation and Language · Computer Science 2025-01-10 Melkamu Mersha , Mingiziem Bitewa , Tsion Abay , Jugal Kalita

Explaining recommendations enables users to understand whether recommended items are relevant to their needs and has been shown to increase their trust in the system. More generally, if designing explainable machine learning models is key…

Machine Learning · Computer Science 2020-08-27 Darius Afchar , Romain Hennequin

The use of convolutional neural networks (CNNs) for classification tasks has become dominant in various medical imaging applications. At the same time, recent advances in interpretable machine learning techniques have shown great potential…

Image and Video Processing · Electrical Eng. & Systems 2019-10-02 Irina Grigorescu , Lucilio Cordero-Grande , A David Edwards , Jo Hajnal , Marc Modat , Maria Deprez

Deep neural networks (DNNs) have been shown to perform well on exclusive, multi-class classification tasks. However, when different classes have similar visual features, it becomes challenging for human annotators to differentiate them.…

Computer Vision and Pattern Recognition · Computer Science 2024-04-18 Changbin Li , Kangshuo Li , Yuzhe Ou , Lance M. Kaplan , Audun Jøsang , Jin-Hee Cho , Dong Hyun Jeong , Feng Chen

Deep learning as represented by the artificial deep neural networks (DNNs) has achieved great success in many important areas that deal with text, images, videos, graphs, and so on. However, the black-box nature of DNNs has become one of…

Machine Learning · Computer Science 2021-09-29 Fenglei Fan , Jinjun Xiong , Mengzhou Li , Ge Wang

The large and still increasing popularity of deep learning clashes with a major limit of neural network architectures, that consists in their lack of capability in providing human-understandable motivations of their decisions. In situations…

Machine Learning · Computer Science 2023-05-22 Gabriele Ciravegna , Pietro Barbiero , Francesco Giannini , Marco Gori , Pietro Lió , Marco Maggini , Stefano Melacci

Pretrained transformer-based Language Models (LMs) are well-known for their ability to achieve significant improvement on NLP tasks, but their black-box nature, which leads to a lack of interpretability, has been a major concern. My…

Computation and Language · Computer Science 2024-12-06 Ximing Wen

Strong intelligent machines powered by deep neural networks are increasingly deployed as black boxes to make decisions in risk-sensitive domains, such as finance and medical. To reduce potential risk and build trust with users, it is…

Computer Vision and Pattern Recognition · Computer Science 2019-09-13 Lingyang Chu , Xia Hu , Juhua Hu , Lanjun Wang , Jian Pei