English
Related papers

Related papers: Addressing the interpretability problem for deep l…

200 papers

Fuelled by increasing computer power and algorithmic advances, machine learning techniques have become powerful tools for finding patterns in data. Since quantum systems produce counter-intuitive patterns believed not to be efficiently…

Quantum Physics · Physics 2018-05-14 Jacob Biamonte , Peter Wittek , Nicola Pancotti , Patrick Rebentrost , Nathan Wiebe , Seth Lloyd

Deep learning models developed for time-series associated tasks have become more widely researched nowadays. However, due to the unintuitive nature of time-series data, the interpretability problem -- where we understand what is under the…

Machine Learning · Computer Science 2023-05-25 Ziqi Zhao , Yucheng Shi , Shushan Wu , Fan Yang , Wenzhan Song , Ninghao Liu

Although deep learning models have been successfully applied to a variety of tasks, due to the millions of parameters, they are becoming increasingly opaque and complex. In order to establish trust for their widespread commercial use, it is…

Machine Learning · Computer Science 2018-11-13 Tanmayee Narendra , Anush Sankaran , Deepak Vijaykeerthy , Senthil Mani

Explainable AI is an emerging field providing solutions for acquiring insights into automated systems' rationale. It has been put on the AI map by suggesting ways to tackle key ethical and societal issues. Existing explanation techniques…

Machine Learning · Computer Science 2022-05-02 Ioannis Mollas , Nick Bassiliades , Grigorios Tsoumakas

Large Language Models (LLMs) are increasingly being used in education, yet their correctness alone does not capture the quality, reliability, or pedagogical validity of their problem-solving behavior, especially in mathematics, where…

Computers and Society · Computer Science 2025-10-22 Sagnik Dakshit , Sushmita Sinha Roy

Learning concepts that are consistent with human perception is important for Deep Neural Networks to win end-user trust. Post-hoc interpretation methods lack transparency in the feature representations learned by the models. This work…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Deep Neural Networks have achieved huge success at a wide spectrum of applications from language modeling, computer vision to speech recognition. However, nowadays, good performance alone is not sufficient to satisfy the needs of practical…

Machine Learning · Computer Science 2018-12-31 Xuan Liu , Xiaoguang Wang , Stan Matwin

Current Deep Learning approaches have been very successful using convolutional neural networks (CNN) trained on large graphical processing units (GPU)-based computers. Three limitations of this approach are: 1) they are based on a simple…

Neural and Evolutionary Computing · Computer Science 2017-07-17 Thomas E. Potok , Catherine Schuman , Steven R. Young , Robert M. Patton , Federico Spedalieri , Jeremy Liu , Ke-Thia Yao , Garrett Rose , Gangotree Chakma

Concept-based interpretability methods aim to explain deep neural network model predictions using a predefined set of semantic concepts. These methods evaluate a trained model on a new, "probe" dataset and correlate model predictions with…

Computer Vision and Pattern Recognition · Computer Science 2023-05-15 Vikram V. Ramaswamy , Sunnie S. Y. Kim , Ruth Fong , Olga Russakovsky

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

There have been many advances in the artificial intelligence field due to the emergence of deep learning. In almost all sub-fields, artificial neural networks have reached or exceeded human-level performance. However, most of the models are…

Computation and Language · Computer Science 2021-03-19 Reza Marzban , Christopher John Crick

Recent advancements in signal processing and machine learning domains have resulted in an extensive surge of interest in deep learning models due to their unprecedented performance and high accuracy for different and challenging problems of…

Computer Vision and Pattern Recognition · Computer Science 2018-03-01 Atefeh Shahroudnejad , Arash Mohammadi , Konstantinos N. Plataniotis

This paper proposes a method to modify traditional convolutional neural networks (CNNs) into interpretable CNNs, in order to clarify knowledge representations in high conv-layers of CNNs. In an interpretable CNN, each filter in a high…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Quanshi Zhang , Ying Nian Wu , Song-Chun Zhu

Deep learning models have achieved state-of-the-art performance in many classification tasks. However, most of them cannot provide an interpretation for their classification results. Machine learning models that are interpretable are…

Machine Learning · Computer Science 2021-11-04 Miles Q. Li , Benjamin C. M. Fung , Adel Abusitta

Text has become the predominant form of communication on social media, embedding a wealth of emotional nuances. Consequently, the extraction of emotional information from text is of paramount importance. Despite previous research making…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Bingyu Li , Da Zhang , Zhiyuan Zhao , Junyu Gao , Yuan Yuan

In recent years, deep learning has had a profound impact on machine learning and artificial intelligence. At the same time, algorithms for quantum computers have been shown to efficiently solve some problems that are intractable on…

Quantum Physics · Physics 2015-05-25 Nathan Wiebe , Ashish Kapoor , Krysta M. Svore

There has been growing interest in developing accurate models that can also be explained to humans. Unfortunately, if there exist multiple distinct but accurate models for some dataset, current machine learning methods are unlikely to find…

Machine Learning · Computer Science 2018-07-23 Andrew Slavin Ross , Weiwei Pan , Finale Doshi-Velez

Interpreting the decision logic behind effective deep convolutional neural networks (CNN) on images complements the success of deep learning models. However, the existing methods can only interpret some specific decision logic on individual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Peter Cho-Ho Lam , Lingyang Chu , Maxim Torgonskiy , Jian Pei , Yong Zhang , Lanjun Wang

Deep learning (DL) models have been popular due to their ability to learn directly from the raw data in an end-to-end paradigm, alleviating the concern of a separate error-prone feature extraction phase. Recent DL-based neuroimaging studies…

Machine Learning · Computer Science 2023-07-20 Md. Mahfuzur Rahman , Vince D. Calhoun , Sergey M. Plis

In cognitive decoding, researchers aim to characterize a brain region's representations by identifying the cognitive states (e.g., accepting/rejecting a gamble) that can be identified from the region's activity. Deep learning (DL) methods…

Machine Learning · Computer Science 2021-08-17 Armin W. Thomas , Christopher Ré , Russell A. Poldrack