English
Related papers

Related papers: Evaluating Neuron Interpretation Methods of NLP Mo…

200 papers

Interpretability aims to explain the behavior of deep neural networks. Despite rapid growth, there is mounting concern that much of this work has not translated into practical impact, raising questions about its relevance and utility. This…

Annotator disagreement is widespread in NLP, particularly for subjective and ambiguous tasks such as toxicity detection and stance analysis. While early approaches treated disagreement as noise to be removed, recent work increasingly models…

Computation and Language · Computer Science 2026-01-21 Yinuo Xu , David Jurgens

Natural language is an appealing medium for explaining how large language models process and store information, but evaluating the faithfulness of such explanations is challenging. To help address this, we develop two modes of evaluation…

Computation and Language · Computer Science 2023-09-20 Jing Huang , Atticus Geiger , Karel D'Oosterlinck , Zhengxuan Wu , Christopher Potts

Interpretability of deep neural networks (DNNs) is essential since it enables users to understand the overall strengths and weaknesses of the models, conveys an understanding of how the models will behave in the future, and how to diagnose…

Computer Vision and Pattern Recognition · Computer Science 2017-03-31 Yinpeng Dong , Hang Su , Jun Zhu , Bo Zhang

Along with the great success of deep neural networks, there is also growing concern about their black-box nature. The interpretability issue affects people's trust on deep learning systems. It is also related to many ethical problems, e.g.,…

Machine Learning · Computer Science 2022-02-01 Yu Zhang , Peter Tiňo , Aleš Leonardis , Ke Tang

This paper proposes a set of criteria to evaluate the objectiveness of explanation methods of neural networks, which is crucial for the development of explainable AI, but it also presents significant challenges. The core challenge is that…

Machine Learning · Computer Science 2019-11-21 Hao Zhang , Jiayi Chen , Haotian Xue , Quanshi Zhang

To demystify the "black box" property of deep neural networks for natural language processing (NLP), several methods have been proposed to interpret their predictions by measuring the change in prediction probability after erasing each…

Computation and Language · Computer Science 2020-10-28 Siwon Kim , Jihun Yi , Eunji Kim , Sungroh Yoon

Neural Machine Translation (NMT) models have shown remarkable performance but remain largely opaque in their decision making processes. The interpretability of these models, especially their internal attention mechanisms, is critical for…

Artificial Intelligence · Computer Science 2024-12-30 Anurag Mishra

With the rising interest in graph representation learning, a variety of approaches have been proposed to effectively capture a graph's properties. While these approaches have improved performance in graph machine learning tasks compared to…

Machine Learning · Computer Science 2019-10-09 Antonia Gogoglou , C. Bayan Bruss , Keegan E. Hines

Neural generative models can be used to learn complex probability distributions from data, to sample from them, and to produce probability density estimates. We propose a computational framework for developing neural generative models…

Machine Learning · Computer Science 2022-01-06 Alexander Ororbia , Daniel Kifer

Sentiment analysis is known as one of the most crucial tasks in the field of natural language processing and Convolutional Neural Network (CNN) is one of those prominent models that is commonly used for this aim. Although convolutional…

Computation and Language · Computer Science 2021-02-24 Hossein Sadr , Mozhdeh Nazari Solimandarabi , Mir Mohsen Pedram , Mohammad Teshnehlab

The success of recent deep convolutional neural networks (CNNs) depends on learning hidden representations that can summarize the important factors of variation behind the data. However, CNNs often criticized as being black boxes that lack…

Computer Vision and Pattern Recognition · Computer Science 2018-06-27 Bolei Zhou , David Bau , Aude Oliva , Antonio Torralba

Model interpretability methods are often used to explain NLP model decisions on tasks such as text classification, where the output space is relatively small. However, when applied to language generation, where the output space often…

Computation and Language · Computer Science 2022-05-24 Kayo Yin , Graham Neubig

A basic question within the emerging field of mechanistic interpretability is the degree to which neural networks learn the same underlying mechanisms. In other words, are neural mechanisms universal across different models? In this work,…

While neural network-based models have achieved impressive performance on a large body of NLP tasks, the generalization behavior of different models remains poorly understood: Does this excellent performance imply a perfect generalization…

Computation and Language · Computer Science 2020-01-14 Jinlan Fu , Pengfei Liu , Qi Zhang , Xuanjing Huang

Convolutional neural network (CNN) models have seen advanced improvements in performance in various domains, but lack of interpretability is a major barrier to assurance and regulation during operation for acceptance and deployment of…

Machine Learning · Computer Science 2022-11-02 Wenli Yang , Guan Huang , Renjie Li , Jiahao Yu , Yanyu Chen , Quan Bai , Beyong Kang

We introduce and study methods for inferring and learning from correspondences among neurons. The approach enables alignment of data from distinct multiunit studies of nervous systems. We show that the methods for inferring correspondences…

Neurons and Cognition · Quantitative Biology 2015-01-28 Ashish Kapoor , E. Paxon Frady , Stefanie Jegelka , William B. Kristan , Eric Horvitz

Interpretable machine learning models offer understandable reasoning behind their decision-making process, though they may not always match the performance of their black-box counterparts. This trade-off between interpretability and model…

Artificial Intelligence · Computer Science 2025-03-12 Pranjal Atrey , Michael P. Brundage , Min Wu , Sanghamitra Dutta

A crucial aspect of understanding the complex nature of Deep Neural Networks (DNNs) is the ability to explain learned concepts within their latent representations. While methods exist to connect neurons to human-understandable textual…

Machine Learning · Computer Science 2024-12-06 Laura Kopf , Philine Lou Bommer , Anna Hedström , Sebastian Lapuschkin , Marina M. -C. Höhne , Kirill Bykov

Deep Learning of neural networks has progressively become more prominent in healthcare with models reaching, or even surpassing, expert accuracy levels. However, these success stories are tainted by concerning reports on the lack of model…

Machine Learning · Computer Science 2021-11-02 Matthew Watson , Bashar Awwad Shiekh Hasan , Noura Al Moubayed