English
Related papers

Related papers: Discovering Salient Neurons in Deep NLP Models

200 papers

Deep learning methods employ multiple processing layers to learn hierarchical representations of data and have produced state-of-the-art results in many domains. Recently, a variety of model designs and methods have blossomed in the context…

Computation and Language · Computer Science 2018-11-27 Tom Young , Devamanyu Hazarika , Soujanya Poria , Erik Cambria

Large language models (LLMs) store extensive factual knowledge, but the underlying mechanisms remain unclear. Previous research suggests that factual knowledge is stored within multi-layer perceptron weights, and some storage units exhibit…

Computation and Language · Computer Science 2024-06-18 Yuheng Chen , Pengfei Cao , Yubo Chen , Yining Wang , Shengping Liu , Kang Liu , Jun Zhao

Large pre-trained language models have demonstrated their proficiency in storing factual knowledge within their parameters and achieving remarkable results when fine-tuned for downstream natural language processing tasks. Nonetheless, their…

Computation and Language · Computer Science 2023-09-29 Konstantinos Andriopoulos , Johan Pouwelse

In this paper, we propose a novel deep neural network framework embedded with low-level features (LCNN) for salient object detection in complex images. We utilise the advantage of convolutional neural networks to automatically learn the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-18 Hongyang Li , Huchuan Lu , Zhe Lin , Xiaohui Shen , Brian Price

Learning and inferring features that generate sensory input is a task continuously performed by cortex. In recent years, novel algorithms and learning rules have been proposed that allow neural network models to learn such features from…

Neurons and Cognition · Quantitative Biology 2021-04-13 Yasser Roudi , Graham Taylor

The use of large pretrained neural networks to create contextualized word embeddings has drastically improved performance on several natural language processing (NLP) tasks. These computationally expensive models have begun to be applied to…

Computers and Society · Computer Science 2019-12-03 Benjamin Clavié , Kobi Gal

Recursive processing in sentence comprehension is considered a hallmark of human linguistic abilities. However, its underlying neural mechanisms remain largely unknown. We studied whether a modern artificial neural network trained with…

Computation and Language · Computer Science 2021-05-04 Yair Lakretz , Dieuwke Hupkes , Alessandra Vergallito , Marco Marelli , Marco Baroni , Stanislas Dehaene

The mental lexicon is a complex cognitive system representing information about the words/concepts that one knows. Decades of psychological experiments have shown that conceptual associations across multiple, interactive cognitive levels…

Computation and Language · Computer Science 2022-10-04 Massimo Stella , Salvatore Citraro , Giulio Rossetti , Daniele Marinazzo , Yoed N. Kenett , Michael S. Vitevitch

Fine-tuned Large Language Models (LLMs) encode rich task-specific features, but the form of these representations, especially within MLP layers, remains unclear. Empirical inspection of LoRA updates shows that new features concentrate in…

Machine Learning · Computer Science 2025-09-30 Tanya Chowdhury , Atharva Nijasure , Yair Zick , James Allan

Pre-trained language models learn informative word representations on a large-scale text corpus through self-supervised learning, which has achieved promising performance in fields of natural language processing (NLP) after fine-tuning.…

Computation and Language · Computer Science 2023-10-31 Jian Yang , Xinyu Hu , Gang Xiao , Yulong Shen

Massive language models are the core of modern NLP modeling and have been shown to encode impressive amounts of commonsense and factual information. However, that knowledge exists only within the latent parameters of the model, inaccessible…

Computation and Language · Computer Science 2020-07-03 Pat Verga , Haitian Sun , Livio Baldini Soares , William W. Cohen

Large language models may encounter factual knowledge during pre-training yet fail to reliably use that knowledge after fine-tuning. Despite growing empirical evidence that MLP layers store factual associations and fine-tuning affects…

Machine Learning · Computer Science 2026-05-19 Ruichen Xu , Kexin Chen

Training a unified multilingual model promotes knowledge transfer but inevitably introduces negative interference. Language-specific modeling methods show promise in reducing interference. However, they often rely on heuristics to…

Computation and Language · Computer Science 2024-04-18 Shaomu Tan , Di Wu , Christof Monz

Deep neural networks have shown recent promise in many language-related tasks such as the modeling of conversations. We extend RNN-based sequence to sequence models to capture the long range discourse across many turns of conversation. We…

Computation and Language · Computer Science 2016-07-18 John M. Pierre , Mark Butler , Jacob Portnoff , Luis Aguilar

Advances in model editing through neuron pruning hold promise for removing undesirable concepts from large language models. However, it remains unclear whether models have the capacity to reacquire pruned concepts after editing. To…

Artificial Intelligence · Computer Science 2024-01-04 Michelle Lo , Shay B. Cohen , Fazl Barez

To understand and infer meaning in language, neural models have to learn complicated nuances. Discovering distinctive linguistic phenomena from data is not an easy task. For instance, lexical ambiguity is a fundamental feature of language…

Computation and Language · Computer Science 2021-02-23 Marzieh Fadaee

Code language models excel on code intelligence tasks, yet their internal interpretability is underexplored. Existing neuron interpretability techniques from NLP are suboptimal for source code due to programming languages formal,…

Software Engineering · Computer Science 2026-03-20 Zhe Yin , Xiaodong Gu , Beijun Shen

Interpretability researchers have attempted to understand MLP neurons of language models based on both the contexts in which they activate and their output weight vectors. They have paid little attention to a complementary aspect: the…

Machine Learning · Computer Science 2025-05-26 Sebastian Gerstner , Hinrich Schütze

Pretrained language models (PLMs) form the basis of most state-of-the-art NLP technologies. Nevertheless, they are essentially black boxes: Humans do not have a clear understanding of what knowledge is encoded in different parts of the…

Computation and Language · Computer Science 2023-11-15 Tanja Baeumel , Soniya Vijayakumar , Josef van Genabith , Guenter Neumann , Simon Ostermann

A key problem in salient object detection is how to effectively model the semantic properties of salient objects in a data-driven manner. In this paper, we propose a multi-task deep saliency model based on a fully convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2016-08-24 Xi Li , Liming Zhao , Lina Wei , Ming-Hsuan Yang , Fei Wu , Yueting Zhuang , Haibin Ling , Jingdong Wang