English
Related papers

Related papers: Analyzing Individual Neurons in Pre-trained Langua…

200 papers

Neural networks trained on natural language processing tasks capture syntax even though it is not provided as a supervision signal. This indicates that syntactic analysis is essential to the understating of language in artificial…

Computation and Language · Computer Science 2020-10-05 Tomasz Limisiewicz , David Mareček

Despite the recent success of deep neural networks in natural language processing (NLP), their interpretability remains a challenge. We analyze the representations learned by neural machine translation models at various levels of…

Computation and Language · Computer Science 2019-11-04 Yonatan Belinkov , Nadir Durrani , Fahim Dalvi , Hassan Sajjad , James Glass

Recent success in training deep neural networks have prompted active investigation into the features learned on their intermediate layers. Such research is difficult because it requires making sense of non-linear computations performed by…

Machine Learning · Computer Science 2016-03-01 Yixuan Li , Jason Yosinski , Jeff Clune , Hod Lipson , John Hopcroft

Adult language learning varies greatly among individuals. Traditionally associated with frontotemporal language regions, this variability is increasingly seen as stemming from distributed brain networks. However, the role of these networks…

Neurons and Cognition · Quantitative Biology 2025-11-19 Peilun Song , Shuguang Yang , Xiujuan Geng , Zhenzhong Gan , Suiping Wang , Gangyi Feng

Recent breakthroughs of pretrained language models have shown the effectiveness of self-supervised learning for a wide range of natural language processing (NLP) tasks. In addition to standard syntactic and semantic NLP tasks, pretrained…

Computation and Language · Computer Science 2019-12-23 Wenhan Xiong , Jingfei Du , William Yang Wang , Veselin Stoyanov

While recent research on natural language inference has considerably benefited from large annotated datasets, the amount of inference-related knowledge (including commonsense) provided in the annotated data is still rather limited. There…

Computation and Language · Computer Science 2021-09-10 Xiaoyu Yang , Xiaodan Zhu , Zhan Shi , Tianda Li

While many studies have shown that linguistic information is encoded in hidden word representations, few have studied individual neurons, to show how and in which neurons it is encoded. Among these, the common approach is to use an external…

Computation and Language · Computer Science 2022-08-02 Omer Antverg , Yonatan Belinkov

Fine-tuning pre-trained contextualized embedding models has become an integral part of the NLP pipeline. At the same time, probing has emerged as a way to investigate the linguistic knowledge captured by pre-trained models. Very little is,…

Computation and Language · Computer Science 2020-10-07 Marius Mosbach , Anna Khokhlova , Michael A. Hedderich , Dietrich Klakow

While large language models (LLMs) have demonstrated superior multi-task capabilities, understanding the learning mechanisms behind this is still a challenging problem. In this paper, we attempt to understand such mechanisms from the…

Computation and Language · Computer Science 2025-01-14 Yongqi Leng , Deyi Xiong

Large language models (LLMs) often develop learned mechanisms specialized to specific datasets, such as reliance on domain-specific correlations, which yield high-confidence predictions without generalizable reasoning. While beneficial in…

Computation and Language · Computer Science 2025-07-15 Ameen Ali , Shahar Katz , Lior Wolf , Ivan Titov

We present novel methods for analyzing the activation patterns of RNNs from a linguistic point of view and explore the types of linguistic structure they learn. As a case study, we use a multi-task gated recurrent network architecture…

Computation and Language · Computer Science 2016-06-09 Ákos Kádár , Grzegorz Chrupała , Afra Alishahi

Pre-training a language model and then fine-tuning it for downstream tasks has demonstrated state-of-the-art results for various NLP tasks. Pre-training is usually independent of the downstream task, and previous works have shown that this…

Computation and Language · Computer Science 2022-11-28 Tanish Lad , Himanshu Maheshwari , Shreyas Kottukkal , Radhika Mamidi

Language model pre-training, such as BERT, has achieved remarkable results in many NLP tasks. However, it is unclear why the pre-training-then-fine-tuning paradigm can improve performance and generalization capability across different…

Computation and Language · Computer Science 2019-08-16 Yaru Hao , Li Dong , Furu Wei , Ke Xu

A large number of studies that analyze deep neural network models and their ability to encode various linguistic and non-linguistic concepts provide an interpretation of the inner mechanics of these models. The scope of the analyses is…

Computation and Language · Computer Science 2022-05-17 Fahim Dalvi , Abdul Rafae Khan , Firoj Alam , Nadir Durrani , Jia Xu , Hassan Sajjad

Language exhibits structure at different scales, ranging from subwords to words, sentences, paragraphs, and documents. To what extent do deep models capture information at these scales, and can we force them to better capture structure…

Computation and Language · Computer Science 2020-11-11 Alex Tamkin , Dan Jurafsky , Noah Goodman

Transformer architectures show significant promise for natural language processing. Given that a single pretrained model can be fine-tuned to perform well on many different tasks, these networks appear to extract generally useful linguistic…

Machine Learning · Computer Science 2019-10-29 Andy Coenen , Emily Reif , Ann Yuan , Been Kim , Adam Pearce , Fernanda Viégas , Martin Wattenberg

The adaptation of pretrained language models to solve supervised tasks has become a baseline in NLP, and many recent works have focused on studying how linguistic information is encoded in the pretrained sentence representations. Among…

Computation and Language · Computer Science 2021-02-11 Laura Pérez-Mayos , Roberto Carlini , Miguel Ballesteros , Leo Wanner

Progress in natural language processing (NLP) models that estimate representations of word sequences has recently been leveraged to improve the understanding of language processing in the brain. However, these models have not been…

Neurons and Cognition · Quantitative Biology 2019-11-11 Dan Schwartz , Mariya Toneva , Leila Wehbe

Recent progress in NLP witnessed the development of large-scale pre-trained language models (GPT, BERT, XLNet, etc.) based on Transformer (Vaswani et al. 2017), and in a range of end tasks, such models have achieved state-of-the-art…

Computation and Language · Computer Science 2019-11-12 Pengxiang Cheng , Katrin Erk

Modern neural networks (NNs), trained on extensive raw sentence data, construct distributed representations by compressing individual words into dense, continuous, high-dimensional vectors. These representations are expected to capture…

Computation and Language · Computer Science 2024-12-04 Zhu Liu