English
Related papers

Related papers: Verb Conjugation in Transformers Is Determined by …

200 papers

Bidirectional Encoder Representations from Transformers (BERT) reach state-of-the-art results in a variety of Natural Language Processing tasks. However, understanding of their internal functioning is still insufficient and unsatisfactory.…

Computation and Language · Computer Science 2019-09-12 Betty van Aken , Benjamin Winter , Alexander Löser , Felix A. Gers

Transformer has demonstrated its great power to learn contextual word representations for multiple languages in a single model. To process multilingual sentences in the model, a learnable vector is usually assigned to each language, which…

Computation and Language · Computer Science 2021-02-17 Shengjie Luo , Kaiyuan Gao , Shuxin Zheng , Guolin Ke , Di He , Liwei Wang , Tie-Yan Liu

The Transformer architecture has become prominent in developing large causal language models. However, mechanisms to explain its capabilities are not well understood. Focused on the training process, here we establish a meta-learning view…

Machine Learning · Computer Science 2024-03-26 Xinbo Wu , Lav R. Varshney

Much of the knowledge encoded in transformer language models (LMs) may be expressed in terms of relations: relations between words and their synonyms, entities and their attributes, etc. We show that, for a subset of relations, this…

Computation and Language · Computer Science 2024-02-19 Evan Hernandez , Arnab Sen Sharma , Tal Haklay , Kevin Meng , Martin Wattenberg , Jacob Andreas , Yonatan Belinkov , David Bau

This study investigates the internal representations of verb-particle combinations within transformer-based large language models (LLMs), specifically examining how these models capture lexical and syntactic nuances at different neural…

Computation and Language · Computer Science 2024-12-20 Hassane Kissane , Achim Schilling , Patrick Krauss

Transformer-based language models create hidden representations of their inputs at every layer, but only use final-layer representations for prediction. This obscures the internal decision-making process of the model and the utility of its…

Computation and Language · Computer Science 2024-06-21 Alexander Yom Din , Taelin Karidi , Leshem Choshen , Mor Geva

Although transformer-based Neural Language Models demonstrate impressive performance on a variety of tasks, their generalization abilities are not well understood. They have been shown to perform strongly on subject-verb number agreement in…

Computation and Language · Computer Science 2022-11-10 Karim Lasri , Alessandro Lenci , Thierry Poibeau

In this paper, we present a comprehensive study of language interference in encoder-only Transformer models across 83 languages. We construct an interference matrix by training and evaluating small BERT-like models on all possible language…

Computation and Language · Computer Science 2025-08-05 Belen Alastruey , João Maria Janeiro , Alexandre Allauzen , Maha Elbayad , Loïc Barrault , Marta R. Costa-jussà

Representations from large pretrained models such as BERT encode a range of features into monolithic vectors, affording strong predictive accuracy across a multitude of downstream tasks. In this paper we explore whether it is possible to…

Computation and Language · Computer Science 2021-09-14 Xiongyi Zhang , Jan-Willem van de Meent , Byron C. Wallace

Word order, an essential property of natural languages, is injected in Transformer-based neural language models using position encoding. However, recent experiments have shown that explicit position encoding is not always useful, since some…

Computation and Language · Computer Science 2022-11-09 Karim Lasri , Alessandro Lenci , Thierry Poibeau

Prediction head is a crucial component of Transformer language models. Despite its direct impact on prediction, this component has often been overlooked in analyzing Transformers. In this study, we investigate the inner workings of the…

Computation and Language · Computer Science 2023-05-30 Goro Kobayashi , Tatsuki Kuribayashi , Sho Yokoi , Kentaro Inui

Pre-trained language models perform well on a variety of linguistic tasks that require symbolic reasoning, raising the question of whether such models implicitly represent abstract symbols and rules. We investigate this question using the…

Computation and Language · Computer Science 2021-09-16 Jason Wei , Dan Garrette , Tal Linzen , Ellie Pavlick

Since 2017, the Transformer-based models play critical roles in various downstream Natural Language Processing tasks. However, a common limitation of the attention mechanism utilized in Transformer Encoder is that it cannot automatically…

Computation and Language · Computer Science 2022-04-20 Ziyang Luo , Yadong Xi , Jing Ma , Zhiwei Yang , Xiaoxi Mao , Changjie Fan , Rongsheng Zhang

How language models process complex input that requires multiple steps of inference is not well understood. Previous research has shown that information about intermediate values of these inputs can be extracted from the activations of the…

Machine Learning · Computer Science 2023-01-18 Yuta Matsumoto , Benjamin Heinzerling , Masashi Yoshikawa , Kentaro Inui

Language models based on the Transformer architecture achieve excellent results in many language-related tasks, such as text classification or sentiment analysis. However, despite the architecture of these models being well-defined, little…

Computation and Language · Computer Science 2025-04-14 Miguel López-Otal , Jorge Gracia , Jordi Bernad , Carlos Bobed , Lucía Pitarch-Ballesteros , Emma Anglés-Herrero

Many recent works have demonstrated that unsupervised sentence representations of neural networks encode syntactic information by observing that neural language models are able to predict the agreement between a verb and its subject. We…

Computation and Language · Computer Science 2021-09-22 Bingzhi Li , Guillaume Wisniewski , Benoit Crabbé

This study investigates the internal representations of verb-particle combinations, called multi-word verbs, within transformer-based large language models (LLMs), specifically examining how these models capture lexical and syntactic…

Computation and Language · Computer Science 2025-02-10 Hassane Kissane , Achim Schilling , Patrick Krauss

Embeddings in AI convert symbolic structures into fixed-dimensional vectors, effectively fusing multiple signals. However, the nature of this fusion in real-world data is often unclear. To address this, we introduce two methods: (1)…

Machine Learning · Computer Science 2023-11-21 Zhijin Guo , Zhaozhen Xu , Martha Lewis , Nello Cristianini

One of the key factors in language productivity and human cognition is the ability of systematic compositionality, which refers to understanding composed unseen examples of seen primitives. However, recent evidence reveals that the…

Computation and Language · Computer Science 2023-12-13 Chen Huang , Peixin Qin , Wenqiang Lei , Jiancheng Lv

Variants of the BERT architecture specialised for producing full-sentence representations often achieve better performance on downstream tasks than sentence embeddings extracted from vanilla BERT. However, there is still little…

Computation and Language · Computer Science 2023-01-31 Dmitry Nikolaev , Sebastian Padó