English
Related papers

Related papers: Word Meanings in Transformer Language Models

200 papers

Can a machine understand the meanings of natural language? Recent developments in the generative large language models (LLMs) of artificial intelligence have led to the belief that traditional philosophical assumptions about machine…

Computation and Language · Computer Science 2023-10-27 Vladimír Havlík

Word embedding is central to neural machine translation (NMT), which has attracted intensive research interest in recent years. In NMT, the source embedding plays the role of the entrance while the target embedding acts as the terminal.…

Computation and Language · Computer Science 2019-06-10 Xuebo Liu , Derek F. Wong , Yang Liu , Lidia S. Chao , Tong Xiao , Jingbo Zhu

We study semantic compression for text where meanings contained in the text are conveyed to a source decoder, e.g., for classification. The main motivator to move to such an approach of recovering the meaning without requiring exact…

Information Theory · Computer Science 2023-09-20 Emrecan Kutay , Aylin Yener

Current evaluation metrics for language modeling and generation rely heavily on the accuracy of predicted (or generated) words as compared to a reference ground truth. While important, token-level accuracy only captures one aspect of a…

Computation and Language · Computer Science 2020-10-15 Shiran Dudy , Steven Bedrick

Translations capture important information about languages that can be used as implicit supervision in learning linguistic properties and semantic representations. In an information-centric view, translated texts may be considered as…

Computation and Language · Computer Science 2018-02-02 Jörg Tiedemann

Recent advances in methods focused on the grounding problem have resulted in techniques that can be used to construct a symbolic language associated with a specific domain. Inspired by how humans communicate complex ideas through language,…

Artificial Intelligence · Computer Science 2020-08-06 Alberto Santamaria-Pang , James Kubricht , Aritra Chowdhury , Chitresh Bhushan , Peter Tu

Large language models use high-dimensional latent spaces to encode and process textual information. Much work has investigated how the conceptual content of words translates into geometrical relationships between their vector…

Computation and Language · Computer Science 2025-05-26 Raphaël Sarfati , Haley Moller , Toni J. B. Liu , Nicolas Boullé , Christopher Earls

The transformer is a state-of-the-art neural translation model that uses attention to iteratively refine lexical representations with information drawn from the surrounding context. Lexical features are fed into the first layer and…

Computation and Language · Computer Science 2019-07-01 Denis Emelin , Ivan Titov , Rico Sennrich

Conventional text classification models make a bag-of-words assumption reducing text into word occurrence counts per document. Recent algorithms such as word2vec are capable of learning semantic meaning and similarity between words in an…

Computation and Language · Computer Science 2018-07-11 Vincent Major , Alisa Surkis , Yindalon Aphinyanaphongs

Transformer-based Neural Language Models achieve state-of-the-art performance on various natural language processing tasks. However, an open question is the extent to which these models rely on word-order/syntactic or word…

Computation and Language · Computer Science 2024-03-05 Vasudevan Nedumpozhimana , John D. Kelleher

We analyze how large language models (LLMs) represent out-of-context words, investigating their reliance on the given context to capture their semantics. Our likelihood-guided text perturbations reveal a correlation between token likelihood…

Computation and Language · Computer Science 2023-03-16 Valeria Ruscio , Valentino Maiorca , Fabrizio Silvestri

Language models (LMs) are said to be exhibiting reasoning, but what does this entail? We assess definitions of reasoning and how key papers in the field of natural language processing (NLP) use the notion and argue that the definitions…

Computation and Language · Computer Science 2025-11-18 Bertram Højer

Modern language models can process inputs across diverse languages and modalities. We hypothesize that models acquire this capability through learning a shared representation space across heterogeneous data types (e.g., different languages…

Computation and Language · Computer Science 2025-03-12 Zhaofeng Wu , Xinyan Velocity Yu , Dani Yogatama , Jiasen Lu , Yoon Kim

Word embeddings play a significant role in many modern NLP systems. Since learning one representation per word is problematic for polysemous words and homonymous words, researchers propose to use one embedding per word sense. Their…

Computation and Language · Computer Science 2016-10-25 Qi Li , Tianshi Li , Baobao Chang

While word embeddings derive meaning from co-occurrence patterns, human language understanding is grounded in sensory and motor experience. We present $\text{SENSE}$ $(\textbf{S}\text{ensorimotor }$ $\textbf{E}\text{mbedding }$…

Computation and Language · Computer Science 2026-04-24 Abhinav Gupta , Toben H. Mintz , Jesse Thomason

Neural language models are a powerful tool to embed words into semantic vector spaces. However, learning such models generally relies on the availability of abundant and diverse training examples. In highly specialised domains this…

Computation and Language · Computer Science 2015-12-04 Stephanie L. Hyland , Theofanis Karaletsos , Gunnar Rätsch

Cognitive science and neuroscience have long faced the challenge of disentangling representations of language from representations of conceptual meaning. As the same problem arises in today's language models (LMs), we investigate the…

Computation and Language · Computer Science 2025-08-18 Maria Ryskina , Greta Tuckute , Alexander Fung , Ashley Malkin , Evelina Fedorenko

Using a vocabulary that is shared across languages is common practice in Multilingual Neural Machine Translation (MNMT). In addition to its simple design, shared tokens play an important role in positive knowledge transfer, assuming that…

Computation and Language · Computer Science 2024-01-23 Di Wu , Christof Monz

Sentence embeddings induced with various transformer architectures encode much semantic and syntactic information in a distributed manner in a one-dimensional array. We investigate whether specific grammatical information can be accessed in…

Computation and Language · Computer Science 2023-12-18 Vivi Nastase , Paola Merlo

Sentence embeddings from transformer models encode in a fixed length vector much linguistic information. We explore the hypothesis that these embeddings consist of overlapping layers of information that can be separated, and on which…

Computation and Language · Computer Science 2024-07-03 Vivi Nastase , Paola Merlo