English
Related papers

Related papers: Improving Interpretability of Lexical Semantic Cha…

200 papers

Meanings of words change over time and across domains. Detecting the semantic changes of words is an important task for various NLP applications that must make time-sensitive predictions. We consider the problem of predicting whether a…

Computation and Language · Computer Science 2023-10-17 Taichi Aida , Danushka Bollegala

Contextualized embeddings are the preferred tool for modeling Lexical Semantic Change (LSC). Current evaluations typically focus on a specific task known as Graded Change Detection (GCD). However, performance comparison across work are…

Computation and Language · Computer Science 2024-10-31 Francesco Periti , Nina Tahmasebi

Languages continually evolve in response to societal events, resulting in new terms and shifts in meanings. These changes have significant implications for computer applications, including automatic translation and chatbots, making it…

Computation and Language · Computer Science 2024-07-24 Jader Martins Camboim de Sá , Marcos Da Silveira , Cédric Pruski

We use contextualized word definitions generated by large language models as semantic representations in the task of diachronic lexical semantic change detection (LSCD). In short, generated definitions are used as `senses', and the change…

Computation and Language · Computer Science 2024-08-01 Mariia Fedorova , Andrey Kutuzov , Yves Scherrer

The meaning of a word is closely linked to sociocultural factors that can change over time and location, resulting in corresponding meaning changes. Taking a global view of words and their meanings in a widely used language, such as…

Computation and Language · Computer Science 2020-10-05 Hongyu Gong , Suma Bhat , Pramod Viswanath

Detecting lexical semantic change in smaller data sets, e.g. in historical linguistics and digital humanities, is challenging due to a lack of statistical power. This issue is exacerbated by non-contextual embedding models that produce one…

Computation and Language · Computer Science 2022-02-23 Yang Liu , Alan Medlar , Dorota Glowacka

Lexical Semantic Change detection, i.e., the task of identifying words that change meaning over time, is a very active research area, with applications in NLP, lexicography, and linguistics. Evaluation is currently the most pressing problem…

Computation and Language · Computer Science 2020-09-01 Dominik Schlechtweg , Barbara McGillivray , Simon Hengchen , Haim Dubossarsky , Nina Tahmasebi

The way the words are used evolves through time, mirroring cultural or technological evolution of society. Semantic change detection is the task of detecting and analysing word evolution in textual data, even in short periods of time. In…

Computation and Language · Computer Science 2020-04-21 Matej Martinc , Syrielle Montariol , Elaine Zosa , Lidia Pivovarova

Semantic feature models have become a popular tool for prediction and interpretation of fMRI data. In particular, prior work has shown that differences in the fMRI patterns in sentence reading can be explained by context-dependent changes…

Computation and Language · Computer Science 2021-01-14 N. Aguirre-Celis , R. Miikkulainen

Understanding the vulnerability of linguistic features extracted from noisy text is important for both developing better health text classification models and for interpreting vulnerabilities of natural language models. In this paper, we…

Computation and Language · Computer Science 2019-10-02 Jekaterina Novikova , Aparna Balagopalan , Ksenia Shkaruta , Frank Rudzicz

Lexical Semantic Change Detection stands out as one of the few areas where Large Language Models (LLMs) have not been extensively involved. Traditional methods like PPMI, and SGNS remain prevalent in research, alongside newer BERT-based…

Computation and Language · Computer Science 2023-12-12 Ruiyu Wang , Matthew Choi

By integrating recent advances in large language models (LLMs) and generative models into the emerging semantic communication (SC) paradigm, in this article we put forward to a novel framework of language-oriented semantic communication…

Signal Processing · Electrical Eng. & Systems 2023-09-21 Hyelin Nam , Jihong Park , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

This paper presents the first unsupervised approach to lexical semantic change that makes use of contextualised word representations. We propose a novel method that exploits the BERT neural language model to obtain representations of word…

Computation and Language · Computer Science 2020-10-21 Mario Giulianelli , Marco Del Tredici , Raquel Fernández

We propose a new computational approach for tracking and detecting statistically significant linguistic shifts in the meaning and usage of words. Such linguistic shifts are especially prevalent on the Internet, where the rapid exchange of…

Computation and Language · Computer Science 2014-11-13 Vivek Kulkarni , Rami Al-Rfou , Bryan Perozzi , Steven Skiena

The meanings and relationships of words shift over time. This phenomenon is referred to as semantic shift. Research focused on understanding how semantic shifts occur over multiple time periods is essential for gaining a detailed…

Computation and Language · Computer Science 2025-01-20 Hajime Kiyama , Taichi Aida , Mamoru Komachi , Toshinobu Ogiso , Hiroya Takamura , Daichi Mochihashi

Measuring semantic change has thus far remained a task where methods using contextual embeddings have struggled to improve upon simpler techniques relying only on static word vectors. Moreover, many of the previously proposed approaches…

Computation and Language · Computer Science 2023-09-07 Dallas Card

Semantic communications, a promising approach for agent-human and agent-agent interactions, typically operate at a feature level, lacking true semantic understanding. This paper explores understanding-level semantic communications (ULSC),…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Shuaishuai Guo , Yanhu Wang , Jia Ye , Anbang Zhang , Kun Xu

In natural language processing (NLP) of spoken languages, word embeddings have been shown to be a useful method to encode the meaning of words. Sign languages are visual languages, which require sign embeddings to capture the visual and…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Ryan Wong , Necati Cihan Camgoz , Richard Bowden

Lexical Semantic Change is the study of how the meaning of words evolves through time. Another related question is whether and how lexical relations over pairs of words, such as synonymy, change over time. There are currently two competing,…

Computation and Language · Computer Science 2023-05-31 Bastien Liétard , Mikaela Keller , Pascal Denis

The dynamic nature of language, particularly evident in the realm of slang and memes on the Internet, poses serious challenges to the adaptability of large language models (LLMs). Traditionally anchored to static datasets, these models…

Computation and Language · Computer Science 2025-02-04 Lingrui Mei , Shenghua Liu , Yiwei Wang , Baolong Bi , Xueqi Cheng