English
Related papers

Related papers: Simulating Lexical Semantic Change from Sense-Anno…

200 papers

The lack of contextual information in text data can make the annotation process of text-based emotion classification datasets challenging. As a result, such datasets often contain labels that fail to consider all the relevant emotions in…

Computation and Language · Computer Science 2023-11-08 Daniel Yang , Aditya Kommineni , Mohammad Alshehri , Nilamadhab Mohanty , Vedant Modi , Jonathan Gratch , Shrikanth Narayanan

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these synthetic data are mainly used in the pre-training phase…

Computation and Language · Computer Science 2024-06-26 Yixuan Wang , Baoxin Wang , Yijun Liu , Qingfu Zhu , Dayong Wu , Wanxiang Che

We present a novel approach to learn representations for sentence-level semantic similarity using conversational data. Our method trains an unsupervised model to predict conversational input-response pairs. The resulting sentence embeddings…

Computation and Language · Computer Science 2018-04-23 Yinfei Yang , Steve Yuan , Daniel Cer , Sheng-yi Kong , Noah Constant , Petr Pilar , Heming Ge , Yun-Hsuan Sung , Brian Strope , Ray Kurzweil

This paper addresses the critical need for high-quality evaluation datasets in low-resource languages to advance cross-lingual transfer. While cross-lingual transfer offers a key strategy for leveraging multilingual pretraining to expand…

The ability to correctly model distinct meanings of a word is crucial for the effectiveness of semantic representation techniques. However, most existing evaluation benchmarks for assessing this criterion are tied to sense inventories…

Computation and Language · Computer Science 2020-10-14 Alessandro Raganato , Tommaso Pasini , Jose Camacho-Collados , Mohammad Taher Pilehvar

In this paper we present a clean, yet effective, model for word sense disambiguation. Our approach leverage a bidirectional long short-term memory network which is shared between all words. This enables the model to share statistical…

Computation and Language · Computer Science 2016-11-22 Mikael Kågebäck , Hans Salomonsson

Recently, Yuan et al. (2016) have shown the effectiveness of using Long Short-Term Memory (LSTM) for performing Word Sense Disambiguation (WSD). Their proposed technique outperformed the previous state-of-the-art with several benchmarks,…

Computation and Language · Computer Science 2017-12-19 Minh Le , Marten Postma , Jacopo Urbani

Sense tagging, the automatic assignment of the appropriate sense from some lexicon to each of the words in a text, is a specialised instance of the general problem of semantic tagging by category or type. We discuss which recent word sense…

cmp-lg · Computer Science 2008-02-03 Yorick Wilks , Mark Stevenson

Lexical semantic change detection (LSCD) increasingly relies on contextualised language model embeddings, yet most approaches still quantify change using a small set of semantic change metrics, primarily Average Pairwise Distance (APD) and…

Computation and Language · Computer Science 2026-02-18 Roksana Goworek , Haim Dubossarsky

We present a new approach to learning semantic parsers from multiple datasets, even when the target semantic formalisms are drastically different, and the underlying corpora do not overlap. We handle such "disjoint" data by treating…

Computation and Language · Computer Science 2018-04-18 Hao Peng , Sam Thomson , Swabha Swayamdipta , Noah A. Smith

Natural Language Understanding has seen an increasing number of publications in the last few years, especially after robust word embeddings models became prominent, when they proved themselves able to capture and represent semantic…

Computation and Language · Computer Science 2022-12-20 Terry Ruas , William Grosky , Akiko Aizawa

Recent years have witnessed a surge of publications aimed at tracing temporal changes in lexical semantics using distributional methods, particularly prediction-based word embedding models. However, this vein of research lacks the cohesion,…

Computation and Language · Computer Science 2018-06-14 Andrey Kutuzov , Lilja Øvrelid , Terrence Szymanski , Erik Velldal

Recent advances in large language models have prompted researchers to examine their abilities across a variety of linguistic tasks, but little has been done to investigate how models handle the interactions in meaning across words and…

Computation and Language · Computer Science 2023-07-11 Lindia Tjuatja , Emmy Liu , Lori Levin , Graham Neubig

Contextualised word embeddings is a powerful tool to detect contextual synonyms. However, most of the current state-of-the-art (SOTA) deep learning concept extraction methods remain supervised and underexploit the potential of the context.…

Computation and Language · Computer Science 2021-09-07 Jingqing Zhang , Luis Bolanos , Tong Li , Ashwani Tanwar , Guilherme Freire , Xian Yang , Julia Ive , Vibhor Gupta , Yike Guo

Much as the social landscape in which languages are spoken shifts, language too evolves to suit the needs of its users. Lexical semantic change analysis is a burgeoning field of semantic analysis which aims to trace changes in the meanings…

Computation and Language · Computer Science 2020-10-20 Eleri Sarsfield , Harish Tayyar Madabushi

There has been a surge of interest in computational modeling of semantic change. The foci of previous works are on detecting and interpreting word senses gained over time; however, it remains unclear whether the gained senses are covered by…

Computation and Language · Computer Science 2024-07-08 Xianghe Ma , Dominik Schlechtweg , Wei Zhao

In this paper, we propose an unsupervised method to identify noun sense changes based on rigorous analysis of time-varying text data available in the form of millions of digitized books. We construct distributional thesauri based networks…

Computation and Language · Computer Science 2014-05-20 Sunny Mitra , Ritwik Mitra , Martin Riedl , Chris Biemann , Animesh Mukherjee , Pawan Goyal

We propose a new method that leverages contextual embeddings for the task of diachronic semantic shift detection by generating time specific word representations from BERT embeddings. The results of our experiments in the domain specific…

Computation and Language · Computer Science 2020-03-06 Matej Martinc , Petra Kralj Novak , Senja Pollak

Current state of the art systems in NLP heavily rely on manually annotated datasets, which are expensive to construct. Very little work adequately exploits unannotated data -- such as discourse markers between sentences -- mainly because of…

Computation and Language · Computer Science 2019-03-29 Damien Sileo , Tim Van-De-Cruys , Camille Pradel , Philippe Muller

The requirement of large amounts of annotated images has become one grand challenge while training deep neural network models for various visual detection and recognition tasks. This paper presents a novel image synthesis technique that…

Computer Vision and Pattern Recognition · Computer Science 2018-09-27 Fangneng Zhan , Shijian Lu , Chuhui Xue