English
Related papers

Related papers: Word sense induction using word embeddings and com…

200 papers

There have been some works that learn a lexicon together with the corpus to improve the word embeddings. However, they either model the lexicon separately but update the neural networks for both the corpus and the lexicon by the same…

Computation and Language · Computer Science 2017-07-25 Yuanzhi Ke , Masafumi Hagiwara

Most existing word embedding approaches do not distinguish the same words in different contexts, therefore ignoring their contextual meanings. As a result, the learned embeddings of these words are usually a mixture of multiple meanings. In…

Computation and Language · Computer Science 2016-12-04 Jian Tang , Meng Qu , Qiaozhu Mei

Word sense disambiguation tries to learn the appropriate sense of an ambiguous word in a given context. The existing pre-trained language methods and the methods based on multi-embeddings of word did not explore the power of the…

Computation and Language · Computer Science 2020-07-01 Xin Liu , Qingcai Chen , Yan Liu , Joanna Siebert , Baotian Hu , Xiangping Wu , Buzhou Tang

Understanding the meaning of words is crucial for many tasks that involve human-machine interaction. This has been tackled by research in Word Sense Disambiguation (WSD) in the Natural Language Processing (NLP) field. Recently, WSD and many…

Computation and Language · Computer Science 2020-02-26 María G. Buey , Carlos Bobed , Jorge Gracia , Eduardo Mena

Pre-trained contextual language models are ubiquitously employed for language understanding tasks, but are unsuitable for resource-constrained systems. Noncontextual word embeddings are an efficient alternative in these settings. Such…

Computation and Language · Computer Science 2023-04-24 Anik Saha , Alex Gittens , Bulent Yener

Sense embedding learning methods learn multiple vectors for a given ambiguous word, corresponding to its different word senses. For this purpose, different methods have been proposed in prior work on sense embedding learning that use…

Computation and Language · Computer Science 2023-05-31 Haochen Luo , Yi Zhou , Danushka Bollegala

Wordnets are indispensable tools for various natural language processing applications. Unfortunately, wordnets get outdated, and producing or updating wordnets can be slow and costly in terms of time and resources. This problem intensifies…

To avoid the "meaning conflation deficiency" of word embeddings, a number of models have aimed to embed individual word senses. These methods at one time performed well on tasks such as word sense induction (WSI), but they have since been…

Computation and Language · Computer Science 2021-01-27 Alan Ansell , Felipe Bravo-Marquez , Bernhard Pfahringer

Word sense induction (WSI), or the task of automatically discovering multiple senses or meanings of a word, has three main challenges: domain adaptability, novel sense detection, and sense granularity flexibility. While current latent…

Computation and Language · Computer Science 2018-11-26 Reinald Kim Amplayo , Seung-won Hwang , Min Song

Most of the time, the first step to learn word embeddings is to build a word co-occurrence matrix. As such matrices are equivalent to graphs, complex networks theory can naturally be used to deal with such data. In this paper, we consider…

Computation and Language · Computer Science 2019-10-04 Nicolas Dugué , Victor Connes

Polysemy and synonymy are two crucial interrelated facets of lexical ambiguity. While both phenomena are widely documented in lexical resources and have been studied extensively in NLP, leading to dedicated systems, they are often being…

Computation and Language · Computer Science 2025-11-10 Bastien Liétard , Pascal Denis , Mikaela Keller

Contextual embeddings represent a new generation of semantic representations learned from Neural Language Modelling (NLM) that addresses the issue of meaning conflation hampering traditional word embeddings. In this work, we show that…

Computation and Language · Computer Science 2019-06-25 Daniel Loureiro , Alipio Jorge

In this paper we concentrate on the resolution of the lexical ambiguity that arises when a given word has several different meanings. This specific task is commonly referred to as word sense disambiguation (WSD). The task of WSD consists of…

Computation and Language · Computer Science 2011-09-13 A. Montoyo , M. Palomar , G. Rigau , A. Suarez

Word embeddings represent a transformative technology for analyzing text data in social work research, offering sophisticated tools for understanding case notes, policy documents, research literature, and other text-based materials. This…

Computation and Language · Computer Science 2024-11-12 Brian E. Perron , Kelley A. Rivenburgh , Bryan G. Victor , Zia Qi , Hui Luan

Word embeddings are now ubiquitous forms of word representation in natural language processing. There have been applications of word embeddings for monolingual word sense disambiguation (WSD) in English, but few comparisons have been done.…

Computation and Language · Computer Science 2017-04-11 Hong Jin Kang , Tao Chen , Muthu Kumar Chandrasekaran , Min-Yen Kan

Word Sense Disambiguation (WSD) is the task of associating a word in a given context with its most suitable meaning among a set of possible candidates. While the task has recently witnessed renewed interest, with systems achieving…

Computation and Language · Computer Science 2024-12-13 Andrei Stefan Bejgu , Edoardo Barba , Luigi Procopio , Alberte Fernández-Castro , Roberto Navigli

Word embeddings have been widely used in sentiment classification because of their efficacy for semantic representations of words. Given reviews from different domains, some existing methods for word embeddings exploit sentiment…

Computation and Language · Computer Science 2018-05-11 Bei Shi , Zihao Fu , Lidong Bing , Wai Lam

Word Sense Disambiguation (WSD) aims to identify the correct meaning of polysemous words in the particular context. Lexical resources like WordNet which are proved to be of great help for WSD in the knowledge-based methods. However,…

Computation and Language · Computer Science 2018-07-17 Fuli Luo , Tianyu Liu , Qiaolin Xia , Baobao Chang , Zhifang Sui

Many less-resourced languages struggle with a lack of large, task-specific datasets that are required for solving relevant tasks with modern transformer-based large language models (LLMs). On the other hand, many linguistic resources, such…

Computation and Language · Computer Science 2025-03-07 Tadej Škvorc , Marko Robnik-Šikonja

Despite the success achieved on various natural language processing tasks, word embeddings are difficult to interpret due to the dense vector representations. This paper focuses on interpreting the embeddings for various aspects, including…

Computation and Language · Computer Science 2018-09-11 Ting-Yun Chang , Ta-Chung Chi , Shang-Chi Tsai , Yun-Nung Chen