English
Related papers

Related papers: Improved Word Sense Disambiguation Using Pre-Train…

200 papers

Supervised models for Word Sense Disambiguation (WSD) currently yield to state-of-the-art results in the most popular benchmarks. Despite the recent introduction of Word Embeddings and Recurrent Neural Networks to design powerful…

Computation and Language · Computer Science 2024-02-22 Stefano Melacci , Achille Globo , Leonardo Rigutini

Reading a document and extracting an answer to a question about its content has attracted substantial attention recently. While most work has focused on the interaction between the question and the document, in this work we evaluate the…

Computation and Language · Computer Science 2018-09-05 Shimi Salant , Jonathan Berant

Word Sense Disambiguation (WSD) is the task of associating a word in a given context with its most suitable meaning among a set of possible candidates. While the task has recently witnessed renewed interest, with systems achieving…

Computation and Language · Computer Science 2024-12-13 Andrei Stefan Bejgu , Edoardo Barba , Luigi Procopio , Alberte Fernández-Castro , Roberto Navigli

Word representation is a fundamental component in neural language understanding models. Recently, pre-trained language models (PrLMs) offer a new performant method of contextualized word representations by leveraging the sequence-level…

Computation and Language · Computer Science 2021-01-01 Zhuosheng Zhang , Haojie Yu , Hai Zhao , Rui Wang , Masao Utiyama

Employing pre-trained language models (LM) to extract contextualized word representations has achieved state-of-the-art performance on various NLP tasks. However, applying this technique to noisy transcripts generated by automatic speech…

Computation and Language · Computer Science 2020-11-03 Chao-Wei Huang , Yun-Nung Chen

In recent years, concepts and methods of complex networks have been employed to tackle the word sense disambiguation (WSD) task by representing words as nodes, which are connected if they are semantically similar. Despite the increasingly…

Computation and Language · Computer Science 2018-02-27 Edilson A. Correa , Alneu de Andrade Lopes , Diego R. Amancio

Biomedical word sense disambiguation (WSD) is an important intermediate task in many natural language processing applications such as named entity recognition, syntactic parsing, and relation extraction. In this paper, we employ…

Computation and Language · Computer Science 2017-10-03 A. K. M. Sabbir , Antonio Jimeno Yepes , Ramakanth Kavuluru

In this paper, we present a new approach for word sense disambiguation (WSD) using an exemplar-based learning algorithm. This approach integrates a diverse set of knowledge sources to disambiguate word sense, including part of speech of…

cmp-lg · Computer Science 2008-02-03 Hwee Tou Ng , Hian Beng Lee

The issue of word sense ambiguity poses a significant challenge in natural language processing due to the scarcity of annotated data to feed machine learning models to face the challenge. Therefore, unsupervised word sense disambiguation…

Computation and Language · Computer Science 2023-12-14 Jorge Martinez-Gil

Determining the intended sense of words in text - word sense disambiguation (WSD) - is a long standing problem in natural language processing. Recently, researchers have shown promising results using word vectors extracted from a neural…

Computation and Language · Computer Science 2016-11-08 Dayu Yuan , Julian Richardson , Ryan Doherty , Colin Evans , Eric Altendorf

Contextualized word representations have proven useful for various natural language processing tasks. However, it remains unclear to what extent these representations can cover hand-coded semantic information such as semantic frames, which…

Computation and Language · Computer Science 2021-05-31 Kosuke Yamada , Ryohei Sasano , Koichi Takeda

In this paper we concentrate on the resolution of the lexical ambiguity that arises when a given word has several different meanings. This specific task is commonly referred to as word sense disambiguation (WSD). The task of WSD consists of…

Computation and Language · Computer Science 2011-09-13 A. Montoyo , M. Palomar , G. Rigau , A. Suarez

Recent years of research in Natural Language Processing (NLP) have witnessed dramatic growth in training large models for generating context-aware language representations. In this regard, numerous NLP systems have leveraged the power of…

Computation and Language · Computer Science 2024-09-04 Avi Chawla , Nidhi Mulay , Vikas Bishnoi , Gaurav Dhama , Anil Kumar Singh

The goal of Word Sense Disambiguation (WSD) is to identify the sense of a polysemous word in a specific context. Deep-learning techniques using BERT have achieved very promising results in the field and different methods have been proposed…

Computation and Language · Computer Science 2021-10-15 Guan-Ting Lin , Manuel Giambi

We present a simple yet effective approach for learning word sense embeddings. In contrast to existing techniques, which either directly learn sense representations from corpora or rely on sense inventories from lexical resources, our…

Computation and Language · Computer Science 2017-08-14 Maria Pelevina , Nikolay Arefyev , Chris Biemann , Alexander Panchenko

Word sense disambiguation (WSD) is the task of determining the sense of a word in context. Translations have been used in WSD as a source of knowledge, and even as a means of delimiting word senses. In this paper, we define three…

Computation and Language · Computer Science 2023-10-05 Bradley Hauer , Grzegorz Kondrak

The neural architectures of language models are becoming increasingly complex, especially that of Transformers, based on the attention mechanism. Although their application to numerous natural language processing tasks has proven to be very…

Computation and Language · Computer Science 2023-12-04 Pablo Gamallo

Contextual word representations, typically trained on unstructured, unlabeled text, do not contain any explicit grounding to real world entities and are often unable to remember facts about those entities. We propose a general method to…

Computation and Language · Computer Science 2019-11-01 Matthew E. Peters , Mark Neumann , Robert L. Logan , Roy Schwartz , Vidur Joshi , Sameer Singh , Noah A. Smith

Interpretability of a predictive model is a powerful feature that gains the trust of users in the correctness of the predictions. In word sense disambiguation (WSD), knowledge-based systems tend to be much more interpretable than…

Computation and Language · Computer Science 2018-05-21 Alexander Panchenko , Fide Marten , Eugen Ruppert , Stefano Faralli , Dmitry Ustalov , Simone Paolo Ponzetto , Chris Biemann

A critical challenge faced by supervised word sense disambiguation (WSD) is the lack of large annotated datasets with sufficient coverage of words in their diversity of senses. This inspired recent research on few-shot WSD using…

Computation and Language · Computer Science 2021-06-08 Yingjun Du , Nithin Holla , Xiantong Zhen , Cees G. M. Snoek , Ekaterina Shutova