English
Related papers

Related papers: Sparse associative memory based on contextual code…

200 papers

In recent years, Large Language Models (LLMs) have garnered significant attention from the research community due to their exceptional performance and generalization capabilities. In this paper, we introduce a novel method for…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-21 Egor Lakomkin , Chunyang Wu , Yassir Fathullah , Ozlem Kalinli , Michael L. Seltzer , Christian Fuegen

Word sense disambiguation (WSD) methods identify the most suitable meaning of a word with respect to the usage of that word in a specific context. Neural network-based WSD approaches rely on a sense-annotated corpus since they do not…

Computation and Language · Computer Science 2021-02-11 Sm Zobaed , Md Enamul Haque , Md Fazle Rabby , Mohsen Amini Salehi

Commonsense reasoning is fundamental to natural language understanding. While traditional methods rely heavily on human-crafted features and knowledge bases, we explore learning commonsense knowledge from a large amount of raw text via…

Computation and Language · Computer Science 2019-04-04 Shuohang Wang , Sheng Zhang , Yelong Shen , Xiaodong Liu , Jingjing Liu , Jianfeng Gao , Jing Jiang

In this paper, we present a new approach for word sense disambiguation (WSD) using an exemplar-based learning algorithm. This approach integrates a diverse set of knowledge sources to disambiguate word sense, including part of speech of…

cmp-lg · Computer Science 2008-02-03 Hwee Tou Ng , Hian Beng Lee

Pretrained Language Models (PLMs) learn rich cross-lingual knowledge and can be finetuned to perform well on diverse tasks such as translation and multilingual word sense disambiguation (WSD). However, they often struggle at disambiguating…

Computation and Language · Computer Science 2023-04-28 Haoqiang Kang , Terra Blevins , Luke Zettlemoyer

Recent years of research in Natural Language Processing (NLP) have witnessed dramatic growth in training large models for generating context-aware language representations. In this regard, numerous NLP systems have leveraged the power of…

Computation and Language · Computer Science 2024-09-04 Avi Chawla , Nidhi Mulay , Vikas Bishnoi , Gaurav Dhama , Anil Kumar Singh

Understanding the meaning of words in context is a fundamental capability for Large Language Models (LLMs). Despite extensive evaluation efforts, the extent to which LLMs show evidence that they truly grasp word senses remains…

Computation and Language · Computer Science 2025-09-18 Domenico Meconi , Simone Stirpe , Federico Martelli , Leonardo Lavalle , Roberto Navigli

Understanding the meaning of words is crucial for many tasks that involve human-machine interaction. This has been tackled by research in Word Sense Disambiguation (WSD) in the Natural Language Processing (NLP) field. Recently, WSD and many…

Computation and Language · Computer Science 2020-02-26 María G. Buey , Carlos Bobed , Jorge Gracia , Eduardo Mena

A promising approach for knowledge-based Word Sense Disambiguation (WSD) is to select the sense whose contextualized embeddings computed for its definition sentence are closest to those computed for a target word in a given sentence. This…

Computation and Language · Computer Science 2023-04-25 Sakae Mizuki , Naoaki Okazaki

Word sense disambiguation (WSD) is a well researched problem in computational linguistics. Different research works have approached this problem in different ways. Some state of the art results that have been achieved for this problem are…

Computation and Language · Computer Science 2018-09-05 Mahtab Ahmed , Muhammad Rifayat Samee , Robert E. Mercer

Cross-lingual word sense disambiguation (WSD) tackles the challenge of disambiguating ambiguous words across languages given context. The pre-trained BERT embedding model has been proven to be effective in extracting contextual information…

Computation and Language · Computer Science 2020-12-11 Xingran Zhu

Interpretability benefits the theoretical understanding of representations. Existing word embeddings are generally dense representations. Hence, the meaning of latent dimensions is difficult to interpret. This makes word embeddings like a…

Computation and Language · Computer Science 2023-06-27 Minxue Xia , Hao Zhu

Biomedical word sense disambiguation (WSD) is an important intermediate task in many natural language processing applications such as named entity recognition, syntactic parsing, and relation extraction. In this paper, we employ…

Computation and Language · Computer Science 2017-10-03 A. K. M. Sabbir , Antonio Jimeno Yepes , Ramakanth Kavuluru

Word embeddings are now ubiquitous forms of word representation in natural language processing. There have been applications of word embeddings for monolingual word sense disambiguation (WSD) in English, but few comparisons have been done.…

Computation and Language · Computer Science 2017-04-11 Hong Jin Kang , Tao Chen , Muthu Kumar Chandrasekaran , Min-Yen Kan

Transformer-based language models have taken many fields in NLP by storm. BERT and its derivatives dominate most of the existing evaluation benchmarks, including those for Word Sense Disambiguation (WSD), thanks to their ability in…

Computation and Language · Computer Science 2021-03-19 Daniel Loureiro , Kiamehr Rezaee , Mohammad Taher Pilehvar , Jose Camacho-Collados

Visual Word Sense Disambiguation (VWSD) is a novel challenging task that lies between linguistic sense disambiguation and fine-grained multimodal retrieval. The recent advancements in the development of visiolinguistic (VL) transformers…

Computation and Language · Computer Science 2024-04-23 Anastasia Kritharoula , Maria Lymperaiou , Giorgos Stamou

Interpretability of a predictive model is a powerful feature that gains the trust of users in the correctness of the predictions. In word sense disambiguation (WSD), knowledge-based systems tend to be much more interpretable than…

Computation and Language · Computer Science 2018-05-21 Alexander Panchenko , Fide Marten , Eugen Ruppert , Stefano Faralli , Dmitry Ustalov , Simone Paolo Ponzetto , Chris Biemann

Neural word representations have proven useful in Natural Language Processing (NLP) tasks due to their ability to efficiently model complex semantic and syntactic word relationships. However, most techniques model only one representation…

Computation and Language · Computer Science 2015-11-23 Andrew Trask , Phil Michalak , John Liu

Recently, Yuan et al. (2016) have shown the effectiveness of using Long Short-Term Memory (LSTM) for performing Word Sense Disambiguation (WSD). Their proposed technique outperformed the previous state-of-the-art with several benchmarks,…

Computation and Language · Computer Science 2017-12-19 Minh Le , Marten Postma , Jacopo Urbani

In natural language processing, word-sense disambiguation (WSD) is an open problem concerned with identifying the correct sense of words in a particular context. To address this problem, we introduce a novel knowledge-based WSD system. We…

Computation and Language · Computer Science 2020-06-23 Sunjae Kwon , Dongsuk Oh , Youngjoong Ko