English
Related papers

Related papers: Meta-Learning with Variational Semantic Memory for…

200 papers

In this paper, we explore meta-learning for few-shot text classification. Meta-learning has shown strong performance in computer vision, where low-level patterns are transferable across learning tasks. However, directly applying this…

Computation and Language · Computer Science 2020-02-19 Yujia Bao , Menghua Wu , Shiyu Chang , Regina Barzilay

Best-performing speech models are trained on large amounts of data in the language they are meant to work for. However, most languages have sparse data, making training models challenging. This shortage of data is even more prevalent in…

Computation and Language · Computer Science 2024-10-08 David-Gabriel Ion , Răzvan-Alexandru Smădu , Dumitru-Clementin Cercel , Florin Pop , Mihaela-Claudia Cercel

Text classification tends to be difficult when data are deficient or when it is required to adapt to unseen classes. In such challenging scenarios, recent studies have often used meta-learning to simulate the few-shot task, thus negating…

Information Retrieval · Computer Science 2019-11-22 Shumin Deng , Ningyu Zhang , Zhanlin Sun , Jiaoyan Chen , Huajun Chen

Word embeddings are now ubiquitous forms of word representation in natural language processing. There have been applications of word embeddings for monolingual word sense disambiguation (WSD) in English, but few comparisons have been done.…

Computation and Language · Computer Science 2017-04-11 Hong Jin Kang , Tao Chen , Muthu Kumar Chandrasekaran , Min-Yen Kan

Word Sense Disambiguation (WSD) aims to automatically identify the exact meaning of one word according to its context. Existing supervised models struggle to make correct predictions on rare word senses due to limited training data and can…

Computation and Language · Computer Science 2021-10-28 Wenlin Yao , Xiaoman Pan , Lifeng Jin , Jianshu Chen , Dian Yu , Dong Yu

A major obstacle in Word Sense Disambiguation (WSD) is that word senses are not uniformly distributed, causing existing models to generally perform poorly on senses that are either rare or unseen during training. We propose a bi-encoder…

Computation and Language · Computer Science 2020-06-03 Terra Blevins , Luke Zettlemoyer

We propose a new method of generating meaningful embeddings for speech, changes to four commonly used meta learning approaches to enable them to perform keyword spotting in continuous signals and an approach of combining their outcomes into…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-26 Florian Lux , Ngoc Thang Vu

Language Models are the core for almost any Natural Language Processing system nowadays. One of their particularities is their contextualized representations, a game changer feature when a disambiguation between word senses is necessary. In…

Computation and Language · Computer Science 2023-02-08 Oscar Sainz , Oier Lopez de Lacalle , Eneko Agirre , German Rigau

In recent years, concepts and methods of complex networks have been employed to tackle the word sense disambiguation (WSD) task by representing words as nodes, which are connected if they are semantically similar. Despite the increasingly…

Computation and Language · Computer Science 2018-02-27 Edilson A. Correa , Alneu de Andrade Lopes , Diego R. Amancio

In this paper, we are going to find meaning of words based on distinct situations. Word Sense Disambiguation is used to find meaning of words based on live contexts using supervised and unsupervised approaches. Unsupervised approaches use…

Computation and Language · Computer Science 2016-11-04 Alok Ranjan Pal , Anirban Kundu , Abhay Singh , Raj Shekhar , Kunal Sinha

Contextual embeddings represent a new generation of semantic representations learned from Neural Language Modelling (NLM) that addresses the issue of meaning conflation hampering traditional word embeddings. In this work, we show that…

Computation and Language · Computer Science 2019-06-25 Daniel Loureiro , Alipio Jorge

To address the annotation scarcity issue in some cases of semantic segmentation, there have been a few attempts to develop the segmentation model in the few-shot learning paradigm. However, most existing methods only focus on the…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Pinzhuo Tian , Zhangkai Wu , Lei Qi , Lei Wang , Yinghuan Shi , Yang Gao

We consider the problem of few-shot spoken word classification in a setting where a model is incrementally introduced to new word classes. This would occur in a user-defined keyword system where new words can be added as the system is used.…

Computation and Language · Computer Science 2023-05-31 Ruan van der Merwe , Herman Kamper

This paper offers a mini review of Visual Word Sense Disambiguation (VWSD), which is a multimodal extension of traditional Word Sense Disambiguation (WSD). VWSD helps tackle lexical ambiguity in vision-language tasks. While conventional WSD…

Computation and Language · Computer Science 2026-02-03 Shashini Nilukshi , Deshan Sumanathilaka

Word sense disambiguation helps identifying the proper sense of ambiguous words in text. With large terminologies such as the UMLS Metathesaurus ambiguities appear and highly effective disambiguation methods are required. Supervised…

Computation and Language · Computer Science 2016-12-20 Antonio Jimeno Yepes

Recent advances in deep learning, in particular enabled by hardware advances and big data, have provided impressive results across a wide range of computational problems such as computer vision, natural language, or reinforcement learning.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Ileana Rugina , Rumen Dangovski , Mark Veillette , Pooya Khorrami , Brian Cheung , Olga Simek , Marin Soljačić

User-defined keyword spotting is a task to detect new spoken terms defined by users. This can be viewed as a few-shot learning problem since it is unreasonable for users to define their desired keywords by providing many examples. To solve…

Machine Learning · Computer Science 2022-10-06 Wei-Tsung Kao , Yuan-Kuei Wu , Chia-Ping Chen , Zhi-Sheng Chen , Yu-Pao Tsai , Hung-Yi Lee

Pretrained Language Models (PLMs) learn rich cross-lingual knowledge and can be finetuned to perform well on diverse tasks such as translation and multilingual word sense disambiguation (WSD). However, they often struggle at disambiguating…

Computation and Language · Computer Science 2023-04-28 Haoqiang Kang , Terra Blevins , Luke Zettlemoyer

Word Sense Disambiguation (WSD) aims to identify the correct meaning of polysemous words in the particular context. Lexical resources like WordNet which are proved to be of great help for WSD in the knowledge-based methods. However,…

Computation and Language · Computer Science 2018-07-17 Fuli Luo , Tianyu Liu , Qiaolin Xia , Baobao Chang , Zhifang Sui

Acquisition of multilingual training data continues to be a challenge in word sense disambiguation (WSD). To address this problem, unsupervised approaches have been proposed to automatically generate sense annotations for training…

Computation and Language · Computer Science 2021-09-21 Bradley Hauer , Grzegorz Kondrak , Yixing Luan , Arnob Mallik , Lili Mou