English
Related papers

Related papers: English Out-of-Vocabulary Lexical Evaluation Task

200 papers

Word representation is a key component in neural-network-based sequence labeling systems. However, representations of unseen or rare words trained on the end task are usually poor for appreciable performance. This is commonly referred to as…

Computation and Language · Computer Science 2019-05-30 Minlong Peng , Qi Zhang , Xiaoyu Xing , Tao Gui , Jinlan Fu , Xuanjing Huang

Communication has become increasingly dynamic with the popularization of social networks and applications that allow people to express themselves and communicate instantly. In this scenario, distributed representation models have their…

Computation and Language · Computer Science 2024-05-30 Johannes V. Lochter , Renato M. Silva , Tiago A. Almeida

While recent retrieval techniques do not limit the number of index terms, out-of-vocabulary (OOV) words are crucial in speech recognition. Aiming at retrieving information with spoken queries, we fill the gap between speech recognition and…

Computation and Language · Computer Science 2007-05-23 Atsushi Fujii , Katunobu Itou , Tetsuya Ishikawa

We propose a new contextual-compositional neural network layer that handles out-of-vocabulary (OOV) words in natural language processing (NLP) tagging tasks. This layer consists of a model that attends to both the character sequence and the…

Machine Learning · Computer Science 2019-12-17 Nicolas Garneau , Jean-Samuel Leboeuf , Yuval Pinter , Luc Lamontagne

Existing approaches for learning word embeddings often assume there are sufficient occurrences for each word in the corpus, such that the representation of words can be accurately estimated from their contexts. However, in real-world…

Computation and Language · Computer Science 2019-07-02 Ziniu Hu , Ting Chen , Kai-Wei Chang , Yizhou Sun

We propose a novel way to handle out of vocabulary (OOV) words in downstream natural language processing (NLP) tasks. We implement a network that predicts useful embeddings for OOV words based on their morphology and on the context in which…

Computation and Language · Computer Science 2019-03-05 Nicolas Garneau , Jean-Samuel Leboeuf , Luc Lamontagne

Language in social media is mostly driven by new words and spellings that are constantly entering the lexicon thereby polluting it and resulting in high deviation from the formal written version. The primary entities of such language are…

Computation and Language · Computer Science 2016-02-02 Suman Kalyan Maity , Chaitanya Sarda , Anshit Chaudhary , Abhijeet Patil , Shraman Kumar , Akash Mondal , Animesh Mukherjee

Semantic representations of words have been successfully extracted from unlabeled corpuses using neural network models like word2vec. These representations are generally high quality and are computationally inexpensive to train, making them…

Computation and Language · Computer Science 2019-10-24 Raj Patel , Carlotta Domeniconi

One of the most important causes of failure in spoken dialogue systems is usually neglected: the problem of words that are not covered by the system's vocabulary (out-of-vocabulary or OOV words). In this paper a methodology is described for…

cmp-lg · Computer Science 2008-02-03 Manuela Boros , Maria Aretoulaki , Florian Gallwitz , Elmar Noeth , Heinrich Niemann

This paper presents final results of the Out-Of-Vocabulary 2022 (OOV) challenge. The OOV contest introduces an important aspect that is not commonly studied by Optical Character Recognition (OCR) models, namely, the recognition of unseen…

Computer Vision and Pattern Recognition · Computer Science 2022-09-15 Sergi Garcia-Bordils , Andrés Mafla , Ali Furkan Biten , Oren Nuriel , Aviad Aberdam , Shai Mazor , Ron Litman , Dimosthenis Karatzas

Large Language Models (LLMs) have great success in natural language processing tasks such as response generation. However, their use in tabular data has been limited due to their inferior performance compared to traditional machine learning…

Computation and Language · Computer Science 2024-08-27 Kangjun Noh , Baekryun Seong , Hoyoon Byun , Youngjun Choi , Sungjin Song , Kyungwoo Song

Open-Vocabulary Segmentation (OVS) methods are capable of performing semantic segmentation without relying on a fixed vocabulary, and in some cases, without training or fine-tuning. However, OVS methods typically require a human in the loop…

Computer Vision and Pattern Recognition · Computer Science 2025-03-13 Osman Ülger , Maksymilian Kulicki , Yuki Asano , Martin R. Oswald

Most statistical machine translation systems cannot translate words that are unseen in the training data. However, humans can translate many classes of out-of-vocabulary (OOV) words (e.g., novel morphological variants, misspellings, and…

Computation and Language · Computer Science 2018-08-20 Nelson F. Liu , Jonathan May , Michael Pust , Kevin Knight

Word embedding learning methods require a large number of occurrences of a word to accurately learn its embedding. However, out-of-vocabulary (OOV) words which do not appear in the training corpus emerge frequently in the smaller downstream…

Computation and Language · Computer Science 2021-02-25 Gordon Buck , Andreas Vlachos

Vision-language modeling has enabled open-vocabulary tasks where predictions can be queried using any text prompt in a zero-shot manner. Existing open-vocabulary tasks focus on object classes, whereas research on object attributes is…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 María A. Bravo , Sudhanshu Mittal , Simon Ging , Thomas Brox

State-of-the-art NLP systems represent inputs with word embeddings, but these are brittle when faced with Out-of-Vocabulary (OOV) words. To address this issue, we follow the principle of mimick-like models to generate vectors for unseen…

Computation and Language · Computer Science 2022-03-22 Lihu Chen , Gaël Varoquaux , Fabian M. Suchanek

Scene text recognition has attracted increasing interest in recent years due to its wide range of applications in multilingual translation, autonomous driving, etc. In this report, we describe our solution to the Out of Vocabulary Scene…

Computer Vision and Pattern Recognition · Computer Science 2022-09-02 Zhangzi Zhu , Chuhui Xue , Yu Hao , Wenqing Zhang , Song Bai

We present a novel learning method for word embeddings designed for relation classification. Our word embeddings are trained by predicting words between noun pairs using lexical relation-specific features on a large unlabeled corpus. This…

Computation and Language · Computer Science 2015-06-23 Kazuma Hashimoto , Pontus Stenetorp , Makoto Miwa , Yoshimasa Tsuruoka

The extreme multi-label classification (XMC) task aims at tagging content with a subset of labels from an extremely large label set. The label vocabulary is typically defined in advance by domain experts and assumed to capture all necessary…

Computation and Language · Computer Science 2022-05-13 Daniel Simig , Fabio Petroni , Pouya Yanki , Kashyap Popat , Christina Du , Sebastian Riedel , Majid Yazdani

Word embedding is an essential building block for deep learning methods for natural language processing. Although word embedding has been extensively studied over the years, the problem of how to effectively embed numerals, a special subset…

Computation and Language · Computer Science 2020-01-14 Chengyue Jiang , Zhonglin Nian , Kaihao Guo , Shanbo Chu , Yinggong Zhao , Libin Shen , Kewei Tu
‹ Prev 1 2 3 10 Next ›