English
Related papers

Related papers: Problems With Evaluation of Word Embeddings Using …

200 papers

Vector-based word representations help countless Natural Language Processing (NLP) tasks capture the language's semantic and syntactic regularities. In this paper, we present the characteristics of existing word embedding approaches and…

Computation and Language · Computer Science 2024-03-05 Obaidullah Zaland , Muhammad Abulaish , Mohd. Fazil

Mapping words into a fixed-dimensional vector space is the backbone of modern NLP. While most word embedding methods successfully encode semantic information, they overlook phonetic information that is crucial for many tasks. We develop…

Computation and Language · Computer Science 2024-03-27 Vilém Zouhar , Kalvin Chang , Chenxuan Cui , Nathaniel Carlson , Nathaniel Robinson , Mrinmaya Sachan , David Mortensen

Analysis of word embedding properties to inform their use in downstream NLP tasks has largely been studied by assessing nearest neighbors. However, geometric properties of the continuous feature space contribute directly to the use of…

Computation and Language · Computer Science 2019-04-11 Brendan Whitaker , Denis Newman-Griffis , Aparajita Haldar , Hakan Ferhatosmanoglu , Eric Fosler-Lussier

One of the most important problems in machine translation (MT) evaluation is to evaluate the similarity between translation hypotheses with different surface forms from the reference, especially at the segment level. We propose to use word…

Computation and Language · Computer Science 2017-04-04 Junki Matsuo , Mamoru Komachi , Katsuhito Sudoh

Semantic Similarity is an important application which finds its use in many downstream NLP applications. Though the task is mathematically defined, semantic similarity's essence is to capture the notions of similarity impregnated in humans.…

Computation and Language · Computer Science 2018-05-18 Ameet Deshpande , Vedant Somani

Semantic textual similarity is one of the open research challenges in the field of Natural Language Processing. Extensive research has been carried out in this field and near-perfect results are achieved by recent transformer-based models…

Computation and Language · Computer Science 2021-07-13 Dhivya Chandrasekaran , Vijay Mago

In the field of natural language processing (NLP), continuous vector representations are crucial for capturing the semantic meanings of individual words. Yet, when it comes to the representations of sets of words, the conventional…

Computation and Language · Computer Science 2024-04-11 Yoichi Ishibashi , Sho Yokoi , Katsuhito Sudoh , Satoshi Nakamura

Word embeddings are an essential instrument in many NLP tasks. Most available resources are trained on general language from Web corpora or Wikipedia dumps. However, word embeddings for domain-specific language are rare, in particular for…

Computation and Language · Computer Science 2023-02-14 Ricardo Schiffers , Dagmar Kern , Daniel Hienert

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left…

Computation and Language · Computer Science 2016-09-29 Shihao Ji , Hyokun Yun , Pinar Yanardag , Shin Matsushima , S. V. N. Vishwanathan

Understanding the meaning of words is crucial for many tasks that involve human-machine interaction. This has been tackled by research in Word Sense Disambiguation (WSD) in the Natural Language Processing (NLP) field. Recently, WSD and many…

Computation and Language · Computer Science 2020-02-26 María G. Buey , Carlos Bobed , Jorge Gracia , Eduardo Mena

While word embeddings are currently predominant for natural language processing, most of existing models learn them solely from their contexts. However, these context-based word embeddings are limited since not all words' meaning can be…

Computation and Language · Computer Science 2016-08-23 Jifan Chen , Kan Chen , Xipeng Qiu , Qi Zhang , Xuanjing Huang , Zheng Zhang

Word Embeddings are used widely in multiple Natural Language Processing (NLP) applications. They are coordinates associated with each word in a dictionary, inferred from statistical properties of these words in a large corpus. In this paper…

Computation and Language · Computer Science 2020-06-18 Adam Sutton , Nello Cristianini

Distributed word representations are popularly used in many tasks in natural language processing. Adding that pretrained word vectors on huge text corpus achieved high performance in many different NLP tasks. This paper introduces multiple…

Computation and Language · Computer Science 2022-03-11 Hadi Abdine , Christos Xypolopoulos , Moussa Kamal Eddine , Michalis Vazirgiannis

Estimating the semantic similarity between text data is one of the challenging and open research problems in the field of Natural Language Processing (NLP). The versatility of natural language makes it difficult to define rule-based methods…

Computation and Language · Computer Science 2021-02-24 Dhivya Chandrasekaran , Vijay Mago

We investigate the task of assessing sentence-level prompt relevance in learner essays. Various systems using word overlap, neural embeddings and neural compositional models are evaluated on two datasets of learner writing. We propose a new…

Computation and Language · Computer Science 2017-07-18 Marek Rei , Ronan Cummins

Since word embeddings have been the most popular input for many NLP tasks, evaluating their quality is of critical importance. Most research efforts are focusing on English word embeddings. This paper addresses the problem of constructing…

Computation and Language · Computer Science 2020-04-07 Stamatis Outsios , Christos Karatsalos , Konstantinos Skianis , Michalis Vazirgiannis

Word embeddings play a significant role in many modern NLP systems. Since learning one representation per word is problematic for polysemous words and homonymous words, researchers propose to use one embedding per word sense. Their…

Computation and Language · Computer Science 2016-10-25 Qi Li , Tianshi Li , Baobao Chang

The versatility of word embeddings for various applications is attracting researchers from various fields. However, the impact of hyper-parameters when training embedding model is often poorly understood. How much do hyper-parameters such…

Computation and Language · Computer Science 2018-04-13 Maryam Fanaeepour , Adam Makarucha , Jey Han Lau

This paper have two parts. In the first part we discuss word embeddings. We discuss the need for them, some of the methods to create them, and some of their interesting properties. We also compare them to image embeddings and see how word…

Machine Learning · Computer Science 2016-10-27 Amit Mandelbaum , Adi Shalev

There is a lot of research interest in encoding variable length sentences into fixed length vectors, in a way that preserves the sentence meanings. Two common methods include representations based on averaging word vectors, and…

Computation and Language · Computer Science 2017-02-10 Yossi Adi , Einat Kermany , Yonatan Belinkov , Ofer Lavi , Yoav Goldberg