English
Related papers

Related papers: SynWMD: Syntax-aware Word Mover's Distance for Sen…

200 papers

Measuring the semantic similarity between two sentences is still an important task. The word mover's distance (WMD) computes the similarity via the optimal alignment between the sets of word embeddings. However, WMD does not utilize word…

Computation and Language · Computer Science 2023-11-03 Hiroaki Yamagiwa , Sho Yokoi , Hidetoshi Shimodaira

The Word Mover's Distance (WMD) is a metric that measures the semantic dissimilarity between two text documents by computing the cost of moving all words of a source/query document to the most similar words of a target document optimally.…

Machine Learning · Computer Science 2021-03-24 Jesmin Jahan Tithi , Fabrizio Petrini

The word mover's distance (WMD) is a popular semantic similarity metric for two texts. This position paper studies several possible extensions of WMD. We experiment with the frequency of words in the corpus as a weighting factor and the…

Computation and Language · Computer Science 2022-02-09 Ilya Smirnov , Ivan P. Yamshchikov

The Word Mover's Distance (WMD) proposed by Kusner et al. is a distance between documents that takes advantage of semantic relations among words that are captured by their embeddings. This distance proved to be quite effective, obtaining…

Computation and Language · Computer Science 2020-05-12 Matheus Werner , Eduardo Laber

The Word Movers Distance (WMD) measures the semantic dissimilarity between two text documents by computing the cost of optimally moving all words of a source/query document to the most similar words of a target document. Computing WMD…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-04-27 Jesmin Jahan Tithi , Fabrizio Petrini

While the celebrated Word2Vec technique yields semantically rich representations for individual words, there has been relatively less success in extending to generate unsupervised sentences or documents embeddings. Recent work has…

Computation and Language · Computer Science 2018-11-06 Lingfei Wu , Ian E. H. Yen , Kun Xu , Fangli Xu , Avinash Balakrishnan , Pin-Yu Chen , Pradeep Ravikumar , Michael J. Witbrock

Assessing the proper difficulty levels of reading materials or texts in general is the first step towards effective comprehension and learning. In this study, we improve the conventional methodology of automatic readability assessment by…

Computation and Language · Computer Science 2021-09-21 Joseph Marvin Imperial , Ethel Ong

The word mover's distance (WMD) is a fundamental technique for measuring the similarity of two documents. As the crux of WMD, it can take advantage of the underlying geometry of the word space by employing an optimal transport formulation.…

Machine Learning · Computer Science 2022-06-16 Ryoma Sato , Makoto Yamada , Hisashi Kashima

A key principle in assessing textual similarity is measuring the degree of semantic overlap between two texts by considering the word alignment. Such alignment-based approaches are intuitive and interpretable; however, they are empirically…

Computation and Language · Computer Science 2020-11-17 Sho Yokoi , Ryo Takahashi , Reina Akama , Jun Suzuki , Kentaro Inui

Recently, finetuning a pretrained language model to capture the similarity between sentence embeddings has shown the state-of-the-art performance on the semantic textual similarity (STS) task. However, the absence of an interpretation…

Artificial Intelligence · Computer Science 2022-04-15 Seonghyeon Lee , Dongha Lee , Seongbo Jang , Hwanjo Yu

Search behaviour is characterised using synonymy and polysemy as users often want to search information based on meaning. Semantic representation strategies represent a move towards richer associative connections that can adequately capture…

Information Retrieval · Computer Science 2026-02-06 Niall McCarroll , Kevin Curran , Eugene McNamee , Angela Clist , Andrew Brammer

The task of generating natural language descriptions from images has received a lot of attention in recent years. Consequently, it is becoming increasingly important to evaluate such image captioning approaches in an automatic manner. In…

Computation and Language · Computer Science 2016-12-23 Mert Kilickaya , Aykut Erdem , Nazli Ikizler-Cinbis , Erkut Erdem

Detecting temporal semantic changes of words is an important task for various NLP applications that must make time-sensitive predictions. Lexical Semantic Change Detection (SCD) task involves predicting whether a given target word, $w$,…

Computation and Language · Computer Science 2024-06-04 Taichi Aida , Danushka Bollegala

Despite the increasing popularity of NLP in the humanities and social sciences, advances in model performance and complexity have been accompanied by concerns about interpretability and explanatory power for sociocultural analysis. One…

Computation and Language · Computer Science 2021-10-15 Mikael Brunila , Jack LaViolette

As a fundamental problem of natural language processing, it is important to measure the distance between different documents. Among the existing methods, the Word Mover's Distance (WMD) has shown remarkable success in document semantic…

Machine Learning · Computer Science 2019-07-12 Zihao Wang , Datong Zhou , Yong Zhang , Hao Wu , Chenglong Bao

Overlapping frequently occurs in paired texts in natural language processing tasks like text editing and semantic similarity evaluation. Better evaluation of the semantic distance between the overlapped sentences benefits the language…

Computation and Language · Computer Science 2023-06-14 Letian Peng , Zuchao Li , Hai Zhao

The rapid development of such natural language processing tasks as style transfer, paraphrase, and machine translation often calls for the use of semantic similarity metrics. In recent years a lot of methods to measure the semantic…

Computation and Language · Computer Science 2022-11-15 Ivan P. Yamshchikov , Viacheslav Shibaev , Nikolay Khlebnikov , Alexey Tikhonov

The amount of unstructured text-based data is growing every day. Querying, clustering, and classifying this big data requires similarity computations across large sets of documents. Whereas low-complexity similarity metrics are available,…

In natural language processing, word-sense disambiguation (WSD) is an open problem concerned with identifying the correct sense of words in a particular context. To address this problem, we introduce a novel knowledge-based WSD system. We…

Computation and Language · Computer Science 2020-06-23 Sunjae Kwon , Dongsuk Oh , Youngjoong Ko

In this paper, we model the document revision detection problem as a minimum cost branching problem that relies on computing document distances. Furthermore, we propose two new document distance measures, word vector-based Dynamic Time…

Information Retrieval · Computer Science 2020-01-08 Xiaofeng Zhu , Diego Klabjan , Patrick Bless
‹ Prev 1 2 3 10 Next ›