English
Related papers

Related papers: Moving Other Way: Exploring Word Mover Distance Ex…

200 papers

The surge in scientific publications challenges the use of publication counts as a measure of scientific progress, requiring alternative metrics that emphasize the quality and novelty of scientific contributions rather than sheer quantity.…

Digital Libraries · Computer Science 2024-09-04 Luca D'Aniello , Nicolas Robinson-Garcia , Massimo Aria , Corrado Cuccurullo

Overlapping frequently occurs in paired texts in natural language processing tasks like text editing and semantic similarity evaluation. Better evaluation of the semantic distance between the overlapped sentences benefits the language…

Computation and Language · Computer Science 2023-06-14 Letian Peng , Zuchao Li , Hai Zhao

The Earth Mover's Distance (EMD) is a state-of-the art metric for comparing discrete probability distributions, but its high distinguishability comes at a high cost in computational complexity. Even though linear-complexity approximation…

Machine Learning · Computer Science 2019-05-29 Kubilay Atasu , Thomas Mittelholzer

Similarity search is an important problem in information retrieval. This similarity is based on a distance. Symbolic representation of time series has attracted many researchers recently, since it reduces the dimensionality of these high…

Information Retrieval · Computer Science 2010-06-18 Muhammad Marwan Muhammad Fuad , Pierre-François Marteau

Since the seminal work of Mikolov et al., word embeddings have become the preferred word representations for many natural language processing tasks. Document similarity measures extracted from word embeddings, such as the soft cosine…

Information Retrieval · Computer Science 2020-04-02 Vít Novotný , Eniafe Festus Ayetiran , Michal Štefánik , Petr Sojka

We survey the emerging area of compression-based, parameter-free, similarity distance measures useful in data-mining, pattern recognition, learning and automatic semantics extraction. Given a family of distances on a set of objects, a…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Rudi Cilibrasi , Paul Vitanyi

A measure of similarity between text embeddings can be considered adequate only if it adheres to the human perception of similarity between texts. In this paper, we introduce the distance-to-distance ratio (DDR), a novel measure of…

Computation and Language · Computer Science 2026-01-27 Abdullah Qureshi , Kenneth Rice , Alexander Wolpert

Word embeddings predict a word from its neighbours by learning small, dense embedding vectors. In practice, this prediction corresponds to a semantic score given to the predicted word (or term weight). We present a novel model that, given a…

Information Retrieval · Computer Science 2019-06-04 Casper Hansen , Christian Hansen , Stephen Alstrup , Jakob Grue Simonsen , Christina Lioma

Word embeddings are high dimensional vector representations of words that capture their semantic similarity in the vector space. There exist several algorithms for learning such embeddings both for a single language as well as for several…

Computation and Language · Computer Science 2019-11-12 Georgios Balikas , Ioannis Partalas

The paper proposes a computationally feasible method for measuring context-sensitive semantic distance between words. The distance is computed by adaptive scaling of a semantic space. In the semantic space, each word in the vocabulary V is…

cmp-lg · Computer Science 2008-02-03 Hideki Kozima , Akira Ito

The Earth movers distance (EMD) is a measure of distance between probability distributions which is at the heart of mass transportation theory. Recent research has shown that the EMD plays a crucial role in studying the potential impact of…

Computation · Statistics 2013-10-15 Kyle Treleaven , Emilio Frazzoli

The ability to measure similarity between documents enables intelligent summarization and analysis of large corpora. Past distances between documents suffer from either an inability to incorporate semantic similarities between words or from…

Machine Learning · Computer Science 2019-11-05 Mikhail Yurochkin , Sebastian Claici , Edward Chien , Farzaneh Mirzazadeh , Justin Solomon

We propose a computationally light method for estimating similarities between text documents, which we call the density similarity (DS) method. The method is based on a word embedding in a high-dimensional Euclidean space and on kernel…

Computation and Language · Computer Science 2020-09-03 Ilia Rushkin

There is a great deal of work in cognitive psychology, linguistics, and computer science, about using word (or phrase) frequencies in context in text corpora to develop measures for word similarity or word association, going back to at…

Computation and Language · Computer Science 2009-05-26 Rudi L. Cilibrasi , Paul M. B. Vitanyi

Term weighting metrics assign weights to terms in order to discriminate the important terms from the less crucial ones. Due to this characteristic, these metrics have attracted growing attention in text classification and recently in…

Computation and Language · Computer Science 2016-10-12 Hussam Hamdan , Patrice Bellot , Frederic Bechet

Compositionality in language refers to how much the meaning of some phrase can be decomposed into the meaning of its constituents and the way these constituents are combined. Based on the premise that substitution by synonyms is…

Computation and Language · Computer Science 2017-03-13 Christina Lioma , Niels Dalum Hansen

Artificial Neural networks are mathematical models at their core. This truismpresents some fundamental difficulty when networks are tasked with Natural Language Processing. A key problem lies in measuring the similarity or distance among…

Computation and Language · Computer Science 2021-06-07 Thomas Conley , Jugal Kalita

We propose a new similarity measure between texts which, contrary to the current state-of-the-art approaches, takes a global view of the texts to be compared. We have implemented a tool to compute our textual distance and conducted…

Computation and Language · Computer Science 2014-05-15 Uli Fahrenberg , Fabrizio Biondi , Kevin Corre , Cyrille Jegourel , Simon Kongshøj , Axel Legay

We give an alternative proof of the formula for the minimum distance of a projective Reed-Muller code of an arbitrary order. It leads to a complete characterization of the minimum weight codewords of a projective Reed-Muller code. This is…

Information Theory · Computer Science 2023-09-29 Sudhir R. Ghorpade , Rati Ludhani

Collaborative filtering, a widely-used recommendation technique, predicts a user's preference by aggregating the ratings from similar users. As a result, these measures cannot fully utilize the rating information and are not suitable for…

Information Retrieval · Computer Science 2019-12-11 Yitong Meng , Xinyan Dai , Xiao Yan , James Cheng , Weiwen Liu , Benben Liao , Jun Guo , Guangyong Chen