English
Related papers

Related papers: An LSH Index for Computing Kendall's Tau over Top-…

200 papers

The rank-based association between two variables can be modeled by introducing a latent normal level to ordinal data. We demonstrate how this approach yields Bayesian inference for Kendall's rank correlation coefficient, improving on a…

Methodology · Statistics 2018-05-25 Johnny van Doorn , Alexander Ly , Maarten Marsman , Eric-Jan Wagenmakers

Nearest neighbor search (NNS) has a wide range of applications in information retrieval, computer vision, machine learning, databases, and other areas. Existing state-of-the-art algorithm for nearest neighbor search, Hierarchical Navigable…

Information Retrieval · Computer Science 2020-10-20 Ishita Doshi , Dhritiman Das , Ashish Bhutani , Rajeev Kumar , Rushi Bhatt , Niranjan Balasubramanian

The problem of finding \emph{distance} between \emph{pattern} of length $m$ and \emph{text} of length $n$ is a typical way of generalizing pattern matching to incorporate dissimilarity score. For both Hamming and $L_1$ distances only a…

Data Structures and Algorithms · Computer Science 2018-05-04 Przemysław Uznański

We consider data in the form of pairwise comparisons of n items, with the goal of precisely identifying the top k items for some value of k < n, or alternatively, recovering a ranking of all the items. We analyze the Copeland counting…

Machine Learning · Computer Science 2016-04-28 Nihar B. Shah , Martin J. Wainwright

With the urbanization and development of infrastructure, the community search over road networks has become increasingly important in many real applications such as urban/city planning, social study on local communities, and community…

Databases · Computer Science 2022-04-29 Niranjan Rai , Xiang Lian

Similarity caching allows requests for an item to be served by a similar item. Applications include recommendation systems, multimedia retrieval, and machine learning. Recently, many similarity caching policies have been proposed, like…

Networking and Internet Architecture · Computer Science 2023-09-22 Younes Ben Mazziane , Sara Alouf , Giovanni Neglia , Daniel S. Menasche

Neuroscientists have recently shown that images that are difficult to find in visual search elicit similar patterns of firing across a population of recorded neurons. The $L^{1}$ distance between firing rate vectors associated with two…

Information Theory · Computer Science 2015-05-12 Nidhin Koshy Vaidhiyan , S. P. Arun , Rajesh Sundaresan

The ability of fast similarity search at large scale is of great importance to many Information Retrieval (IR) applications. A promising way to accelerate similarity search is semantic hashing which designs compact binary codes for a large…

Information Retrieval · Computer Science 2010-04-30 Dell Zhang , Jun Wang , Deng Cai , Jinsong Lu

Spatial data fusion is a bottleneck when it meets the scale of 10 billion records. Cross-matching celestial catalogs is just one example of this. To challenge this, we present a framework that enables efficient cross-matching using Learned…

Instrumentation and Methods for Astrophysics · Physics 2025-04-16 Phu-Minh Lam , Dongwei Fan , Hongbo Wei , Jun Wang , Yu Zhou , Qi Ma , Baolong Zhang , Xiazhao Zhang , Yongheng Wang

Kernel methods have produced state-of-the-art results for a number of NLP tasks such as relation extraction, but suffer from poor scalability due to the high cost of computing kernel similarities between natural language structures. A…

Computation and Language · Computer Science 2019-05-22 Sahil Garg , Aram Galstyan , Greg Ver Steeg , Irina Rish , Guillermo Cecchi , Shuyang Gao

High-dimensional data models, often with low sample size, abound in many interdisciplinary studies, genomics and large biological systems being most noteworthy. The conventional assumption of multinormality or linearity of regression may…

Statistics Theory · Mathematics 2008-12-18 Pranab K. Sen

We present a powerful new loss function and training scheme for learning binary hash codes with any differentiable model and similarity function. Our loss function improves over prior methods by using log likelihood loss on top of an…

Machine Learning · Computer Science 2018-10-03 Martin Loncaric , Bowei Liu , Ryan Weber

Locality-sensitive hashing (LSH) is a well-known solution for approximate nearest neighbor (ANN) search in high-dimensional spaces due to its robust theoretical guarantee on query accuracy. Traditional LSH-based methods mainly focus on…

Databases · Computer Science 2026-02-11 Jiuqi Wei , Botao Peng , Xiaodong Lee , Themis Palpanas

In a standard cluster analysis, such as k-means, in addition to clusters locations and distances between them, it's important to know if they are connected or well separated from each other. The main focus of this paper is discovering the…

Machine Learning · Statistics 2017-05-22 Evgeny Bauman , Konstantin Bauman

We examine the integrated squared difference, also known as the L2 distance (L2D), between two probability densities. Such a distance metric allows for comparison of differences between pairs of distributions or changes in a distribution…

Methodology · Statistics 2019-06-03 George Shan , Mark J. van der Laan

We present NearBucket-LSH, an effective algorithm for similarity search in large-scale distributed online social networks organized as peer-to-peer overlays. As communication is a dominant consideration in distributed systems, we focus on…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-11-24 Naama Kraus , David Carmel , Idit Keidar , Meni Orenbach

Tabu search is one of the most effective heuristics for locating high-quality solutions to a diverse array of NP-hard combinatorial optimization problems. Despite the widespread success of tabu search, researchers have a poor understanding…

Artificial Intelligence · Computer Science 2011-09-13 A. E. Howe , J. P. Watson , L. D. Whitley

The problem of filtering information from large correlation matrices is of great importance in many applications. We have recently proposed the use of the Kullback-Leibler distance to measure the performance of filtering algorithms in…

Data Analysis, Statistics and Probability · Physics 2008-12-02 M. Tumminello , F. Lillo , R. N. Mantegna

Fast item ranking is an important task in recommender systems. In previous works, graph-based Approximate Nearest Neighbor (ANN) approaches have demonstrated good performance on item ranking tasks with generic searching/matching measures…

Information Retrieval · Computer Science 2022-11-02 Khoa Doan , Shulong Tan , Weijie Zhao , Ping Li

One important tool is the optimal clustering of data into useful categories. Dividing similar objects into a smaller number of clusters is of importance in many applications. These include search engines, monitoring of academic performance,…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-09-21 Gavriel Yarmish , Philip Listowsky , Simon Dexter