English
Related papers

Related papers: An LSH Index for Computing Kendall's Tau over Top-…

200 papers

Nearest neighbor search is a problem of finding the data points from the database such that the distances from them to the query point are the smallest. Learning to hash is one of the major solutions to this problem and has been widely…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Jingdong Wang , Ting Zhang , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Hashing, or learning binary embeddings of data, is frequently used in nearest neighbor retrieval. In this paper, we develop learning to rank formulations for hashing, aimed at directly optimizing ranking-based evaluation metrics such as…

Machine Learning · Statistics 2018-10-11 Kun He , Fatih Cakir , Sarah Adel Bargal , Stan Sclaroff

Detecting structural similarity between queries is essential for selecting examples in in-context learning models. However, assessing structural similarity based solely on the natural language expressions of queries, without considering SQL…

Computation and Language · Computer Science 2024-03-26 Mohammadreza Pourreza , Davood Rafiei , Yuxi Feng , Raymond Li , Zhenan Fan , Weiwei Zhang

We consider the evaluation of approximate top-k queries from relations with a-priori unknown values. Such relations can arise for example in the context of expensive predicates, or cloud-based data sources. The task is to find an…

Databases · Computer Science 2010-08-31 Antti Ukkonen

Random hypothesis sampling lies at the core of many popular robust fitting techniques such as RANSAC. In this paper, we propose a novel hypothesis sampling scheme based on incremental computation of distances between partial rankings…

Computer Vision and Pattern Recognition · Computer Science 2011-06-02 Hoi Sim Wong , Tat-Jun Chin , Jin Yu , David Suter

We propose a new method for local distance metric learning based on sample similarity as side information. These local metrics, which utilize conical combinations of metric weight matrices, are learned from the pooled spatial…

Machine Learning · Computer Science 2019-02-25 YInjie Huang , Cong Li , Michael Georgiopoulos , Georgios C. Anagnostopoulos

Pairwise association measure is an important operation in data analytics. Kendall's tau coefficient is one widely used correlation coefficient identifying non-linear relationships between ordinal variables. In this paper, we investigated a…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-04-13 Yongchao Liu , Tony Pan , Oded Green , Srinivas Aluru

Approximate Nearest Neighbor Search (ANNS) is a fundamental problem in many areas of machine learning and data mining. During the past decade, numerous hashing algorithms are proposed to solve this problem. Every proposed algorithm claims…

Computer Vision and Pattern Recognition · Computer Science 2019-06-20 Deng Cai

Given a collection of objects and an associated similarity measure, the all-pairs similarity search problem asks us to find all pairs of objects with similarity greater than a certain user-specified threshold. Locality-sensitive hashing…

Databases · Computer Science 2012-03-29 Venu Satuluri , Srinivasan Parthasarathy

The explosive growth in big data has attracted much attention in designing efficient indexing and search methods recently. In many critical applications such as large-scale search and pattern matching, finding the nearest neighbors to a…

Machine Learning · Computer Science 2015-09-21 Jun Wang , Wei Liu , Sanjiv Kumar , Shih-Fu Chang

Estimating similarity between vertices is a fundamental issue in network analysis across various domains, such as social networks and biological networks. Methods based on common neighbors and structural contexts have received much…

Social and Information Networks · Computer Science 2015-04-14 Jing Zhang , Jie Tang , Cong Ma , Hanghang Tong , Yu Jing , Juanzi Li

The problem of finding K-nearest neighbors in the given dataset for a given query point has been worked upon since several years. In very high dimensional spaces the K-nearest neighbor search (KNNS) suffers in terms of complexity in…

Machine Learning · Computer Science 2021-02-15 Pramod Vadiraja , Christoph Peter Balada

We address the problem of computing distances between rankings that take into account similarities between candidates. The need for evaluating such distances is governed by applications as diverse as rank aggregation, bioinformatics, social…

Data Structures and Algorithms · Computer Science 2014-11-20 Farzad Farnoud , Lili Su , Gregory J. Puleo , Olgica Milenkovic

Nearest Neighbor Search (NNS) over generalized weighted distances is fundamental to a wide range of applications. The problem of NNS over the generalized weighted square Euclidean distance has been studied in previous work. However,…

Databases · Computer Science 2021-10-19 Huan Hu , Jianzhong Li

Locality-sensitive hashing (LSH), introduced by Indyk and Motwani in STOC '98, has been an extremely influential framework for nearest neighbor search in high-dimensional data sets. While theoretical work has focused on the approximate…

Data Structures and Algorithms · Computer Science 2018-12-07 Tobias Christiani , Rasmus Pagh , Mikkel Thorup

In 2019, Anderson et al. proposed the concept of rankability, which refers to a dataset's inherent ability to be meaningfully ranked. In this article, we give an expository review of the linear ordering problem (LOP) and then use it to…

Optimization and Control · Mathematics 2021-04-14 Thomas R. Cameron , Sebastian Charmot , Jonad Pulaj

Efficient k-nearest neighbor search is a fundamental task, foundational for many problems in NLP. When the similarity is measured by dot-product between dual-encoder vectors or $\ell_2$-distance, there already exist many scalable and…

Computation and Language · Computer Science 2022-10-25 Nishant Yadav , Nicholas Monath , Rico Angell , Manzil Zaheer , Andrew McCallum

We investigate the problem of finding reverse nearest neighbors efficiently. Although provably good solutions exist for this problem in low or fixed dimensions, to this date the methods proposed in high dimensions are mostly heuristic. We…

Computational Geometry · Computer Science 2010-11-24 David Arthur , Steve Y. Oudot

In this paper, we address the problem of searching for semantically similar images from a large database. We present a compact coding approach, supervised quantization. Our approach simultaneously learns feature selection that linearly…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Xiaojuan Wang , Ting Zhang , Guo-Jun Q , Jinhui Tang , Jingdong Wang

We show the existence of a Locality-Sensitive Hashing (LSH) family for the angular distance that yields an approximate Near Neighbor Search algorithm with the asymptotically optimal running time exponent. Unlike earlier algorithms with this…

Data Structures and Algorithms · Computer Science 2015-09-10 Alexandr Andoni , Piotr Indyk , Thijs Laarhoven , Ilya Razenshteyn , Ludwig Schmidt