English
Related papers

Related papers: Scalable and robust set similarity join

200 papers

Rank similarity measures provide a method for quantifying differences between search engine results without the need for relevance judgments. For example, the providers of a search service might use such measures to estimate the impact of a…

Information Retrieval · Computer Science 2014-08-18 Luchen Tan , Clarke L. A. Clarke

Graph similarity search algorithms usually leverage the structural properties of a database. Hence, these algorithms are effective only on some structural variations of the data and are ineffective on other forms, which makes them hard to…

Databases · Computer Science 2021-04-01 Yodsawalai Chodpathumwan , Arash Termehchy , Stephen A. Ramsey , Aayam Shresta , Amy Glen , Zheng Liu

The task of identifying synonymous relations and objects, or synonym resolution, is critical for high-quality information extraction. This paper investigates synonym resolution in the context of unsupervised information extraction, where…

Computation and Language · Computer Science 2014-01-23 Alexander Pieter Yates , Oren Etzioni

Large-scale approximate nearest neighbor search (ANN) has been gaining attention along with the latest machine learning researches employing ANNs. If the data is too large to fit in memory, it is necessary to search for the most similar…

Machine Learning · Computer Science 2025-01-29 Taiga Ikeda , Daisuke Miyashita , Jun Deguchi

Joint peak detection is a central problem when comparing samples in genomic data analysis, but current algorithms for this task are unsupervised and limited to at most 2 sample types. We propose PeakSegJoint, a new constrained maximum…

Machine Learning · Statistics 2015-06-04 Toby Dylan Hocking , Guillaume Bourque

To get estimators that work within a certain error bound with high probability, a common strategy is to design one that works with constant probability, and then boost the probability using independent repetitions. Important examples of…

Data Structures and Algorithms · Computer Science 2020-04-03 Anders Aamand , Debarati Das , Evangelos Kipouridis , Jakob B. T. Knudsen , Peter M. R. Rasmussen , Mikkel Thorup

Modern retrieval systems are often driven by an underlying machine learning model. The goal of such systems is to identify and possibly rank the few most relevant items for a given query or context. Thus, such systems are typically…

Machine Learning · Statistics 2017-03-02 Elad ET. Eban , Mariano Schain , Alan Mackey , Ariel Gordon , Rif A. Saurous , Gal Elidan

Synthesizing relational data has started to receive more attention from researchers, practitioners, and industry. The task is more difficult than synthesizing a single table due to the added complexity of relationships between tables. For…

Databases · Computer Science 2024-10-07 Valter Hudovernik , Martin Jurkovič , Erik Štrumbelj

Hierarchical clustering is a stronger extension of one of today's most influential unsupervised learning methods: clustering. The goal of this method is to create a hierarchy of clusters, thus constructing cluster evolutionary history and…

Data Structures and Algorithms · Computer Science 2021-01-14 MohammadTaghi Hajiaghayi , Marina Knittel

Determining if two sets are related - that is, if they have similar values or if one set contains the other - is an important problem with many applications in data cleaning, data integration, and information retrieval. A particularly…

Databases · Computer Science 2017-12-19 Dong Deng , Albert Kim , Samuel Madden , Michael Stonebraker

Similarity search approaches based on graph walks have recently attained outstanding speed-accuracy trade-offs, taking aside the memory requirements. In this paper, we revisit these approaches by considering, additionally, the memory…

Computer Vision and Pattern Recognition · Computer Science 2018-06-07 Matthijs Douze , Alexandre Sablayrolles , Hervé Jégou

Metric based comparison operations such as finding maximum, nearest and farthest neighbor are fundamental to studying various clustering techniques such as $k$-center clustering and agglomerative hierarchical clustering. These techniques…

Data Structures and Algorithms · Computer Science 2021-05-13 Raghavendra Addanki , Sainyam Galhotra , Barna Saha

Selecting appropriate distributed join methods for logical join operations in a query plan is crucial for the performance of data-intensive scalable computing (DISC). Different network communication patterns in the data exchange phase…

Databases · Computer Science 2023-12-29 F. Liang , F. C. M. Lau , H. Cui , Y. Li , B. Lin , C. Li , X. Hu

Optimization of machine learning models is commonly performed through stochastic gradient updates on randomly ordered training examples. This practice means that sub-epochs comprise of independent random samples of the training data that…

Machine Learning · Computer Science 2019-06-20 Eliav Buchnik , Edith Cohen , Avinatan Hassidim , Yossi Matias

We describe a seriation algorithm for ranking a set of items given pairwise comparisons between these items. Intuitively, the algorithm assigns similar rankings to items that compare similarly with all others. It does so by constructing a…

Machine Learning · Computer Science 2016-03-11 Fajwel Fogel , Alexandre d'Aspremont , Milan Vojnovic

Schema Matching is a method of finding attributes that are either similar to each other linguistically or represent the same information. In this project, we take a hybrid approach at solving this problem by making use of both the provided…

Databases · Computer Science 2020-04-22 Tanvi Sahay , Ankita Mehta , Shruti Jadon

Zero-shot relation extraction aims to identify relations between entity mentions using textual descriptions of novel types (i.e., previously unseen) instead of labeled training examples. Previous works often rely on unrealistic assumptions:…

Computation and Language · Computer Science 2026-03-05 Hugo Thomas , Caio Corro , Guillaume Gravier , Pascale Sébillot

We propose a novel and efficient algorithm for the collaborative preference completion problem, which involves jointly estimating individualized rankings for a set of entities over a shared set of items, based on a limited number of…

Machine Learning · Statistics 2016-11-16 Suriya Gunasekar , Oluwasanmi Koyejo , Joydeep Ghosh

Statistical matching is an effective method for estimating causal effects in which treated units are paired with control units with ``similar'' values of confounding covariates prior to performing estimation. In this way, matching helps…

Methodology · Statistics 2023-09-13 Sanjeewani Weerasingha , Michael J. Higgins

Over the past a few years, research and development has made significant progresses on big data analytics. A fundamental issue for big data analytics is the efficiency. If the optimal solution is unable to attain or not required or has a…

Databases · Computer Science 2019-01-03 Shuai Ma , Jinpeng Huai