中文
相关论文

相关论文: Fast Similarity Sketching

200 篇论文

The challenge of estimating similarity between sets has been a significant concern in data science, finding diverse applications across various domains. However, previous approaches, such as MinHash, have predominantly centered around…

数据结构与算法 · 计算机科学 2024-05-31 Fenghao Dong , Yang He , Yutong Liang , Zirui Liu , Yuhan Wu , Peiqing Chen , Tong Yang

Count-sketch is a popular matrix sketching algorithm that can produce a sketch of an input data matrix X in O(nnz(X))time where nnz(X) denotes the number of non-zero entries in X. The sketched matrix will be much smaller than X while…

机器学习 · 计算机科学 2020-11-30 Yuhan Wang , Zijian Lei , Liang Lan

In sketched clustering, a dataset of $T$ samples is first sketched down to a vector of modest size, from which the centroids are subsequently extracted. Advantages include i) reduced storage complexity and ii) centroid extraction complexity…

信息论 · 计算机科学 2019-05-21 Evan Byrne , Antoine Chatalic , Remi Gribonval , Philip Schniter

We consider sketch vectors of geometric objects $J$ through the \mindist function \[ v_i(J) = \inf_{p \in J} \|p-q_i\| \] for $q_i \in Q$ from a point set $Q$. Collecting the vector of these sketch values induces a simple, effective, and…

计算几何 · 计算机科学 2019-07-09 Jeff M. Phillips , Pingfan Tang

Sketching uses randomized Hash functions for dimensionality reduction and acceleration. The existing sketching methods, such as count sketch (CS), tensor sketch (TS), and higher-order count sketch (HCS), either suffer from low accuracy or…

机器学习 · 计算机科学 2021-06-25 Xingyu Cao , Jiani Liu

Sketching has emerged as a powerful technique for speeding up problems in numerical linear algebra, such as regression. In the overconstrained regression problem, one is given an $n \times d$ matrix $A$, with $n \gg d$, as well as an $n…

数据结构与算法 · 计算机科学 2017-05-31 Eric Price , Zhao Song , David P. Woodruff

The probability Jaccard similarity was recently proposed as a natural generalization of the Jaccard similarity to measure the proximity of sets whose elements are associated with relative frequencies or probabilities. In combination with a…

数据结构与算法 · 计算机科学 2020-10-27 Otmar Ertl

The Jaccard index is an important similarity measure for item sets and Boolean data. On large datasets, an exact similarity computation is often infeasible for all item pairs both due to time and space constraints, giving rise to faster…

数据结构与算法 · 计算机科学 2021-03-09 Marc Bury , Chris Schwiegelshohn , Mara Sorella

The immense amount of daily generated and communicated data presents unique challenges in their processing. Clustering, the grouping of data without the presence of ground-truth labels, is an important tool for drawing inferences from data.…

机器学习 · 统计学 2018-02-08 Panagiotis A. Traganitis , Georgios B. Giannakis

Proliferation of touch-based devices has made sketch-based image retrieval practical. While many methods exist for sketch-based object detection/image retrieval on small datasets, relatively less work has been done on large (web)-scale…

计算机视觉与模式识别 · 计算机科学 2015-11-03 Sarthak Parui , Anurag Mittal

Constructing a similarity graph from a set $X$ of data points in $\mathbb{R}^d$ is the first step of many modern clustering algorithms. However, typical constructions of a similarity graph have high time complexity, and a quadratic space…

数据结构与算法 · 计算机科学 2023-10-24 Peter Macgregor , He Sun

Approximate Nearest Neighbor (ANN) search and Approximate Kernel Density Estimation (A-KDE) are fundamental problems at the core of modern machine learning, with broad applications in data analysis, information systems, and large-scale…

机器学习 · 计算机科学 2025-10-28 Ved Danait , Srijan Das , Sujoy Bhore

Many data sources can be interpreted as time-series, and a key problem is to identify which pairs out of a large collection of signals are highly correlated. We expect that there will be few, large, interesting correlations, while most…

数据结构与算法 · 计算机科学 2017-10-06 Graham Cormode , Jacques Dark

We revisit the well-studied problem of approximating a matrix product, $\mathbf{A}^T\mathbf{B}$, based on small space sketches $\mathcal{S}(\mathbf{A})$ and $\mathcal{S}(\mathbf{B})$ of $\mathbf{A} \in \R^{n \times d}$ and $\mathbf{B}\in…

数据结构与算法 · 计算机科学 2025-01-30 Majid Daliri , Juliana Freire , Danrong Li , Christopher Musco

This paper presents a new algorithm for calculating hash signatures of sets which can be directly used for Jaccard similarity estimation. The new approach is an improvement over the MinHash algorithm, because it has a better runtime…

数据结构与算法 · 计算机科学 2017-06-20 Otmar Ertl

Similarity search (nearest neighbor search) is a problem of pursuing the data items whose distances to a query item are the smallest from a large database. Various methods have been developed to address this problem, and recently a lot of…

数据结构与算法 · 计算机科学 2014-08-14 Jingdong Wang , Heng Tao Shen , Jingkuan Song , Jianqiu Ji

We develop an algorithm for estimating the values of a vector x in R^n over a support S of size k from a randomized sparse binary linear sketch Ax of size O(k). Given Ax and S, we can recover x' with ||x' - x_S||_2 <= eps ||x - x_S||_2 with…

数据结构与算法 · 计算机科学 2010-11-22 Eric Price

Learning to hash is an efficient paradigm for exact and approximate nearest neighbor search from massive databases. Binary hash codes are typically extracted from an image by rounding output features from a CNN, which is trained on a…

机器学习 · 计算机科学 2020-05-12 Heikki Arponen , Tom E. Bishop

We propose a new fast word embedding technique using hash functions. The method is a derandomization of a new type of random projections: By disregarding the classic constraint used in designing random projections (i.e., preserving pairwise…

计算与语言 · 计算机科学 2018-08-31 Behrang QasemiZadeh , Laura Kallmeyer

Two important optimization problems in the analysis of geometric data sets are clustering and sketching. Here, clustering refers to the problem of partitioning some input metric measure space (mm-space) into k clusters, minimizing some…

计算几何 · 计算机科学 2018-10-19 Facundo Mémoli , Anastasios Sidiropoulos , Kritika Singhal