English
Related papers

Related papers: Efficient Sketching Algorithm for Sparse Binary Da…

200 papers

Dynamic connectivity is a fundamental dynamic graph problem, and recent algorithmic breakthroughs on dynamic graph sketching have reshaped what is theoretically possible: by encoding the graph as per-vertex linear sketches, these algorithms…

Data Structures and Algorithms · Computer Science 2026-05-15 Quinten De Man , Gilvir Gill , Michael A. Bender , Laxman Dhulipala , David Tench

This paper describes a suite of algorithms for constructing low-rank approximations of an input matrix from a random linear image of the matrix, called a sketch. These methods can preserve structural properties of the input matrix, such as…

Numerical Analysis · Computer Science 2018-01-03 Joel A. Tropp , Alp Yurtsever , Madeleine Udell , Volkan Cevher

We consider sketching algorithms which first compress data by multiplication with a random sketch matrix, and then apply the sketch to quickly solve an optimization problem, e.g., low-rank approximation and regression. In the learning-based…

Machine Learning · Computer Science 2024-04-12 Yi Li , Honghao Lin , Simin Liu , Ali Vakilian , David P. Woodruff

The blooming availability of traces for social, biological, and communication networks opens up unprecedented opportunities in analyzing diffusion processes in networks. However, the sheer sizes of the nowadays networks raise serious…

Data Structures and Algorithms · Computer Science 2017-09-13 Hung T. Nguyen , Tri P. Nguyen , NhatHai Phan , Thang N. Dinh

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

Free-hand sketch-based image retrieval (SBIR) is a specific cross-view retrieval task, in which queries are abstract and ambiguous sketches while the retrieval database is formed with natural images. Work in this area mainly focuses on…

Computer Vision and Pattern Recognition · Computer Science 2017-03-17 Li Liu , Fumin Shen , Yuming Shen , Xianglong Liu , Ling Shao

Document sketching using Jaccard similarity has been a workable effective technique in reducing near-duplicates in Web page and image search results, and has also proven useful in file system synchronization, compression and learning…

Data Structures and Algorithms · Computer Science 2014-10-17 Bernhard Haeupler , Mark Manasse , Kunal Talwar

A sketch is a probabilistic data structure used to record frequencies of items in a multi-set. Sketches are widely used in various fields, especially those that involve processing and storing data streams. In streaming applications with…

Data Structures and Algorithms · Computer Science 2017-02-08 Tong Yang , Lingtong Liu , Yibo Yan , Muhammad Shahzad , Yulong Shen , Xiaoming Li , Bin Cui , Gaogang Xie

We consider the problem of recovering an $n_1 \times n_2$ low-rank matrix with $k$-sparse singular vectors from a small number of linear measurements (sketch). We propose a sketching scheme and an algorithm that can recover the singular…

Information Theory · Computer Science 2024-07-02 Xiaoqi Liu , Ramji Venkataramanan

Constructing a similarity graph from a set $X$ of data points in $\mathbb{R}^d$ is the first step of many modern clustering algorithms. However, typical constructions of a similarity graph have high time complexity, and a quadratic space…

Data Structures and Algorithms · Computer Science 2023-10-24 Peter Macgregor , He Sun

This survey highlights the recent advances in algorithms for numerical linear algebra that have come from the technique of linear sketching, whereby given a matrix, one first compresses it to a much smaller matrix by multiplying it by a…

Data Structures and Algorithms · Computer Science 2015-02-11 David P. Woodruff

We propose a deep hashing framework for sketch retrieval that, for the first time, works on a multi-million scale human sketch dataset. Leveraging on this large dataset, we explore a few sketch-specific traits that were otherwise…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Peng Xu , Yongye Huang , Tongtong Yuan , Kaiyue Pang , Yi-Zhe Song , Tao Xiang , Timothy M. Hospedales , Zhanyu Ma , Jun Guo

Embedding image features into a binary Hamming space can improve both the speed and accuracy of large-scale query-by-example image retrieval systems. Supervised hashing aims to map the original features to compact binary codes in a manner…

Machine Learning · Computer Science 2016-11-17 Guosheng Lin , Chunhua Shen , Anton van den Hengel

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

Distance computation is one of the most fundamental primitives used in communication networks. The cost of effectively and accurately computing pairwise network distances can become prohibitive in large-scale networks such as the Internet…

Data Structures and Algorithms · Computer Science 2011-12-07 Atish Das Sarma , Michael Dinitz , Gopal Pandurangan

This paper focuses on the sparse subspace clustering problem, and develops an online algorithmic solution to cluster data points on-the-fly, without revisiting the whole dataset. The strategy involves an online solution of a sparse…

Optimization and Control · Mathematics 2024-07-16 Liam Madden , Stephen Becker , Emiliano Dall'Anese

Leveraging the kernel trick in both the input and output spaces, surrogate kernel methods are a flexible and theoretically grounded solution to structured output prediction. If they provide state-of-the-art performance on complex data sets…

Machine Learning · Statistics 2024-05-07 Tamim El Ahmad , Luc Brogat-Motte , Pierre Laforgue , Florence d'Alché-Buc

Recent studies show that large-scale sketch-based image retrieval (SBIR) can be efficiently tackled by cross-modal binary representation learning methods, where Hamming distance matching significantly speeds up the process of similarity…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 Yuming Shen , Li Liu , Fumin Shen , Ling Shao

Associative memories are data structures addressed using part of the content rather than an index. They offer good fault reliability and biological plausibility. Among different families of associative memories, sparse ones are known to…

Neural and Evolutionary Computing · Computer Science 2013-08-22 Ala Aboudib , Vincent Gripon , Xiaoran Jiang

Recent work has explored transforming data sets into smaller, approximate summaries in order to scale Bayesian inference. We examine a related problem in which the parameters of a Bayesian model are very large and expensive to store in…

Machine Learning · Computer Science 2018-10-03 Joseph Tassarotti , Jean-Baptiste Tristan , Michael Wick