English
Related papers

Related papers: Sub-linear Memory Sketches for Near Neighbor Searc…

200 papers

The $k$-Minimum Values (\kmv) data sketch algorithm stores the $k$ least hash keys generated by hashing the items in a dataset. We show that compression based on ordering the keys and encoding successive differences can offer $O(\log n)$…

Data Structures and Algorithms · Computer Science 2024-09-05 Charlie Dickens , Eric Bax , Alexander Saydakov

Many real-world matrix datasets arrive as high-throughput vector streams, making it impractical to store or process them in their entirety. To enable real-time analytics under limited computational, memory, and communication resources,…

Databases · Computer Science 2026-01-12 Hanyan Yin , Dongxie Wen , Jiajun Li , Zhewei Wei , Xiao Zhang , Peng Zhao , Zhi-Hua Zhou

Nearest neighbor search is a problem of finding the data points from the database such that the distances from them to the query point are the smallest. Learning to hash is one of the major solutions to this problem and has been widely…

Computer Vision and Pattern Recognition · Computer Science 2017-04-25 Jingdong Wang , Ting Zhang , Jingkuan Song , Nicu Sebe , Heng Tao Shen

Despite the success of deep learning on representing images for particular object retrieval, recent studies show that the learned representations still lie on manifolds in a high dimensional space. This makes the Euclidean nearest neighbor…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Ahmet Iscen , Yannis Avrithis , Giorgos Tolias , Teddy Furon , Ondrej Chum

We adapt a well known streaming algorithm for approximating item frequencies to the matrix sketching setting. The algorithm receives the rows of a large matrix $A \in \R^{n \times m}$ one after the other in a streaming fashion. It maintains…

Data Structures and Algorithms · Computer Science 2012-07-12 Edo Liberty

Low-rank representation~(LRR) has been a significant method for segmenting data that are generated from a union of subspaces. It is, however, known that solving the LRR program is challenging in terms of time complexity and memory…

Machine Learning · Statistics 2017-10-24 Jie Shen , Ping Li , Huan Xu

Large-scale distributed training of neural networks is often limited by network bandwidth, wherein the communication time overwhelms the local computation time. Motivated by the success of sketching methods in sub-linear/streaming…

Machine Learning · Computer Science 2020-01-24 Nikita Ivkin , Daniel Rothchild , Enayat Ullah , Vladimir Braverman , Ion Stoica , Raman Arora

We propose OverSketch, an approximate algorithm for distributed matrix multiplication in serverless computing. OverSketch leverages ideas from matrix sketching and high-performance computing to enable cost-efficient multiplication that is…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-02-25 Vipul Gupta , Shusen Wang , Thomas Courtade , Kannan Ramchandran

In this paper, we introduce a new model for sublinear algorithms called \emph{dynamic sketching}. In this model, the underlying data is partitioned into a large \emph{static} part and a small \emph{dynamic} part and the goal is to compute a…

Data Structures and Algorithms · Computer Science 2015-10-13 Sepehr Assadi , Sanjeev Khanna , Yang Li , Val Tannen

In this work we provide a new technique to design fast approximation algorithms for graph problems where the points of the graph lie in a metric space. Specifically, we present a sampling approach for such metric graphs that, using a…

Data Structures and Algorithms · Computer Science 2018-07-26 Hossein Esfandiari , Michael Mitzenmacher

Structure encoding has proven to be the key feature to distinguishing links in a graph. However, Structure encoding in the temporal graph keeps changing as the graph evolves, repeatedly computing such features can be time-consuming due to…

Machine Learning · Computer Science 2024-07-31 Ke Cheng , Linzhi Peng , Junchen Ye , Leilei Sun , Bowen Du

In this paper, we consider the problems from the area of sublinear-time algorithms of edge sampling, edge counting, and triangle counting. Part of our contribution is that we consider three different settings, differing in the way in which…

Data Structures and Algorithms · Computer Science 2022-04-13 Jakub Tětek , Mikkel Thorup

Sketching is a stochastic dimension reduction method that preserves geometric structures of data and has applications in high-dimensional regression, low rank approximation and graph sparsification. In this work, we show that sketching can…

Machine Learning · Statistics 2021-09-17 Zhishen Huang , Stephen Becker

Coverage problems are central in optimization and have a wide range of applications in data mining and machine learning. While several distributed algorithms have been developed for coverage problems, the existing methods suffer from…

Data Structures and Algorithms · Computer Science 2017-03-13 MohammadHossein Bateni , Hossein Esfandiari , Vahab Mirrokni

In online convex optimization (OCO), a decision-maker is confronted with an unknown environment and seeks to play an optimal sequence of decisions on a short time-scale using only past information. Recent advances in second-order OCO…

Optimization and Control · Mathematics 2026-05-28 Jean-Luc Lupien , Yuen-Man Pun , Youssef Diouane , Iman Shames , Antoine Lesage-Landry

Proximity graph-based methods have emerged as a leading paradigm for approximate nearest neighbor (ANN) search in the system community. This paper presents fresh insights into the theoretical foundation of these methods. We describe an…

Data Structures and Algorithms · Computer Science 2025-09-10 Shangqi Lu , Yufei Tao

Nearest-neighbor search, which returns the nearest neighbor of a query point in a set of points, is an important and widely studied problem in many fields, and it has wide range of applications. In many of them, such as sensor databases,…

Computational Geometry · Computer Science 2016-06-02 Pankaj K. Agarwal , Boris Aronov , Sariel Har-Peled , Jeff M. Philips , Ke Yi , Wuzhou Zhang

In this paper, we propose a novel framework that converts streaming algorithms for monotone submodular maximization into streaming algorithms for non-monotone submodular maximization. This reduction readily leads to the currently tightest…

Data Structures and Algorithms · Computer Science 2020-02-11 Ran Haba , Ehsan Kazemi , Moran Feldman , Amin Karbasi

In this paper, we study the problem of finding a maximum matching in the semi-streaming model when edges arrive in a random order. In the semi-streaming model, an algorithm receives a stream of edges and it is allowed to have a memory of…

Data Structures and Algorithms · Computer Science 2019-12-24 Alireza Farhadi , MohammadTaghi Hajiaghayi , Tung Mai , Anup Rao , Ryan A. Rossi

Count-sketch is a popular matrix sketching algorithm that can produce a sketch of an input data matrix X in O(nnz(X))time where nnz(X) denotes the number of non-zero entries in X. The sketched matrix will be much smaller than X while…

Machine Learning · Computer Science 2020-11-30 Yuhan Wang , Zijian Lei , Liang Lan