English
Related papers

Related papers: OverSketch: Approximate Matrix Multiplication for …

200 papers

Data sketches are approximate succinct summaries of long streams. They are widely used for processing massive amounts of data and answering statistical queries about it in real-time. Existing libraries producing sketches are very fast, but…

Data Structures and Algorithms · Computer Science 2019-12-06 Arik Rinberg , Alexander Spiegelman , Edward Bortnikov , Eshcar Hillel , Idit Keidar , Lee Rhodes , Hadar Serviansky

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

Count-Min Sketch is a widely adopted algorithm for approximate event counting in large scale processing. However, the original version of the Count-Min-Sketch (CMS) suffers of some deficiences, especially if one is interested by the…

Information Retrieval · Computer Science 2015-02-18 Guillaume Pitel , Geoffroy Fouquier

Data structures that allow efficient distance estimation (distance oracles, distance sketches, etc.) have been extensively studied, and are particularly well studied in centralized models and classical distributed models such as CONGEST. We…

Data Structures and Algorithms · Computer Science 2019-09-13 Michael Dinitz , Yasamin Nazari

In this paper, we introduce a new heuristics for global optimization in scenarios where extensive evaluations of the cost function are expensive, inaccessible, or even prohibitive. The method, which we call Landscape-Sketch-and-Step (LSS),…

Machine Learning · Computer Science 2023-10-06 Rafael Monteiro , Kartik Sau

Kernel methods are learning algorithms that enjoy solid theoretical foundations while suffering from important computational limitations. Sketching, which consists in looking for solutions among a subspace of reduced dimension, is a well…

Machine Learning · Statistics 2023-11-07 Tamim El Ahmad , Pierre Laforgue , Florence d'Alché-Buc

Network monitoring is vital in modern clouds and data center networks for traffic engineering, network diagnosis, network intrusion detection, which need diverse traffic statistics ranging from flow size distributions to heavy hitters. To…

Networking and Internet Architecture · Computer Science 2019-05-09 Yongquan Fu , Dongsheng Li , Siqi Shen , Yiming Zhang , Kai Chen

We present the first sublinear memory sketch that can be queried to find the nearest neighbors in a dataset. Our online sketching algorithm compresses an N element dataset to a sketch of size $O(N^b \log^3 N)$ in $O(N^{(b+1)} \log^3 N)$…

Data Structures and Algorithms · Computer Science 2020-09-15 Benjamin Coleman , Richard G. Baraniuk , Anshumali Shrivastava

Recent years have seen a huge development in spatial modelling and prediction methodology, driven by the increased availability of remote-sensing data and the reduced cost of distributed-processing technology. It is well known that…

Computation · Statistics 2020-02-18 Andrew Zammit-Mangion , Jonathan Rougier

Anomaly detection in dynamic graphs is essential for identifying malicious activities, fraud, and unexpected behaviors in real-world systems such as cybersecurity and power grids. However, existing approaches struggle with scalability,…

Machine Learning · Computer Science 2025-09-16 Ocheme Anthony Ekle , William Eberle

Edge computing is emerging as a new paradigm to allow processing data at the edge of the network, where data is typically generated and collected, by exploiting multiple devices at the edge collectively. However, exploiting the potential of…

Information Theory · Computer Science 2021-06-17 Elahe Vedadi , Hulya Seferoglu

Given a collection of $m$ sets from a universe $\mathcal{U}$, the Maximum Set Coverage problem consists of finding $k$ sets whose union has largest cardinality. This problem is NP-Hard, but the solution can be approximated by a polynomial…

Data Structures and Algorithms · Computer Science 2023-12-13 Stephen Jaud , Anthony Wirth , Farhana Choudhury

Linear regression is a fundamental and primitive problem in supervised machine learning, with applications ranging from epidemiology to finance. In this work, we propose methods for speeding up distributed linear regression. We do so by…

Information Theory · Computer Science 2024-04-02 Neophytos Charalambides , Hessam Mahdavifar , Mert Pilanci , Alfred O. Hero

Sketched gradient algorithms have been recently introduced for efficiently solving the large-scale constrained Least-squares regressions. In this paper we provide novel convergence analysis for the basic method {\it Gradient Projection…

Optimization and Control · Mathematics 2017-06-05 Junqi Tang , Mohammad Golbabaee , Mike Davies

Sketch-and-extrude is a common and intuitive modeling process in computer aided design. This paper studies the problem of learning the shape given in the form of point clouds by inverse sketch-and-extrude. We present ExtrudeNet, an…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Daxuan Ren , Jianmin Zheng , Jianfei Cai , Jiatong Li , Junzhe Zhang

Deploying neural networks on edge devices entails a careful balance between the energy required for inference and the accuracy of the resulting classification. One technique for navigating this tradeoff is approximate computing: the process…

Machine Learning · Computer Science 2025-09-18 Morteza Rezaalipour , Francesco Costa , Marco Biasion , Rodrigo Otoni , George A. Constantinides , Laura Pozzi

We present a matrix factorization algorithm that scales to input matrices that are large in both dimensions (i.e., that contains morethan 1TB of data). The algorithm streams the matrix columns while subsampling them, resulting in low…

Optimization and Control · Mathematics 2016-12-04 Arthur Mensch , Julien Mairal , Gaël Varoquaux , Bertrand Thirion

In this work we propose a new paradigm for designing efficient deep unrolling networks using operator sketching. The deep unrolling networks are currently the state-of-the-art solutions for imaging inverse problems. However, for…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Junqi Tang , Subhadip Mukherjee , Carola-Bibiane Schönlieb

Estimating cardinality, i.e., the number of distinct elements, of a data stream is a fundamental problem in areas like databases, computer networks, and information retrieval. This study delves into a broader scenario where each element…

Databases · Computer Science 2024-06-28 Yiyan Qi , Rundong Li , Pinghui Wang , Yufang Sun , Rui Xing

As massive graphs become more prevalent, there is a rapidly growing need for scalable algorithms that solve classical graph problems, such as maximum matching and minimum vertex cover, on large datasets. For massive inputs, several…

Data Structures and Algorithms · Computer Science 2018-12-31 Sepehr Assadi , MohammadHossein Bateni , Aaron Bernstein , Vahab Mirrokni , Cliff Stein