English
Related papers

Related papers: Sampling Sketches for Concave Sublinear Functions …

200 papers

Large-sample data became prevalent as data acquisition became cheaper and easier. While a large sample size has theoretical advantages for many statistical methods, it presents computational challenges. Sketching, or compression, is a…

Machine Learning · Statistics 2020-05-11 Alexander F. Lapanowski , Irina Gaynanova

We provide statistical learning guarantees for two unsupervised learning tasks in the context of compressive statistical learning, a general framework for resource-efficient large-scale learning that we introduced in a companion paper.The…

Machine Learning · Computer Science 2021-08-18 Rémi Gribonval , Gilles Blanchard , Nicolas Keriven , Yann Traonmilin

Document sketching using Jaccard similarity has been a workable effective technique in reducing near-duplicates in Web page and image search results, and has also proven useful in file system synchronization, compression and learning…

Data Structures and Algorithms · Computer Science 2014-10-17 Bernhard Haeupler , Mark Manasse , Kunal Talwar

As an alternative to the traditional sampling theory, compressed sensing allows acquiring much smaller amount of data, still estimating the spectra of frequency-sparse signals accurately. However, compressed sensing usually requires random…

Information Theory · Computer Science 2016-07-22 Shan Huang , Hong Sun , Haijian Zhang , Lei Yu

Learning properties of large graphs from samples has been an important problem in statistical network analysis since the early work of Goodman \cite{Goodman1949} and Frank \cite{Frank1978}. We revisit a problem formulated by Frank…

Statistics Theory · Mathematics 2019-06-18 Jason M. Klusowski , Yihong Wu

Graph signals arise in various applications, ranging from sensor networks to social media data. The high-dimensional nature of these signals implies that they often need to be compressed in order to be stored and transmitted. The common…

Signal Processing · Electrical Eng. & Systems 2021-10-26 Pei Li , Nir Shlezinger , Haiyang Zhang , Baoyun Wang , Yonina C. Eldar

Uniform sampling from graphical realizations of a given degree sequence is a fundamental component in simulation-based measurements of network observables, with applications ranging from epidemics, through social networks to Internet…

Physics and Society · Physics 2010-04-14 Charo I. Del Genio , Hyunju Kim , Zoltan Toroczkai , Kevin E. Bassler

We provide a novel statistical perspective on a classical problem at the intersection of computer science and information theory: recovering the empirical frequency of a symbol in a large discrete dataset using only a compressed…

Methodology · Statistics 2025-04-11 Mario Beraha , Stefano Favaro , Matteo Sesia

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

Many data sources are naturally modeled by multiple weight assignments over a set of keys: snapshots of an evolving database at multiple points in time, measurements collected over multiple time periods, requests for resources served at…

Databases · Computer Science 2010-11-11 Edith Cohen , Haim Kaplan , Subhabrata Sen

Retrieving cohesive subgraphs in networks is a fundamental problem in social network analysis and graph data management. These subgraphs can be used for marketing strategies or recommendation systems. Despite the introduction of numerous…

Social and Information Networks · Computer Science 2025-07-16 Dahee Kim , Song Kim , Jeongseon Kim , Junghoon Kim , Kaiyu Feng , Sungsu Lim , Jungeun Kim

Conservative Count-Min, an improved version of Count-Min sketch [Cormode, Muthukrishnan 2005], is an online-maintained hashing-based data structure summarizing element frequency information without storing elements themselves. Although…

Data Structures and Algorithms · Computer Science 2023-09-08 Éric Fusy , Gregory Kucherov

Small subgraphs (graphlets) are important features to describe fundamental units of a large network. The calculation of the subgraph frequency distributions has a wide application in multiple domains including biology and engineering.…

Machine Learning · Computer Science 2022-07-15 Zhongren Chen , Xinyue Xu , Shengyi Jiang , Hao Wang , Lu Mi

We study the complexity of sampling, rounding, and integrating arbitrary logconcave functions. Our new approach provides the first complexity improvements in nearly two decades for general logconcave functions for all three problems, and…

Data Structures and Algorithms · Computer Science 2024-11-21 Yunbum Kook , Santosh S. Vempala

Learning parameters from voluminous data can be prohibitive in terms of memory and computational requirements. We propose a "compressive learning" framework where we estimate model parameters from a sketch of the training data. This sketch…

Machine Learning · Computer Science 2017-05-08 Nicolas Keriven , Anthony Bourrier , Rémi Gribonval , Patrick Pérez

We consider the problem of imaging a crack network embedded in some homogeneous background from measured multi-static far field data generated by acoustic plane waves. We propose two novel approaches that can be seen as extensions of linear…

Analysis of PDEs · Mathematics 2020-06-19 Lorenzo Audibert , Lucas Chesnel , Houssem Haddar , Kevish Napal

Randomness extraction is an essential post-processing step in practical quantum cryptography systems. When statistical fluctuations are taken into consideration, the requirement of large input data size could heavily penalise the speed and…

Quantum Physics · Physics 2024-04-09 Hong Jie Ng , Wen Yu Kon , Ignatius William Primaatmaja , Chao Wang , Charles Lim

This article considers "compressive learning," an approach to large-scale machine learning where datasets are massively compressed before learning (e.g., clustering, classification, or regression) is performed. In particular, a "sketch" is…

Weighted sampling is a fundamental tool in data analysis and machine learning pipelines. Samples are used for efficient estimation of statistics or as sparse representations of the data. When weight distributions are skewed, as is often the…

Machine Learning · Computer Science 2020-08-18 Edith Cohen , Rasmus Pagh , David P. Woodruff

This article explores and analyzes the unsupervised clustering of large partially observed graphs. We propose a scalable and provable randomized framework for clustering graphs generated from the stochastic block model. The clustering is…

Social and Information Networks · Computer Science 2022-12-06 Mostafa Rahmani , Andre Beckus , Adel Karimian , George Atia