English
Related papers

Related papers: One-Pass, One-Hash n-Gram Statistics Estimation

200 papers

We propose two one-pass streaming algorithms for the $\mathcal{NP}$-hard hypergraph matching problem. The first algorithm stores a small subset of potential matching edges in a stack using dual variables to select edges. It has an…

Data Structures and Algorithms · Computer Science 2025-07-09 Henrik Reinstädtler , S M Ferdous , Alex Pothen , Bora Uçar , Christian Schulz

Embedding image features into a binary Hamming space can improve both the speed and accuracy of large-scale query-by-example image retrieval systems. Supervised hashing aims to map the original features to compact binary codes in a manner…

Machine Learning · Computer Science 2016-11-17 Guosheng Lin , Chunhua Shen , Anton van den Hengel

The definition of $1$-planar graphs naturally extends graph planarity, namely a graph is $1$-planar if it can be drawn in the plane with at most one crossing per edge. Unfortunately, while testing graph planarity is solvable in linear time,…

Computational Geometry · Computer Science 2019-11-05 Carla Binucci , Walter Didimo , Fabrizio Montecchiani

Identifying independence between two random variables or correlated given their samples has been a fundamental problem in Statistics. However, how to do so in a space-efficient way if the number of states is large is not quite well-studied.…

Data Structures and Algorithms · Computer Science 2022-11-21 Zhenhao Gu , Hao Zhang

Feature hashing, also known as {\em the hashing trick}, introduced by Weinberger et al. (2009), is one of the key techniques used in scaling-up machine learning algorithms. Loosely speaking, feature hashing uses a random sparse projection…

Machine Learning · Computer Science 2018-05-23 Casper Benjamin Freksen , Lior Kamma , Kasper Green Larsen

Real-world graphs often manifest as a massive temporal stream of edges. The need for real-time analysis of such large graph streams has led to progress on low memory, one-pass streaming graph algorithms. These algorithms were designed for…

Data Structures and Algorithms · Computer Science 2014-10-16 Madhav Jha , C. Seshadhri , Ali Pinar

In data stream applications, one of the critical issues is to estimate the frequency of each item in the specific multiset. The multiset means that each item in this set can appear multiple times. The data streams in many applications are…

Data Structures and Algorithms · Computer Science 2020-01-07 Ning Li

Cosmological $N$-body simulations play a vital role in studying models for the evolution of the Universe. To compare to observations and make a scientific inference, statistic analysis on large simulation datasets, e.g., finding halos,…

Instrumentation and Methods for Astrophysics · Physics 2018-05-07 Nikita Ivkin , Zaoxing Liu , Lin F. Yang , Srinivas Suresh Kumar , Gerard Lemson , Mark Neyrinck , Alexander S. Szalay , Vladimir Braverman , Tamas Budavari

We propose data-driven one-pass streaming algorithms for estimating the number of triangles and four cycles, two fundamental problems in graph analytics that are widely studied in the graph data stream literature. Recently, (Hsu 2018) and…

Data Structures and Algorithms · Computer Science 2022-03-21 Justin Y. Chen , Talya Eden , Piotr Indyk , Honghao Lin , Shyam Narayanan , Ronitt Rubinfeld , Sandeep Silwal , Tal Wagner , David P. Woodruff , Michael Zhang

We present a novel approach for the problem of frequency estimation in data streams that is based on optimization and machine learning. Contrary to state-of-the-art streaming frequency estimation algorithms, which heavily rely on random…

Data Structures and Algorithms · Computer Science 2022-07-19 Dimitris Bertsimas , Vassilis Digalakis

Two-sample hypothesis testing for network comparison presents many significant challenges, including: leveraging repeated network observations and known node registration, but without requiring them to operate; relaxing strong structural…

Methodology · Statistics 2024-02-05 Meijia Shao , Dong Xia , Yuan Zhang , Qiong Wu , Shuo Chen

Efficient sampling from a classical Gibbs distribution is an important computational problem with applications ranging from statistical physics over Monte Carlo and optimization algorithms to machine learning. We introduce a family of…

Quantum Physics · Physics 2021-09-08 Dominik S. Wild , Dries Sels , Hannes Pichler , Cristian Zanoci , Mikhail D. Lukin

Probabilistic inferences distill knowledge from graphs to aid human make important decisions. Due to the inherent uncertainty in the model and the complexity of the knowledge, it is desirable to help the end-users understand the inference…

Social and Information Networks · Computer Science 2019-08-21 Chao Chen , Yifei Liu , Xi Zhang , Sihong Xie

With the explosion of the size of digital dataset, the limiting factor for decomposition algorithms is the \emph{number of passes} over the input, as the input is often stored out-of-core or even off-site. Moreover, we're only interested in…

Numerical Analysis · Computer Science 2016-08-14 Radim Řeh{ů}řek

Graphlets are induced subgraphs of a large network and are important for understanding and modeling complex networks. Despite their practical importance, graphlets have been severely limited to applications and domains with relatively small…

Social and Information Networks · Computer Science 2017-03-01 Ryan A. Rossi , Rong Zhou , Nesreen K. Ahmed

Counting the frequency of small subgraphs is a fundamental technique in network analysis across various domains, most notably in bioinformatics and social networks. The special case of triangle counting has received much attention. Getting…

Data Structures and Algorithms · Computer Science 2014-11-19 Madhav Jha , C. Seshadhri , Ali Pinar

$n$-gram profiles have been successfully and widely used to analyse long sequences of potentially differing lengths for clustering or classification. Mainly, machine learning algorithms have been used for this purpose but, despite their…

Methodology · Statistics 2024-09-04 José A. Perusquía , Jim E. Griffin , Cristiano Villa

Motivated by the trend to outsource work to commercial cloud computing services, we consider a variation of the streaming paradigm where a streaming algorithm can be assisted by a powerful helper that can provide annotations to the data…

Data Structures and Algorithms · Computer Science 2015-03-14 Graham Cormode , Michael Mitzenmacher , Justin Thaler

Graph data are ubiquitous in natural sciences and machine learning. In this paper, we consider the problem of quantizing graph structured, bandlimited data to few bits per entry while preserving its information under low-pass filtering. We…

Information Theory · Computer Science 2026-05-08 Johannes Maly , Anna Veselovska

Graph data is ubiquitous in academia and industry, from social networks to bioinformatics. The pervasiveness of graphs today has raised the demand for algorithms that can answer various questions: Which products would a user like to…

Machine Learning · Computer Science 2020-12-01 Minji Yoon , Théophile Gervet , Bryan Hooi , Christos Faloutsos