English
Related papers

Related papers: Identifying Correlation in Stream of Samples

200 papers

Identifying dependency between two random variables is a fundamental problem. The clear interpretability and ability of a procedure to provide information on the form of possible dependence is particularly important when exploring…

Methodology · Statistics 2026-04-27 Bogdan Ćmiel , Teresa Ledwina

Random subsampling of edges is a commonly employed technique in graph algorithms, underlying a vast array of modern algorithmic breakthroughs. Unfortunately, using this technique often leads to randomized algorithms with no clear path to…

Data Structures and Algorithms · Computer Science 2026-03-27 Aaron Putterman , Salil Vadhan , Vadim Zaripov

Based on a generalized cosine measure between two symmetric matrices, we propose a general framework for one-sample and two-sample tests of covariance and correlation matrices. We also develop a set of associated permutation algorithms for…

Methodology · Statistics 2018-12-05 Longyang Wu , Chengguo Weng , Xu Wang , Kesheng Wang , Xuefeng Liu

We propose a novel stochastic algorithm that randomly samples entire rows and columns of the matrix as a way to approximate an arbitrary matrix function using the power series expansion. This contrasts with existing Monte Carlo methods,…

Data Structures and Algorithms · Computer Science 2024-09-23 Nicolas L. Guidotti , Juan A. Acebrón , José Monteiro

The independence clustering problem is considered in the following formulation: given a set $S$ of random variables, it is required to find the finest partitioning $\{U_1,\dots,U_k\}$ of $S$ into clusters such that the clusters…

Machine Learning · Computer Science 2017-03-21 Daniil Ryabko

Identifying dependency in multivariate data is a common inference task that arises in numerous applications. However, existing nonparametric independence tests typically require computation that scales at least quadratically with the sample…

Methodology · Statistics 2021-07-08 Shai Gorsky , Li Ma

Statistical inferences for sample correlation matrices are important in high dimensional data analysis. Motivated by this, this paper establishes a new central limit theorem (CLT) for a linear spectral statistic (LSS) of high dimensional…

Statistics Theory · Mathematics 2014-11-04 Jiti Gao , Xiao Han , Guangming Pan , Yanrong Yang

We provide a fast distributed algorithm for detecting $h$-cycles in the \textsf{Congested Clique} model, whose running time decreases as the number of $h$-cycles in the graph increases. In undirected graphs, constant-round algorithms are…

Data Structures and Algorithms · Computer Science 2024-08-28 Keren Censor-Hillel , Tomer Even , Virginia Vassilevska Williams

The most efficient algorithms for finding maximum independent sets in both theory and practice use reduction rules to obtain a much smaller problem instance called a kernel. The kernel can then be solved quickly using exact or heuristic…

Data Structures and Algorithms · Computer Science 2019-09-11 Demian Hespe , Christian Schulz , Darren Strash

Log-linear models are a family of probability distributions which capture relationships between variables. They have been proven useful in a wide variety of fields such as epidemiology, economics and sociology. The interest in using these…

Machine Learning · Computer Science 2022-12-29 Jan Strappa , Facundo Bromberg

For a large Hermitian matrix $A\in \mathbb{C}^{N\times N}$, it is often the case that the only affordable operation is matrix-vector multiplication. In such case, randomized method is a powerful way to estimate the spectral density (or…

Numerical Analysis · Mathematics 2015-11-24 Lin Lin

Entropic independence is a structural property of measures that underlies modern proofs of functional inequalities, notably (modified) log-Sobolev inequalities, via ``annealing'' or local-to-global schemes. Existing sufficient criteria for…

Information Theory · Computer Science 2026-04-14 Vishesh Jain , Huy Tuan Pham , Thuy-Duong Vuong

In this paper, we are concerned with the independence test for $k$ high-dimensional sub-vectors of a normal vector, with fixed positive integer $k$. A natural high-dimensional extension of the classical sample correlation matrix, namely…

Statistics Theory · Mathematics 2014-10-21 Zhigang Bao , Jiang Hu , Guangming Pan , Wang Zhou

Clustering is a fundamental tool for analyzing large data sets. A rich body of work has been devoted to designing data-stream algorithms for the relevant optimization problems such as $k$-center, $k$-median, and $k$-means. Such algorithms…

Data Structures and Algorithms · Computer Science 2018-12-06 Kook Jin Ahn , Graham Cormode , Sudipto Guha , Andrew McGregor , Anthony Wirth

Analyzing array-based computations to determine data dependences is useful for many applications including automatic parallelization, race detection, computation and communication overlap, verification, and shape analysis. For sparse matrix…

We study the problem of estimating the number of triangles in a graph stream. No streaming algorithm can get sublinear space on all graphs, so methods in this area bound the space in terms of parameters of the input graph such as the…

Data Structures and Algorithms · Computer Science 2019-04-18 John Kallaugher , Eric Price

Matrix sketching is a recently developed data compression technique. An input matrix A is efficiently approximated with a smaller matrix B, so that B preserves most of the properties of A up to some guaranteed approximation ratio. In so…

Machine Learning · Statistics 2019-12-03 Roberta Falcone , Angela Montanari , Laura Anderlucci

In their seminal work, Alon, Matias, and Szegedy introduced several sketching techniques, including showing that 4-wise independence is sufficient to obtain good approximations of the second frequency moment. In this work, we show that…

Data Structures and Algorithms · Computer Science 2010-02-03 Vladimir Braverman , Kai-Min Chung , Zhenming Liu , Michael Mitzenmacher , Rafail Ostrovsky

The starting point of this work is a framework allowing to model systems with dynamic process creation, equipped with a procedure to detect symmetric executions (ie., which differ only by the identities of processes). This allows to reduce…

Logic in Computer Science · Computer Science 2013-02-15 Łukasz Fronc

Counters are the fundamental building block of many data sketching schemes, which hash items to a small number of counters and account for collisions to provide good approximations for frequencies and other measures. Most existing methods…

Data Structures and Algorithms · Computer Science 2021-02-26 Ran Ben Basat , Gil Einziger , Michael Mitzenmacher , Shay Vargaftik