English
Related papers

Related papers: Phase Transitions in the Detection of Correlated D…

200 papers

In this paper, we study the sensitivity of the spectral clustering based community detection algorithm subject to a Erdos-Renyi type random noise model. We prove phase transitions in community detectability as a function of the external…

Social and Information Networks · Computer Science 2015-04-14 Pin-Yu Chen , Alfred O. Hero

We initiate the study of property testing problems concerning relations between permutations. In such problems, the input is a tuple $(\sigma_1,\dotsc,\sigma_d)$ of permutations on $\{1,\dotsc,n\}$, and one wishes to determine whether this…

Data Structures and Algorithms · Computer Science 2024-07-11 Oren Becker , Alexander Lubotzky , Jonathan Mosheiff

In this paper we consider the uniformity testing problem for high-dimensional discrete distributions (multinomials) under sparse alternatives. More precisely, we derive sharp detection thresholds for testing, based on $n$ samples, whether a…

Statistics Theory · Mathematics 2022-02-17 Bhaswar B. Bhattacharya , Rajarshi Mukherjee

The problem of frequent pattern mining from non-temporal databases is studied extensively by various researchers working in areas of data mining, temporal databases and information retrieval. However, Conventional frequent pattern…

Databases · Computer Science 2016-04-19 Vangipuram Radhakrishna , P. V. Kumar , V. Janaki

Whether it is for audit or for recovery purposes, data checkpointing is an important problem of distributed database systems. Actually, transactions establish dependence relations on data checkpoints taken by data object managers. So, given…

Databases · Computer Science 2007-05-23 R. Baldoni , F. Quaglia , M. Raynal

We take a different look at the problem of testing the independence of two metric-space-valued random variables using the distance correlation. Instead of testing if the distance correlation vanishes exactly, we are interested in the…

Statistics Theory · Mathematics 2025-11-19 Holger Dette , Marius Kroll

Consider $d$ dependent change point tests, each based on a CUSUM-statistic. We provide an asymptotic theory that allows us to deal with the maximum over all test statistics as both the sample size $n$ and $d$ tend to infinity. We achieve…

Statistics Theory · Mathematics 2017-12-07 Moritz Jirak

Consider a network consisting of two subnetworks (communities) connected by some external edges. Given the network topology, the community detection problem can be cast as a graph partitioning problem that aims to identify the external…

Social and Information Networks · Computer Science 2023-07-19 Pin-Yu Chen , Alfred O. Hero

When data analysts train a classifier and check if its accuracy is significantly different from chance, they are implicitly performing a two-sample test. We investigate the statistical properties of this flexible approach in the…

Machine Learning · Computer Science 2020-02-18 Ilmun Kim , Aaditya Ramdas , Aarti Singh , Larry Wasserman

We study information-theoretic phase transitions for the detectability of latent geometry in bipartite random geometric graphs RGGs with Gaussian d-dimensional latent vectors while only a subset of edges carries latent information…

Probability · Mathematics 2026-04-13 Andreas Göbel , Marcus Pappik , Leon Schiller

The identification of the dependent components in multiple data sets is a fundamental problem in many practical applications. The challenge in these applications is that often the data sets are high-dimensional with few observations or…

Methodology · Statistics 2023-06-02 Martin Gölz , Tanuj Hasija , Michael Muma , Abdelhak M. Zoubir

Given observations from a stationary time series, permutation tests allow one to construct exactly level $\alpha$ tests under the null hypothesis of an i.i.d. (or, more generally, exchangeable) distribution. On the other hand, when the null…

Statistics Theory · Mathematics 2020-09-09 Joseph P. Romano , Marius A. Tirlea

This paper investigates the problem of detecting relevant change points in the mean vector, say $\mu_t =(\mu_{1,t},\ldots ,\mu_{d,t})^T$ of a high dimensional time series $(Z_t)_{t\in \mathbb{Z}}$. While the recent literature on testing for…

Statistics Theory · Mathematics 2021-02-02 Holger Dette , Josua Gösmann

The problem of detecting correlations from samples of a high-dimensional Gaussian vector has recently received a lot of attention. In most existing work, detection procedures are provided with a full sample. However, following common wisdom…

Statistics Theory · Mathematics 2014-10-24 Rui M. Castro , Gabor Lugosi , Pierre-André Savalle

We trace with analytical methods and in a model parameter independent manner the independent bits of Fisher information of each of the moments of the lognormal distribution, as a now standard prescription for the distribution of the…

Cosmology and Nongalactic Astrophysics · Physics 2011-08-18 Julien Carron

In many applications, hypothesis testing is based on an asymptotic distribution of statistics. The aim of this paper is to clarify and extend multiple correction procedures when the statistics are asymptotically Gaussian. We propose a…

Statistics Theory · Mathematics 2020-07-03 Sophie Achard , Pierre Borgnat , Irène Gannaz

We consider a unified framework of sequential change-point detection and hypothesis testing modeled by means of hidden Markov chains. One observes a sequence of random variables whose distributions are functionals of a hidden Markov chain.…

Optimization and Control · Mathematics 2013-12-13 Savas Dayanik , Kazutoshi Yamazaki

Many systems of interacting elements can be conceptualized as networks, where network nodes represent the elements and network ties represent interactions between the elements. In systems where the underlying network evolves in time, it is…

Methodology · Statistics 2015-05-05 Ian Barnett , Jukka-Pekka Onnela

For a bivariate time series $((X_i,Y_i))_{i=1,...,n}$ we want to detect whether the correlation between $X_i$ and $Y_i$ stays constant for all $i = 1,...,n$. We propose a nonparametric change-point test statistic based on Kendall's tau and…

Statistics Theory · Mathematics 2022-04-12 Herold Dehling , Daniel Vogel , Martin Wendler , Dominik Wied

Sequential Bayesian Filtering aims to estimate the current state distribution of a Hidden Markov Model, given the past observations. The problem is well-known to be intractable for most application domains, except in notable cases such as…

Machine Learning · Statistics 2024-02-16 Théophile Cantelobre , Carlo Ciliberto , Benjamin Guedj , Alessandro Rudi