English
Related papers

Related papers: Higher-criticism for sparse multi-stream change-po…

200 papers

We study the multivariate nonparametric change point detection problem, where the data are a sequence of independent $p$-dimensional random vectors whose distributions are piecewise-constant with Lipschitz densities changing at unknown…

Statistics Theory · Mathematics 2020-06-26 Oscar Hernan Madrid Padilla , Yi Yu , Daren Wang , Alessandro Rinaldo

Detecting abrupt changes in streaming graph signals is relevant in a variety of applications ranging from energy and water supplies, to environmental monitoring. In this paper, we address this problem when anomalies activate localized…

Signal Processing · Electrical Eng. & Systems 2019-10-16 André Ferrari , Cédric Richard , Louis Verduci

We adapt Higher Criticism (HC) to the comparison of two frequency tables which may -- or may not -- exhibit moderate differences between the tables in some unknown, relatively small subset out of a large number of categories. Our analysis…

Statistics Theory · Mathematics 2023-08-29 David L. Donoho , Alon Kipnis

Estimating the number of subgraphs in data streams is a fundamental problem that has received great attention in the past decade. In this paper, we give improved streaming algorithms for approximately counting the number of occurrences of…

Data Structures and Algorithms · Computer Science 2022-03-29 Hendrik Fichtenberger , Pan Peng

We investigate the online detection of changepoints in the distribution of a sequence of observations using degenerate U-statistic-type processes. We study weighted versions of: an ordinary, CUSUM-type scheme, a Page-CUSUM-type scheme, and…

Statistics Theory · Mathematics 2025-10-28 Cooper Boniece , Lajos Horvath , Lorenzo Trapani

Detecting changes in data streams is a vital task in many applications. There is increasing interest in changepoint detection in the online setting, to enable real-time monitoring and support prompt responses and informed decision-making.…

Methodology · Statistics 2024-05-27 Victor K. Khamesi , Niall M. Adams , Dean A. Bodenham , Edward A. K. Cohen

We introduce a novel Bayesian method that can detect multiple structural breaks in the mean and variance of a length $T$ time-series. Our method quantifies uncertainty by returning $\alpha$-level credible sets around the estimated locations…

Methodology · Statistics 2025-07-14 Davis Berlind , Lorenzo Cappello , Oscar Hernan Madrid Padilla

In this paper, we consider the filtering problem for partially observed diffusions, which are regularly observed at discrete times. We are concerned with the case when one must resort to time-discretization of the diffusion process if the…

Numerical Analysis · Mathematics 2020-04-09 Marco Ballesio , Ajay Jasra , Erik von Schwerin , Raul Tempone

We propose a change-point detection method for large scale multiple testing problems with data having clustered signals. Unlike the classic change-point setup, the signals can vary in size within a cluster. The clustering structure on the…

Methodology · Statistics 2021-10-07 Hongyuan Cao , Wei Biao Wu

We propose an algorithm for nonparametric online change point detection based on sequential score function estimation and the tracking the best expert approach. The core of the procedure is a version of the fixed share forecaster tailored…

Machine Learning · Computer Science 2026-02-18 Anna Markovich , Nikita Puchkin

Given a stream of graph edges from a dynamic graph, how can we assign anomaly scores to edges and subgraphs in an online manner, for the purpose of detecting unusual behavior, using constant time and memory? For example, in intrusion…

Data Structures and Algorithms · Computer Science 2023-07-18 Siddharth Bhatia , Mohit Wadhwa , Kenji Kawaguchi , Neil Shah , Philip S. Yu , Bryan Hooi

A common approach to detect multiple changepoints is to minimise a measure of data fit plus a penalty that is linear in the number of changepoints. This paper shows that the general finite sample behaviour of such a method can be related to…

Statistics Theory · Mathematics 2022-08-15 Chao Zheng , Idris A. Eckley , Paul Fearnhead

Security and distributed infrastructure are two of the most common requirements for big data software. But the security features of the big data platforms are still premature. It is critical to identify, modify, test and execute some of the…

Cryptography and Security · Computer Science 2016-11-24 Santosh Aditham , Nagarajan Ranganathan

We consider the problem of breakpoint detection in a regression modeling framework. To that end, we introduce a novel method, the max-EM algorithm which combines a constrained Hidden Markov Model with the Classification-EM (CEM) algorithm.…

Computation · Statistics 2024-10-14 Modibo Diabaté , Grégory Nuel , Olivier Bouaziz

Many automated systems need the capability of automatic change detection without the given detection threshold. This paper presents an automated change detection algorithm in streaming multivariate data. Two overlapping windows are used to…

Databases · Computer Science 2013-11-05 Dang-Hoan Tran

This paper presents a new interaction point process that integrates geological knowledge for the purpose of automatic sources detection of multiple sources in groundwaters from hydrochemical data. The observations are considered as spatial…

Applications · Statistics 2023-02-07 Christophe Reype , Radu S. Stoica , Antonin Richard , Madalina Deaconu

This paper investigates a novel offline change-point detection problem from an information-theoretic perspective. In contrast to most related works, we assume that the knowledge of the underlying pre- and post-change distributions are not…

Information Theory · Computer Science 2021-10-05 Haiyun He , Qiaosheng Zhang , Vincent Y. F. Tan

We propose a new, computationally efficient, sparsity adaptive changepoint estimator for detecting changes in unknown subsets of a high-dimensional data sequence. Assuming the data sequence is Gaussian, we prove that the new method…

Methodology · Statistics 2023-11-27 Per August Jarval Moen , Ingrid Kristine Glad , Martin Tveten

Most studies in real time change-point detection either focus on the linear model or use the CUSUM method under classical assumptions on model errors. This paper considers the sequential change-point detection in a nonlinear quantile model.…

Statistics Theory · Mathematics 2016-05-03 Gabriela Ciuperca

Detecting abrupt changes in real-time data streams from scientific simulations presents a challenging task, demanding the deployment of accurate and efficient algorithms. Identifying change points in live data stream involves continuous…