English
Related papers

Related papers: Optimal sequential detection in multi-stream data

200 papers

This paper addresses the problem of segmenting a stream of graph signals: we aim to detect changes in the mean of a multivariate signal defined over the nodes of a known graph. We propose an offline method that relies on the concept of…

Machine Learning · Computer Science 2024-03-01 Alejandro de la Concha , Nicolas Vayatis , Argyris Kalogeratos

Many offline unsupervised change point detection algorithms rely on minimizing a penalized sum of segment-wise costs. We extend this framework by proposing to minimize a sum of discrepancies between segments. In particular, we propose to…

Machine Learning · Computer Science 2020-09-04 Aurélien Serre , Didier Chételat , Andrea Lodi

We consider the problem of detecting multiple changepoints in large data sets. Our focus is on applications where the number of changepoints will increase as we collect more data: for example in genetics as we analyse larger regions of the…

Methodology · Statistics 2015-03-17 R. Killick , P. Fearnhead , I. A. Eckley

Given a stream of entries in a multi-aspect data setting i.e., entries having multiple dimensions, how can we detect anomalous activities in an unsupervised manner? For example, in the intrusion detection setting, existing work seeks to…

Machine Learning · Computer Science 2021-06-09 Siddharth Bhatia , Arjit Jain , Pan Li , Ritesh Kumar , Bryan Hooi

We treat the statistical inference problems in which one needs to detect and estimate simultaneously using as small number of samples as possible. Conventional methods treat the detection and estimation subproblems separately, ignoring the…

Applications · Statistics 2014-11-07 Yasin Yilmaz , Shang Li , Xiaodong Wang

Intruders detection in computer networks has some deficiencies from machine learning approach, given by the nature of the application. The principal problem is the modest display of detection systems based on learning algorithms under the…

Data Structures and Algorithms · Computer Science 2017-01-05 Jorge Luis Rivero Pérez , Bernardete Ribeiro , Kadir Hector Ortiz

We consider offline detection of a single changepoint in binary and count time-series. We compare exact tests based on the cumulative sum (CUSUM) and the likelihood ratio (LR) statistics, and a new proposal that combines exact two-sample…

Methodology · Statistics 2020-08-21 Shyamal K. De , Soumendu Sundar Mukherjee

While many real-world data streams imply that they change frequently in a nonstationary way, most of deep learning methods optimize neural networks on training data, and this leads to severe performance degradation when dataset shift…

Machine Learning · Computer Science 2021-07-02 Wonju Lee , Seok-Yong Byun , Jooeun Kim , Minje Park , Kirill Chechil

We propose two procedures to detect a change in the mean of high-dimensional online data. One is based on a max-type U-statistic and another is based on a sum-type U-statistic. Theoretical properties of the two procedures are explored in…

Methodology · Statistics 2021-07-27 Jun Li

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

Machine Learning · Computer Science 2018-08-22 Utkarsh Porwal , Smruthi Mukund

In recent years, there has been an increasing demand on efficient algorithms for large scale change point detection problems. To this end, we propose seeded binary segmentation, an approach relying on a deterministic construction of…

Methodology · Statistics 2023-03-13 Solt Kovács , Housen Li , Peter Bühlmann , Axel Munk

In this article we consider the problems of distributed detection and estimation in wireless sensor networks. In the first part, we provide a general framework aimed to show how an efficient design of a sensor network requires a joint…

Distributed, Parallel, and Cluster Computing · Computer Science 2013-07-08 Sergio Barbarossa , Stefania Sardellitti , Paolo Di Lorenzo

In the problem of quickest change detection, a change occurs at some unknown time in the distribution of a sequence of random vectors that are monitored in real time, and the goal is to detect this change as quickly as possible subject to a…

Information Theory · Computer Science 2023-10-27 Venugopal V. Veeravalli , Georgios Fellouris , George V. Moustakides

We present a novel scheme to boost detection power for kernel maximum mean discrepancy based sequential change-point detection procedures. Our proposed scheme features an optimal sub-sampling of the history data before the detection…

Methodology · Statistics 2023-01-19 Song Wei , Chaofan Huang

This work explores use of novel advances in best subset selection for regression modelling via continuous optimization for offline change point detection and estimation in univariate Gaussian data sequences. The approach exploits…

Methodology · Statistics 2024-07-08 Hans Reimann , Sarat Moka , Georgy Sofronov

We address the sequential change-point detection problem for the Gaussian model where baseline distribution is Gaussian with variance \sigma^2 and mean \mu such that \sigma^2=a\mu, where a>0 is a known constant; the change is in \mu from…

Statistics Theory · Mathematics 2012-03-06 Aleksey S. Polunchenko , Alexander G. Tartakovsky , Nitis Mukhopadhyay

The problem of quickest detection of a change in the distribution of a sequence of independent observations is considered. It is assumed that the pre-change distribution is known (accurately estimated), while the only information about the…

Statistics Theory · Mathematics 2023-09-29 Liyan Xie , Yuchen Liang , Venugopal V. Veeravalli

Many modern applications of online changepoint detection require the ability to process high-frequency observations, sometimes with limited available computational resources. Online algorithms for detecting a change in mean often involve…

Methodology · Statistics 2023-04-12 Gaetano Romano , Idris Eckley , Paul Fearnhead , Guillem Rigaill

Change-point analysis has been successfully applied to the detect changes in multivariate data streams over time. In many applications, when data are observed over a graph/network, change does not occur simultaneously but instead spread…

Methodology · Statistics 2023-06-21 Hanqing Cai , Tengyao Wang

This paper considers the change-point problem for finite sequences of networks. To avoid the difficulty of computing the normalization coefficient, such as in Exponential random graphical models (ERGMs) and Markov networks, we construct a…

Statistics Theory · Mathematics 2021-01-19 Lei Qiao , Dong Han