English
Related papers

Related papers: Sequential Change Point Detection with FDR Control…

200 papers

Controlling the False Discovery Rate (FDR) in a variable selection procedure is critical for reproducible discoveries, and it has been extensively studied in sparse linear models. However, it remains largely open in scenarios where the…

Methodology · Statistics 2023-11-16 Yang Cao , Xinwei Sun , Yuan Yao

This paper describes a methodology for detecting anomalies from sequentially observed and potentially noisy data. The proposed approach consists of two main elements: (1) {\em filtering}, or assigning a belief or likelihood to each…

Machine Learning · Computer Science 2016-11-17 Maxim Raginsky , Rebecca Willett , Corinne Horn , Jorge Silva , Roummel Marcia

Many modern applications require detecting change points in complex sequential data. Most existing methods for change point detection are unsupervised and, as a consequence, lack any information regarding what kind of changes we want to…

Machine Learning · Computer Science 2022-02-11 Nauman Ahad , Eva L. Dyer , Keith B. Hengen , Yao Xie , Mark A. Davenport

We propose a novel change-point detection method based on online Dynamic Mode Decomposition with control (ODMDwC). Leveraging ODMDwC's ability to find and track linear approximation of a non-linear system while incorporating control…

Artificial Intelligence · Computer Science 2024-08-20 Marek Wadinger , Michal Kvasnica , Yoshinobu Kawahara

False discovery rate (FDR) is a common way to control the number of false discoveries in multiple testing. There are a number of approaches available for controlling FDR. However, for functional test statistics, which are discretized into…

Methodology · Statistics 2024-12-03 Tomáš Mrkvička , Mari Myllymäki

The False Discovery Rate (FDR) is a new statistical procedure to control the number of mistakes made when performing multiple hypothesis tests, i.e. when comparing many data against a given model hypothesis. The key advantage of FDR is that…

Cumulative sum (CUSUM) charts are typically used to detect changes in a stream of observations e.g. shifts in the mean. Usually, after signalling, the chart is restarted by setting it to some value below the signalling threshold. We propose…

Methodology · Statistics 2013-07-30 Axel Gandy , F. Din-Houn Lau

Selecting relevant features associated with a given response variable is an important issue in many scientific fields. Quantifying quality and uncertainty of a selection result via false discovery rate (FDR) control has been of recent…

Methodology · Statistics 2020-12-17 Chenguang Dai , Buyu Lin , Xin Xing , Jun S. Liu

Initial development and subsequent calibration of discrete event simulation models for complex systems require accurate identification of dynamically changing process characteristics. Existing data driven change point methods (DD-CPD)…

Machine Learning · Computer Science 2024-10-30 Suleyman Yildirim , Alper Ekrem Murat , Murat Yildirim , Suzan Arslanturk

Established recurrent neural networks are well-suited to solve a wide variety of prediction tasks involving discrete sequences. However, they do not perform as well in the task of dynamical system identification, when dealing with…

Machine Learning · Computer Science 2019-11-22 Thomas Demeester

Large-scale hypothesis testing is central to modern science, where controlling the False Discovery Rate (FDR) has become the standard approach to managing false positives across many simultaneous tests. Hypotheses rarely exist in isolation;…

Methodology · Statistics 2026-05-19 Binyamin Perets , Shie Mannor

In modern business modeling and analytics, data monitoring plays a critical role. Nowadays, sophisticated models often rely on hundreds or even thousands of input variables. Over time, structural changes such as abrupt level shifts or trend…

Methodology · Statistics 2019-10-07 Yingbo Li , Robert Cezeaux , Di Yu

While previous distribution shift detection approaches can identify if a shift has occurred, these approaches cannot localize which specific features have caused a distribution shift -- a critical step in diagnosing or fixing any underlying…

Machine Learning · Computer Science 2021-07-16 Sean Kulinski , Saurabh Bagchi , David I. Inouye

In this paper, we study statistical inference of change-points (CPs) in multi-dimensional sequence. In CP detection from a multi-dimensional sequence, it is often desirable not only to detect the location, but also to identify the subset of…

Machine Learning · Statistics 2021-10-19 Ryota Sugiyama , Hiroki Toda , Vo Nguyen Le Duy , Yu Inatsu , Ichiro Takeuchi

A common approach to detect multiple changepoints is to minimise a measure of data fit plus a penalty that is linear in the number of changepoints. This paper shows that the general finite sample behaviour of such a method can be related to…

Statistics Theory · Mathematics 2022-08-15 Chao Zheng , Idris A. Eckley , Paul Fearnhead

This paper investigates a novel offline change-point detection problem from an information-theoretic perspective. In contrast to most related works, we assume that the knowledge of the underlying pre- and post-change distributions are not…

Information Theory · Computer Science 2021-10-05 Haiyun He , Qiaosheng Zhang , Vincent Y. F. Tan

We study how to secure distributed filters for linear time-invariant systems with bounded noise under false-data injection attacks. A malicious attacker is able to arbitrarily manipulate the observations for a time-varying and unknown…

Systems and Control · Electrical Eng. & Systems 2021-06-23 Xingkang He , Xiaoqiang Ren , Henrik Sandberg , Karl H. Johansson

Given a sequence of random (directed and weighted) graphs, we address the problem of online monitoring and detection of changes in the underlying data distribution. Our idea is to endow sequential change-point detection (CPD) techniques…

Machine Learning · Computer Science 2022-02-03 Bernardo Marenco , Paola Bermolen , Marcelo Fiori , Federico Larroca , Gonzalo Mateos

We propose a Bayesian method to detect change points for functional data. We extract the features of a sequence of functional data by the discrete wavelet transform (DWT), and treat each sequence of feature independently. We believe there…

Methodology · Statistics 2018-08-06 Xiuqi Li , Subhashis Ghosal

Advanced computing and data acquisition technologies have made possible the collection of high-dimensional data streams in many fields. Efficient online monitoring tools which can correctly identify any abnormal data stream for such data…

Methodology · Statistics 2017-12-15 Jun Li