English
Related papers

Related papers: Sequential Specification Tests to Choose a Model: …

200 papers

This work investigates the sequential hypothesis testing problem with online sensor selection and sensor usage constraints. That is, in a sensor network, the fusion center sequentially acquires samples by selecting one "most informative"…

Applications · Statistics 2016-01-26 Shang Li , Xiaoou Li , Xiaodong Wang , Jingchen Liu

We propose a new approach to sequential testing which is an adaptive (on-line) extension of the (off-line) framework developed in [10]. It relies upon testing of pairs of hypotheses in the case where each hypothesis states that the vector…

Statistics Theory · Mathematics 2017-02-27 Anatoli Juditsky , Arkadi Nemirovski

Motivated by real-world machine learning applications, we consider a statistical classification task in a sequential setting where test samples arrive sequentially. In addition, the generating distributions are unknown and only a set of…

Machine Learning · Statistics 2021-02-11 Mahdi Haghifam , Vincent Y. F. Tan , Ashish Khisti

We consider a multiple hypothesis testing setting where the hypotheses are ordered and one is only permitted to reject an initial contiguous block, H_1,\dots,H_k, of hypotheses. A rejection rule in this setting amounts to a procedure for…

Statistics Theory · Mathematics 2015-03-25 Max Grazier G'Sell , Stefan Wager , Alexandra Chouldechova , Robert Tibshirani

Model-Based Diagnosis deals with the identification of the real cause of a system's malfunction based on a formal system model and observations of the system behavior. When a malfunction is detected, there is usually not enough information…

Artificial Intelligence · Computer Science 2017-11-16 Patrick Rodler , Wolfgang Schmid , Konstantin Schekotihin

Many model selection algorithms produce a path of fits specifying a sequence of increasingly complex models. Given such a sequence and the data used to produce them, we consider the problem of choosing the least complex model that is not…

Methodology · Statistics 2015-12-09 William Fithian , Jonathan Taylor , Robert Tibshirani , Ryan Tibshirani

The problem of detecting changes in covariance for a single pair of features has been studied in some detail, but may be limited in importance or general applicability. In contrast, testing equality of covariance matrices of a {\it set} of…

Methodology · Statistics 2017-12-12 Yi-Hui Zhou

Change-point detection studies the problem of detecting the changes in the underlying distribution of the data stream as soon as possible after the change happens. Modern large-scale, high-dimensional, and complex streaming data call for…

Statistics Theory · Mathematics 2023-06-05 Haoyun Wang , Yao Xie

The problem of sequential anomaly detection and identification is considered, where multiple data sources are simultaneously monitored and the goal is to identify in real time those, if any, that exhibit ``anomalous" statistical behavior.…

Statistics Theory · Mathematics 2024-12-09 Aristomenis Tsopelakos , Georgios Fellouris

Sequential (online) change-point detection involves continuously monitoring time-series data and triggering an alarm when shifts in the data distribution are detected. We propose an algorithm for real-time identification of alterations in…

Methodology · Statistics 2024-12-16 Yuhan Tian , Abolfazl Safikhani

We propose a novel framework of the model specification test in regression using unlabeled test data. In many cases, we have conducted statistical inferences based on the assumption that we can correctly specify a model. However, it is…

Methodology · Statistics 2020-02-25 Masahiro Kato , Hikaru Kawarazaki

In this paper, we study change-point testing for high-dimensional linear models, an important problem that has not been well explored in the literature. Specifically, we propose a quadratic-form cumulative sum (CUSUM) statistic to test the…

Statistics Theory · Mathematics 2024-10-23 Zifeng Zhao , Xiaokai Luo , Zongge Liu , Daren Wang

We introduce a simple tool to control for false discoveries and identify individual signals in scenarios involving many tests, dependent test statistics, and potentially sparse signals. The tool applies the Cauchy combination test…

Econometrics · Economics 2023-06-02 Nabil Bouamara , Sébastien Laurent , Shuping Shi

In the statistical inference for long range dependent time series the shape of the limit distribution typically depends on unknown parameters. Therefore, we propose to use subsampling. We show the validity of subsampling for general…

Statistics Theory · Mathematics 2016-10-20 Annika Betken , Martin Wendler

To detect changes in the mean of a time series, one may use previsible detection procedures based on nonparametric kernel prediction smoothers which cover various classic detection statistics as special cases. Bandwidth selection,…

Probability · Mathematics 2018-03-20 Ansgar Steland

Classical and more recent tests for detecting distributional changes in multivariate time series often lack power against alternatives that involve changes in the cross-sectional dependence structure. To be able to detect such changes…

Statistics Theory · Mathematics 2014-09-16 Axel Bücher , Ivan Kojadinovic , Tom Rohmer , Johan Segers

When prospectively developing a new clinical prediction model (CPM), fixed sample size calculations are typically conducted before data collection based on sensible assumptions. But if the assumptions are inaccurate the actual sample size…

The sequential hypothesis testing problem is a class of statistical analyses where the sample size is not fixed in advance. Instead, the decision-process takes in new observations sequentially to make real-time decisions for testing an…

Machine Learning · Statistics 2022-04-12 Wanrong Zhang , Yajun Mei , Rachel Cummings

We revisit the problem of statistical sequence matching initiated by Unnikrishnan (TIT 2015) and derive theoretical performance guarantees for sequential tests that have bounded expected stopping times. Specifically, in this problem, one is…

Information Theory · Computer Science 2025-06-05 Lin Zhou , Qianyun Wang , Yun Wei , Jingjing Wang

We propose a new framework for the detection of change-points in online, sequential data analysis. The approach utilizes nearest neighbor information and can be applied to sequences of multivariate observations or non-Euclidean data…

Methodology · Statistics 2018-05-01 Hao Chen