English
Related papers

Related papers: Data-Driven Quickest Change Detection in (Hidden) …

200 papers

In safety-critical Cyber-Physical Systems (CPS), accurate trajectory prediction provides vital guidance for downstream planning and control, yet although deep learning models achieve high-fidelity forecasts on validation data, their…

Robotics · Computer Science 2026-03-17 Tongfei Guo , Lili Su

The problem of sequentially detecting a moving anomaly which affects different parts of a sensor network with time is studied. Each network sensor is characterized by a non-anomalous and anomalous distribution, governing the generation of…

Statistics Theory · Mathematics 2020-07-30 Georgios Rovatsos , George V. Moustakides , Venugopal V. Veeravalli

The impact of randomness on model training is poorly understood. How do differences in data order and initialization actually manifest in the model, such that some training runs outperform others or converge faster? Furthermore, how can we…

Machine Learning · Computer Science 2024-01-23 Michael Y. Hu , Angelica Chen , Naomi Saphra , Kyunghyun Cho

Using supervised machine learning approaches to recognize human activities from on-body wearable accelerometers generally requires a large amount of labelled data. When ground truth information is not available, too expensive, time…

Machine Learning · Statistics 2013-12-30 Dorra Trabelsi , Samer Mohammed , Faicel Chamroukhi , Latifa Oukhellou , Yacine Amirat

Data-driven control algorithms use observations of system dynamics to construct an implicit model for the purpose of control. However, in practice, data-driven techniques often require excessive sample sizes, which may be infeasible in…

Systems and Control · Electrical Eng. & Systems 2023-01-10 Adam J. Thorpe , Cyrus Neary , Franck Djeumou , Meeko M. K. Oishi , Ufuk Topcu

We are interested in assessing the order of a finite-state Hidden Markov Model (HMM) with the only two assumptions that the transition matrix of the latent Markov chain has full rank and that the density functions of the emission…

Statistics Theory · Mathematics 2023-11-29 Marie Du Roy de Chaumaray , Salima El Kolei , Marie-Pierre Etienne , Matthieu Marbac

Multi-stream sequential change detection involves simultaneously monitoring many streams of data and trying to detect when their distributions change, if at all. Here, we theoretically study multiple testing issues that arise from detecting…

Statistics Theory · Mathematics 2025-02-04 Sanjit Dandapanthula , Aaditya Ramdas

Hidden Markov Models (HMMs) can be accurately approximated using co-occurrence frequencies of pairs and triples of observations by using a fast spectral method in contrast to the usual slow methods like EM or Gibbs sampling. We provide a…

Machine Learning · Statistics 2012-03-29 Dean P. Foster , Jordan Rodu , Lyle H. Ungar

Hidden Markov models (HMMs) are commonly used for disease progression modeling when the true patient health state is not fully known. Since HMMs typically have multiple local optima, incorporating additional patient covariates can improve…

Machine Learning · Statistics 2021-10-05 Matt Baucum , Anahita Khojandi , Theodore Papamarkou

Oftentimes in practice, the observed process changes statistical properties at an unknown point in time and the duration of a change is substantially finite, in which case one says that the change is intermittent or transient. We provide an…

Applications · Statistics 2023-04-11 Grigory Sokolov , Valentin S. Spivak , Alexander G. Tartakovsky

ML-enabled systems that are deployed in a production environment typically suffer from decaying model prediction quality through concept drift, i.e., a gradual change in the statistical characteristics of a certain real-world domain. To…

Machine Learning · Computer Science 2025-08-05 Rafiullah Omar , Justus Bogner , Joran Leest , Vincenzo Stoico , Patricia Lago , Henry Muccini

Machine learning (ML) techniques have been demonstrated to improve the accuracy and efficiency of anomaly detection (AD) when compared to conventional methods. This has led to the adoption of ML for data quality monitoring (DQM) use cases…

The problem of quickest detection of a change in the distribution of a sequence of random variables is studied. The objective is to detect the change with the minimum possible delay, subject to constraints on the rate of false alarms and…

Methodology · Statistics 2024-12-31 Yingze Hou , Hoda Bidkhori , Taposh Banerjee

The expansion of residential demand response programs and increased deployment of controllable loads will require accurate appliance-level load modeling and forecasting. This paper proposes a conditional hidden semi-Markov model to describe…

Applications · Statistics 2018-10-10 Yuting Ji , Elizabeth Buechler , Ram Rajagopal

Hidden Markov models have successfully been applied as models of discrete time series in many fields. Often, when applied in practice, the parameters of these models have to be estimated. The currently predominating identification methods,…

Machine Learning · Statistics 2015-07-24 Robert Mattila , Cristian R. Rojas , Bo Wahlberg

Hidden Markov models and their variants are the predominant sequential classification method in such domains as speech recognition, bioinformatics and natural language processing. Being generative rather than discriminative models, however,…

Machine Learning · Statistics 2013-02-18 John A. Quinn , Masashi Sugiyama

The main focus of this work is on developing models for the activity profile of a terrorist group, detecting sudden spurts and downfalls in this profile, and, in general, tracking it over a period of time. Toward this goal, a $d$-state…

Applications · Statistics 2014-01-16 Vasanthan Raghavan , Aram Galstyan , Alexander G. Tartakovsky

The measurement data collected from the supervisory control and data acquisition (SCADA) system installed in distribution network can reflect the operational state of the network effectively. In this paper, a random matrix theory (RMT)…

Applications · Statistics 2020-03-12 Xin Shi , Robert Qiu , Xing He , Zenan Ling , Haosen Yang , Lei Chu

Hidden Markov models (HMMs) and their extensions have proven to be powerful tools for classification of observations that stem from systems with temporal dependence as they take into account that observations close in time are likely…

Applications · Statistics 2021-11-22 Sofia Ruiz-Suarez , Vianey Leos-Barajas , Juan Manuel Morales

Data Drift is the phenomenon where the generating model behind the data changes over time. Due to data drift, any model built on the past training data becomes less relevant and inaccurate over time. Thus, detecting and controlling for data…

Machine Learning · Computer Science 2025-04-29 Subhadip Bandyopadhyay , Joy Bose , Sujoy Roy Chowdhury