English
Related papers

Related papers: Quickest Change Detection in Autoregressive Models

200 papers

Autoregressive models are typically applied to sequences of discrete tokens, but recent research indicates that generating sequences of continuous embeddings in an autoregressive manner is also feasible. However, such Continuous…

Machine Learning · Computer Science 2024-11-28 Marco Pasini , Javier Nistal , Stefan Lattner , George Fazekas

In this paper, we study change-point testing for high-dimensional linear models, an important problem that has not been well explored in the literature. Specifically, we propose a quadratic-form cumulative sum (CUSUM) statistic to test the…

Statistics Theory · Mathematics 2024-10-23 Zifeng Zhao , Xiaokai Luo , Zongge Liu , Daren Wang

We propose a new unsupervised and non-parametric method to detect change points in intricate quasi-periodic signals. The detection relies on optimal transport theory combined with topological analysis and the bootstrap procedure. The…

Machine Learning · Computer Science 2022-11-15 Nikolay Shvetsov , Nazar Buzun , Dmitry V. Dylov

The identification of anomalies is a critical component of operating complex, and possibly large-scale and geo-graphically distributed cyber-physical systems. While designing anomaly detectors, it is common to assume Gaussian noise models…

Systems and Control · Electrical Eng. & Systems 2021-11-15 Venkatraman Renganathan , Navid Hashemi , Justin Ruths , Tyler H. Summers

Iterative gradient-based algorithms have been increasingly applied for the training of a broad variety of machine learning models including large neural-nets. In particular, momentum-based methods, with accelerated learning guarantees, have…

Machine Learning · Computer Science 2021-06-10 José M. Moreu , Anuradha M. Annaswamy

We consider the problem of estimating the number of hidden states (the order) of a nonparametric hidden Markov model (HMM). We propose two different methods and prove their almost sure consistency without any prior assumption, be it on the…

Statistics Theory · Mathematics 2017-05-19 Luc Lehéricy

The ability to localize transmission loss change to a subset of links in optical networks is crucial for maintaining network reliability, performance and security. \emph{Quantum probes}, implemented by sending blocks of $n$ coherent-state…

Quantum Physics · Physics 2025-08-29 Yufei Zheng , Yu-Zhen Janice Chen , Prithwish Basu , Don Towsley

A non-intrusive reduced order model based on convolutional autoencoders (NIROM-CAEs) is proposed as a data-driven tool to build an efficient nonlinear reduced-order model for stochastic spatio-temporal large-scale physical problems. The…

Fluid Dynamics · Physics 2022-08-08 Azzedine Abdedou , Azzeddine Soulaïmani

Detection of critical slowing down (CSD) is the dominant avenue for anticipating critical transitions from noisy time-series data. Most commonly, changes in variance and lag-1 autocorrelation [AC(1)] are used as CSD indicators. However,…

Dynamical Systems · Mathematics 2024-06-05 Andreas Morr , Niklas Boers

Detecting abrupt changes in data streams is crucial because they are often triggered by events that have important consequences if left unattended. Quickest change point detection has become a vital sequential analysis primitive that aims…

Quantum Physics · Physics 2023-10-23 Marco Fanizza , Christoph Hirche , John Calsamiglia

The problem of quickest detection of a change in the mean of a sequence of independent observations is studied. The pre-change distribution is assumed to be stationary, while the post-change distributions are allowed to be non-stationary.…

Signal Processing · Electrical Eng. & Systems 2021-08-26 Yuchen Liang , Venugopal V. Veeravalli

Despite decades of research and recent progress in adaptive control and reinforcement learning, there remains a fundamental lack of understanding in designing controllers that provide robustness to inherent non-asymptotic uncertainties…

Machine Learning · Computer Science 2021-08-13 Benjamin Gravell , Tyler Summers

Asynchronous stochastic gradient descent (SGD) enables scalable distributed training but suffers from gradient staleness. Existing mitigation strategies, such as delay-adaptive learning rates and staleness-aware filtering, typically…

Machine Learning · Computer Science 2026-05-15 Tehila Dahan , Roie Reshef , Sharon Goldstein , Kfir Y. Levy

This work examines the problem of sequential detection of a change in the drift of a Brownian motion in the case of two-sided alternatives. Applications to real life situations in which two-sided changes can occur are discussed.…

Information Theory · Computer Science 2007-07-13 Olympia Hadjiliadis , H. Vincent Poor

Mechanical devices such as engines, vehicles, aircrafts, etc., are typically instrumented with numerous sensors to capture the behavior and health of the machine. However, there are often external factors or variables which are not captured…

Artificial Intelligence · Computer Science 2016-07-12 Pankaj Malhotra , Anusha Ramakrishnan , Gaurangi Anand , Lovekesh Vig , Puneet Agarwal , Gautam Shroff

The development of Adaptive Cruise Control (ACC) systems aims to enhance the safety and comfort of vehicles by automatically regulating the speed of the vehicle to ensure a safe gap from the preceding vehicle. However, conventional ACC…

Robotics · Computer Science 2023-05-08 Rajmeet Singh , Saeed Mozaffari , Mahdi Rezaei , Shahpour Alirezaee

We develop an exact coordinate descent algorithm for high-dimensional regularized Huber regression. In contrast to composite gradient descent methods, our algorithm fully exploits the advantages of coordinate descent when the underlying…

Methodology · Statistics 2025-10-16 Younghoon Kim , Po-Ling Loh , Sumanta Basu

We study the trade-offs between convergence rate and robustness to gradient errors in designing a first-order algorithm. We focus on gradient descent (GD) and accelerated gradient (AG) methods for minimizing strongly convex functions when…

Optimization and Control · Mathematics 2019-11-07 Necdet Serhat Aybat , Alireza Fallah , Mert Gurbuzbalaban , Asuman Ozdaglar

The representation of functions by artificial neural networks depends on a large number of parameters in a non-linear fashion. Suitable parameters of these are found by minimizing a 'loss functional', typically by stochastic gradient…

Machine Learning · Computer Science 2021-09-16 Stephan Wojtowytsch

We investigate the potential of quickest detection based on the eigenvalues of the sample covariance matrix for spectrum sensing applications. A simple phase shift keying (PSK) model with additive white Gaussian noise (AWGN), with $1$…

Information Theory · Computer Science 2015-10-14 Martijn Arts , Andreas Bollig , Rudolf Mathar