English
Related papers

Related papers: Nearly second-order asymptotic optimality of seque…

200 papers

In the field of online sequential decision-making, we address the problem with delays utilizing the framework of online convex optimization (OCO), where the feedback of a decision can arrive with an unknown delay. Unlike previous research…

Machine Learning · Computer Science 2024-02-26 Ping Wu , Heyan Huang , Zhengyang Liu

Consider the problem on sequential change-point detection on multiple data streams. We provide the asymptotic lower bounds of the detection delays at all levels of change-point sparsity and we derive a smaller asymptotic lower bound of the…

Statistics Theory · Mathematics 2023-06-02 Jingyan Huang

When deploying modern machine learning-enabled robotic systems in high-stakes applications, detecting distribution shift is critical. However, most existing methods for detecting distribution shift are not well-suited to robotics settings,…

We introduce a framework for online changepoint detection and simultaneous model learning which is applicable to highly parametrized models, such as deep neural networks. It is based on detecting changepoints across time by sequentially…

Machine Learning · Computer Science 2020-10-08 Michalis K. Titsias , Jakub Sygnowski , Yutian Chen

In this book, I introduce the basic concepts of Online Learning through the modern view of Online Convex Optimization. Here, online learning refers to the framework of regret minimization under worst-case assumptions. I present first-order…

Machine Learning · Computer Science 2026-04-28 Francesco Orabona

In this paper, we study the quickest change detection with mismatched post-change models. A change point is the time instant at which the distribution of a random process changes. The objective of quickest change detection is to minimize…

Methodology · Statistics 2016-01-27 Jingxian Wu , Jing Yang

A finite-horizon variant of the quickest change detection problem is investigated, which is motivated by a change detection problem that arises in piecewise stationary bandits. The goal is to minimize the \emph{latency}, which is smallest…

Information Theory · Computer Science 2025-06-19 Yu-Han Huang , Venugopal V. Veeravalli

We study the parametric online changepoint detection problem, where the underlying distribution of the streaming data changes from a known distribution to an alternative that is of a known parametric form but with unknown parameters. We…

Statistics Theory · Mathematics 2023-05-22 Liyan Xie , George V. Moustakides , Yao Xie

We study the problem of differentially-private (DP) stochastic (convex-concave) saddle-points in the $\ell_1$ setting. We propose $(\varepsilon, \delta)$-DP algorithms based on stochastic mirror descent that attain nearly…

Optimization and Control · Mathematics 2025-11-17 Tomás González , Cristóbal Guzmán , Courtney Paquette

We propose a quickest change detection problem over sensor networks where both the subset of sensors undergoing a change and the local post-change distributions are unknown. Each sensor in the network observes a local discrete time random…

Signal Processing · Electrical Eng. & Systems 2021-02-11 Deniz Sargun , C. Emre Koksal

Changepoints are abrupt variations in the generative parameters of a data sequence. Online detection of changepoints is useful in modelling and prediction of time series in application areas such as finance, biometrics, and robotics. While…

Machine Learning · Statistics 2007-10-22 Ryan Prescott Adams , David J. C. MacKay

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

Machine Learning · Computer Science 2023-01-24 Nikolaj Tatti

We consider a sequential Bayesian changepoint detection problem for a general stochastic model, assuming that the observed data may be dependent and non-identically distributed and the prior distribution of the change point is arbitrary,…

Statistics Theory · Mathematics 2016-01-15 Alexander G. Tartakovsky

We propose a new framework for the detection of change-points in online, sequential data analysis. The approach utilizes nearest neighbor information and can be applied to sequences of multivariate observations or non-Euclidean data…

Methodology · Statistics 2018-05-01 Hao Chen

This paper proposes a novel methodology for the online detection of changepoints in the factor structure of large matrix time series. Our approach is based on the well-known fact that, in the presence of a changepoint, a factor model can be…

Methodology · Statistics 2021-12-28 Yong He , Xin-bing Kong , Lorenzo Trapani , Long Yu

A finite-horizon variant of the quickest change detection (QCD) problem that is of relevance to learning in non-stationary environments is studied. The metric characterizing false alarms is the probability of a false alarm occurring before…

Information Theory · Computer Science 2025-11-18 Yu-Han Huang , Venugopal V. Veeravalli

This paper considers distributed online optimization with time-varying coupled inequality constraints. The global objective function is composed of local convex cost and regularization functions and the coupled constraint function is the…

Optimization and Control · Mathematics 2019-06-06 Xinlei Yi , Xiuxian Li , Lihua Xie , Karl H. Johansson

In this paper, we consider the online proximal mirror descent for solving the time-varying composite optimization problems. For various applications, the algorithm naturally involves the errors in the gradient and proximal operator. We…

Optimization and Control · Mathematics 2023-04-11 Woocheol Choi , Myeong-Su Lee , Seok-Bae Yun

We study the posterior distribution of the Bayesian multiple change-point regression problem when the number and the locations of the change-points are unknown. While it is relatively easy to apply the general theory to obtain the…

Statistics Theory · Mathematics 2008-08-21 Heng Lian

We introduce and study two new inferential challenges associated with the sequential detection of change in a high-dimensional mean vector. First, we seek a confidence interval for the changepoint, and second, we estimate the set of indices…

Methodology · Statistics 2023-03-03 Yudong Chen , Tengyao Wang , Richard J. Samworth