English
Related papers

Related papers: Model change detection with application to machine…

200 papers

This paper addresses the issue of detecting change-points in multivariate time series. The proposed approach differs from existing counterparts by making only weak assumptions on both the change-points structure across series, and the…

Methodology · Statistics 2014-07-14 Flore Harlé , Florent Chatelain , Cédric Gouy-Pailler , Sophie Achard

Test-time adaptation (TTA) is an effective approach to mitigate performance degradation of trained models when encountering input distribution shifts at test time. However, existing TTA methods often suffer significant performance drops…

Machine Learning · Computer Science 2025-02-06 Minguk Jang , Hye Won Chung

We address the problem of detecting a change in the distribution of a high-dimensional multivariate normal time series. Assuming that the post-change parameters are unknown and estimated using a window of historical data, we extend the…

Signal Processing · Electrical Eng. & Systems 2025-02-12 Robert Malinas , Dogyoon Song , Benjamin D. Robinson , Alfred O. Hero

Recent attention in quickest change detection in the multi-sensor setting has been on the case where the densities of the observations change at the same instant at all the sensors due to the disruption. In this work, a more general…

Information Theory · Computer Science 2016-11-18 Vasanthan Raghavan , Venugopal V. Veeravalli

Assume that there are multiple data streams (channels, sensors) and in each stream the process of interest produces generally dependent and non-identically distributed observations. When the process is in a normal mode (in-control), the…

Statistics Theory · Mathematics 2018-07-25 Alexander Tartakovsky

Sequential change-point detection for graphs is a fundamental problem for streaming network data types and has wide applications in social networks and power systems. Given fixed vertices and a sequence of random graphs, the objective is to…

Statistics Theory · Mathematics 2021-02-12 Liyan Xie , Yao Xie

Mixtures of Linear Regressions (MLR) is an important mixture model with many applications. In this model, each observation is generated from one of the several unknown linear regression components, where the identity of the generated…

Machine Learning · Computer Science 2020-03-31 Yuanzhi Li , Yingyu Liang

In this paper easily applicable techniques are devised for detecting changepoints in autocorrelated Gaussian sequences. Our method proceeds by sequential evaluation of a CUSUM-type test statistic, which is compared to a predefined…

Probability · Mathematics 2016-02-09 W. Ellens , J. Kuhn , M. Mandjes , P. Żuraniewski

Many machine learning applications use latent variable models to explain structure in data, whereby visible variables (= coordinates of the given datapoint) are explained as a probabilistic function of some hidden variables. Finding…

Machine Learning · Computer Science 2016-12-30 Sanjeev Arora , Rong Ge , Tengyu Ma , Andrej Risteski

Machine learning algorithms have achieved remarkable success across various disciplines, use cases and applications, under the prevailing assumption that training and test samples are drawn from the same distribution. Consequently, these…

Machine Learning · Computer Science 2024-11-07 Zehao Xiao , Cees G. M. Snoek

Mixed linear models are commonly used in repeated measures studies. They account for the dependence amongst observations obtained from the same experimental unit. Oftentimes, the number of observations is small, and it is thus important to…

Methodology · Statistics 2011-08-05 Tatiane F. N. Melo , Silvia L. P. Ferrari , Francisco Cribari-Neto

This paper investigates correct variable selection in finite samples via $\ell_1$ and $\ell_1+\ell_2$ type penalization schemes. The asymptotic consistency of variable selection immediately follows from this analysis. We focus on logistic…

Statistics Theory · Mathematics 2008-12-16 Florentina Bunea

The notion of concept drift refers to the phenomenon that the distribution generating the observed data changes over time. If drift is present, machine learning models may become inaccurate and need adjustment. Many technologies for…

Machine Learning · Computer Science 2022-12-05 Fabian Hinder , Valerie Vaquet , Johannes Brinkrolf , Barbara Hammer

Human and model-generated texts can be distinguished by examining the magnitude of likelihood in language. However, it is becoming increasingly difficult as language model's capabilities of generating human-like texts keep evolving. This…

Computation and Language · Computer Science 2024-10-10 Yang Xu , Yu Wang , Hao An , Zhichen Liu , Yongyuan Li

We address the issue of detecting changes of models that lie behind a data stream. The model refers to an integer-valued structural information such as the number of free parameters in a parametric model. Specifically we are concerned with…

Machine Learning · Computer Science 2023-02-24 Kenji Yamanishi , So Hirai

When deployed in the real world, machine learning models inevitably encounter changes in the data distribution, and certain -- but not all -- distribution shifts could result in significant performance degradation. In practice, it may make…

Machine Learning · Statistics 2022-05-06 Aleksandr Podkopaev , Aaditya Ramdas

We establish the convergence rates and asymptotic distributions of the common break change-point estimators, obtained by least squares and maximum likelihood in panel data models and compare their asymptotic variances. Our model assumptions…

Statistics Theory · Mathematics 2017-08-22 Monika Bhattacharjee , Moulinath Banerjee , George Michailidis

Modern information systems generate large volumes of data with anomalies that occur at unknown points in time and have to be detected quickly and reliably with low false alarm rates. The paper develops a general theory of quickest…

Statistics Theory · Mathematics 2023-05-16 Alexander G Tartakovsky , Valentin Spivak

Generative, temporal network models play an important role in analyzing the dependence structure and evolution patterns of complex networks. Due to the complicated nature of real network data, it is often naive to assume that the underlying…

Methodology · Statistics 2024-08-15 Daniel Cirkovic , Tiandong Wang , Xianyang Zhang

It can be difficult to assess the quality of a fitted model when facing unsupervised learning problems. Latent variable models, such as variation autoencoders and Gaussian mixture models, are often trained with likelihood-based approaches.…

Machine Learning · Computer Science 2023-06-16 Cédric Beaulac