English
Related papers

Related papers: Change-Point Detection Utilizing Normalized Entrop…

200 papers

In this paper, we introduce two robust, nonparametric methods for multiple change-point detection in the variability of a multivariate sequence of observations. We demonstrate that changes in ranks generated from data depth functions can be…

Methodology · Statistics 2021-11-30 Kelly Ramsay , Shoja'eddin Chenouri

The goal of the change-point detection is to discover changes of time series distribution. One of the state of the art approaches of the change-point detection are based on direct density ratio estimation. In this work we show how existing…

Machine Learning · Computer Science 2022-06-22 Mikhail Hushchyn , Andrey Ustyuzhanin

Without imposing prior distributional knowledge underlying multivariate time series of interest, we propose a nonparametric change-point detection approach to estimate the number of change points and their locations along the temporal axis.…

Methodology · Statistics 2021-05-13 Xiaodong Wang , Fushing Hsieh

We consider the challenge of efficiently detecting changes within a network of sensors, where we also need to minimise communication between sensors and the cloud. We propose an online, communication-efficient method to detect such changes.…

Methodology · Statistics 2024-04-11 Ziyang Yang , Idris A. Eckley , Paul Fearnhead

Change-point detection, detecting an abrupt change in the data distribution from sequential data, is a fundamental problem in statistics and machine learning. CUSUM is a popular statistical method for online change-point detection due to…

Machine Learning · Computer Science 2024-03-12 Tingnan Gong , Junghwan Lee , Xiuyuan Cheng , Yao Xie

Unsupervised detection of anomaly points in time series is a challenging problem, which requires the model to derive a distinguishable criterion. Previous methods tackle the problem mainly through learning pointwise representation or…

Machine Learning · Computer Science 2022-06-30 Jiehui Xu , Haixu Wu , Jianmin Wang , Mingsheng Long

Change point detection is a crucial aspect of analyzing time series data, as the presence of a change point indicates an abrupt and significant change in the process generating the data. While many algorithms for the problem of change point…

Machine Learning · Computer Science 2023-05-23 Mario Krause

This article considers a nonparametric method for detecting change points in non-stationary time series. The proposed method will divide the time series into several segments so that between two adjacent segments, the normalized spectral…

Statistics Theory · Mathematics 2020-11-05 Zixiang Guan , Gemai Chen

We propose novel methods for change-point testing for nonparametric estimators of expected shortfall and related risk measures in weakly dependent time series. We can detect general multiple structural changes in the tails of marginal…

Econometrics · Economics 2025-10-07 Lin Fan , Junting Duan , Peter W. Glynn , Markus Pelger

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

Information Theory · Computer Science 2022-05-30 Kenneth Bogert

Detecting change-points in data is challenging because of the range of possible types of change and types of behaviour of data when there is no change. Statistically efficient methods for detecting a change will depend on both of these…

Machine Learning · Statistics 2024-08-29 Jie Li , Paul Fearnhead , Piotr Fryzlewicz , Tengyao Wang

Following [1], the aim of this paper is to analyze the relative weighted entropy involving the central moments weight functions. We compare the standard relative entropy with the weighted case in two particular forms of Gaussian…

Information Theory · Computer Science 2015-06-23 Salimeh Yasaei Sekeh , Adriano Polpo

Non-parametric and distribution-free two-sample tests have been the foundation of many change point detection algorithms. However, randomness in the test statistic as a function of time makes them susceptible to false positives and…

Signal Processing · Electrical Eng. & Systems 2020-10-29 Kevin C. Cheng , Eric L. Miller , Michael C. Hughes , Shuchin Aeron

Convolutional Neural Network (CNN) techniques have proven to be very useful in image-based anomaly detection applications. CNN can be used as deep features extractor where other anomaly detection techniques are applied on these features.…

Machine Learning · Computer Science 2022-08-15 Sulaiman Aburakhia , Tareq Tayeh , Ryan Myers , Abdallah Shami

This paper investigates sequential change-point detection in reconfigurable sensor networks. In this problem, data from multiple sensors are observed sequentially. Each sensor can have a unique change point, and the data distribution…

Methodology · Statistics 2025-04-10 Seungwon Lee , Yunxiao Chen , Xiaoou Li

The notion of concept drift refers to the phenomenon that the data generating distribution changes over time; as a consequence machine learning models may become inaccurate and need adjustment. In this paper we consider the problem of…

Machine Learning · Computer Science 2022-05-16 Fabian Hinder , André Artelt , Valerie Vaquet , Barbara Hammer

Mixture distributions are a workhorse model for multimodal data in information theory, signal processing, and machine learning. Yet even when each component density is simple, the differential entropy of the mixture is notoriously hard to…

Information Theory · Computer Science 2026-02-18 Namyoon Lee

We establish the convergence rates and asymptotic distributions of the common break change-point estimators, obtained by least squares and maximum likelihood in panel data models and compare their asymptotic variances. Our model assumptions…

Statistics Theory · Mathematics 2017-08-22 Monika Bhattacharjee , Moulinath Banerjee , George Michailidis

Bayesian change-point detection, together with latent variable models, allows to perform segmentation over high-dimensional time-series. We assume that change-points lie on a lower-dimensional manifold where we aim to infer subsets of…

Machine Learning · Statistics 2020-11-04 Lorena Romero-Medrano , Pablo Moreno-Muñoz , Antonio Artés-Rodríguez

Entropy is a measure of heterogeneity widely used in applied sciences, often when data are collected over space. Recently, a number of approaches has been proposed to include spatial information in entropy. The aim of entropy is to…

Statistics Theory · Mathematics 2019-11-12 Linda Altieri , Daniela Cocchi , Giulia Roli