English
Related papers

Related papers: Change Point Detection in Software Performance Tes…

200 papers

We consider a popular online change-point problem of detecting a transient change in distributions of i.i.d. random variables. For this change-point problem, several change-point procedures are formulated and some advanced results for a…

Statistics Theory · Mathematics 2021-04-08 Jack Noonan

Change point estimation in its offline version is traditionally performed by optimizing over the data set of interest, by considering each data point as the true location parameter and computing a data fit criterion. Subsequently, the data…

Methodology · Statistics 2020-04-10 Zhiyuan Lu , Moulinath Banerjee , George Michailidis

We propose a novel change-point detection method based on online Dynamic Mode Decomposition with control (ODMDwC). Leveraging ODMDwC's ability to find and track linear approximation of a non-linear system while incorporating control…

Artificial Intelligence · Computer Science 2024-08-20 Marek Wadinger , Michal Kvasnica , Yoshinobu Kawahara

In this paper, we consider the problem of (multiple) change-point detection in panel data. We propose the double CUSUM statistic which utilises the cross-sectional change-point structure by examining the cumulative sums of ordered CUSUMs at…

Methodology · Statistics 2016-11-29 Haeran Cho

Software performance changes are costly and often hard to detect pre-release. Similar to software testing frameworks, either application benchmarks or microbenchmarks can be integrated into quality assurance pipelines to detect performance…

Performance · Computer Science 2022-12-20 Martin Grambow , Denis Kovalev , Christoph Laaber , Philipp Leitner , David Bermbach

The problem of change-point estimation is considered under a general framework where the data are generated by unknown stationary ergodic process distributions. In this context, the consistent estimation of the number of change-points is…

Machine Learning · Statistics 2013-02-15 Azaden Khaleghi , Daniil Ryabko

Software quality is one of the essential aspects of a software. With increasing demand, software designs are becoming more complex, increasing the probability of software defects. Testers improve the quality of software by fixing defects.…

Software Engineering · Computer Science 2020-11-18 Mitt Shah , Nandit Pujara

In this paper the problem of retrospective change-point detection and estimation in multivariate linear models is considered. The lower bounds for the error of change-point estimation are proved in different cases (one change-point:…

Statistics Theory · Mathematics 2011-10-27 Boris Brodsky , Boris Darkhovsky

It is quite common that the structure of a time series changes abruptly. Identifying these change points and describing the model structure in the segments between these change points is of interest. In this paper, time series data is…

Computation · Statistics 2019-12-18 Lijing Ma , Andrew Grant , Georgy Sofronov

Structural changes occur in dynamic networks quite frequently and its detection is an important question in many situations such as fraud detection or cybersecurity. Real-life networks are often incompletely observed due to individual…

Statistics Theory · Mathematics 2025-03-14 Farida Enikeeva , Olga Klopp

Many industrial and security applications employ a suite of sensors for detecting abrupt changes in temporal behavior patterns. These abrupt changes typically manifest locally, rendering only a small subset of sensors informative.…

Machine Learning · Computer Science 2023-06-14 Aditya Gopalan , Venkatesh Saligrama , Braghadeesh Lakshminarayanan

Business processes are continuously evolving in order to adapt to changes due to various factors. One type of process changes are branching frequency changes, which are related to changes in frequencies between different options when there…

Information Retrieval · Computer Science 2021-06-25 Yang Lu , Qifan Chen , Simon Poon

When a predictive model is in production, it must be monitored in real-time to ensure that its performance does not suffer due to drift or abrupt changes to data. Ideally, this is done long before learning that the performance of the model…

We propose a novel approach for change-point detection and parameter learning in multivariate non-stationary time series exhibiting oscillatory behaviour. We approximate the process through a piecewise function defined by a sum of…

Methodology · Statistics 2026-02-02 Nicolas Bianco , Lorenzo Cappello

Change point detection becomes more and more important as datasets increase in size, where unsupervised detection algorithms can help users process data. To detect change points, a number of unsupervised algorithms have been developed which…

Numerical Analysis · Mathematics 2021-06-18 Rebecca Gedda , Larisa Beilina , Ruomu Tan

Change point detection plays a fundamental role in many real-world applications, where the goal is to analyze and monitor the behaviour of a data stream. In this paper, we study change detection in binary streams. To this end, we use a…

Machine Learning · Computer Science 2023-01-24 Nikolaj Tatti

This paper is concerned with the detection of multiple change-points in the joint distribution of independent categorical variables. The procedures introduced rely on model selection and are based on a penalized least-squares criterion.…

Statistics Theory · Mathematics 2008-01-08 Nathalie Akakpo

The continuous evolution of software projects necessitates the implementation of changes to enhance performance and reduce defects. This research explores effective strategies for learning and implementing useful changes in software…

Software Engineering · Computer Science 2025-04-18 Kartik Gupta

Classifier predictions often rely on the assumption that new observations come from the same distribution as training data. When the underlying distribution changes, so does the optimal classification rule, and performance may degrade. We…

Methodology · Statistics 2021-09-01 Ciaran Evans , Max G'Sell

Autoregressive models capture stochastic processes in which past realizations determine the generative distribution of new data; they arise naturally in a variety of industrial, biomedical, and financial settings. A key challenge when…

Statistics Theory · Mathematics 2020-07-30 Daren Wang , Yi Yu , Alessandro Rinaldo , Rebecca Willett