English
Related papers

Related papers: A pruned dynamic programming algorithm to recover …

200 papers

In the multiple changepoint setting, various search methods have been proposed which involve optimising either a constrained or penalised cost function over possible numbers and locations of changepoints using dynamic programming. Such…

Computation · Statistics 2014-12-12 Kaylea Haynes , Idris A. Eckley , Paul Fearnhead

There is an increasing need for algorithms that can accurately detect changepoints in long time-series, or equivalent, data. Many common approaches to detecting changepoints, for example based on penalised likelihood or minimum description…

Methodology · Statistics 2014-09-08 Robert Maidstone , Toby Hocking , Guillem Rigaill , Paul Fearnhead

We propose a novel algorithm for combined unit and layer pruning of deep neural networks that functions during training and without requiring a pre-trained network to apply. Our algorithm optimally trades-off learning accuracy and pruning…

Machine Learning · Computer Science 2025-07-17 Valentin Frank Ingmar Guenter , Athanasios Sideris

In this paper we build on an approach proposed by Zou et al. (2014) for nonpara- metric changepoint detection. This approach defines the best segmentation for a data set as the one which minimises a penalised cost function, with the cost…

Computation · Statistics 2016-02-04 Kaylea Haynes , Paul Fearnhead , Idris A. Eckley

We consider the problem of detecting change-points in univariate time series by fitting a continuous piecewise linear signal using the residual sum of squares. Values of the inferred signal at slope breaks are restricted to a finite set of…

Computation · Statistics 2022-04-08 Vincent Runge , Marco Pascucci , Nicolas Deschamps de Boishebert

Binary segmentation is the classic greedy algorithm which recursively splits a sequential data set by optimizing some loss or likelihood function. Binary segmentation is widely used for changepoint detection in data sets measured over space…

Machine Learning · Computer Science 2024-10-14 Toby Dylan Hocking

Many offline unsupervised change point detection algorithms rely on minimizing a penalized sum of segment-wise costs. We extend this framework by proposing to minimize a sum of discrepancies between segments. In particular, we propose to…

Machine Learning · Computer Science 2020-09-04 Aurélien Serre , Didier Chételat , Andrea Lodi

Algorithms often carry out equally many computations for "easy" and "hard" problem instances. In particular, algorithms for finding nearest neighbors typically have the same running time regardless of the particular problem instance. In…

Data Structures and Algorithms · Computer Science 2020-03-25 Daniel LeJeune , Richard G. Baraniuk , Reinhard Heckel

We focus in this paper on dataset reduction techniques for use in k-nearest neighbor classification. In such a context, feature and prototype selections have always been independently treated by the standard storage reduction algorithms.…

Machine Learning · Computer Science 2013-01-18 Marc Sebban , Richard Nock

We consider the problem of detecting multiple changepoints in large data sets. Our focus is on applications where the number of changepoints will increase as we collect more data: for example in genetics as we analyse larger regions of the…

Methodology · Statistics 2015-03-17 R. Killick , P. Fearnhead , I. A. Eckley

How to develop slim and accurate deep neural networks has become crucial for real- world applications, especially for those employed in embedded systems. Though previous work along this research line has shown some promising results, most…

Neural and Evolutionary Computing · Computer Science 2019-10-02 Xin Dong , Shangyu Chen , Sinno Jialin Pan

We consider the problem of detecting multiple changes in multiple independent time series. The search for the best segmentation can be expressed as a minimization problem over a given cost function. We focus on dynamic programming…

Methodology · Statistics 2024-05-20 Liudmila Pishchagina , Guillem Rigaill , Vincent Runge

It is common to encounter situations where one must solve a sequence of similar computational problems. Running a standard algorithm with worst-case runtime guarantees on each instance will fail to take advantage of valuable structure…

Machine Learning · Computer Science 2019-04-29 Daniel Alabi , Adam Tauman Kalai , Katrina Ligett , Cameron Musco , Christos Tzamos , Ellen Vitercik

We present a comprehensive classical and parameterized complexity analysis of decision tree pruning operations, extending recent research on the complexity of learning small decision trees. Thereby, we offer new insights into the…

Machine Learning · Computer Science 2025-03-06 Juha Harviainen , Frank Sommer , Manuel Sorge , Stefan Szeider

Current methods for pruning neural network weights iteratively apply magnitude-based pruning on the model weights and re-train the resulting model to recover lost accuracy. In this work, we show that such strategies do not allow for the…

Machine Learning · Computer Science 2022-02-04 Suraj Srinivas , Andrey Kuzmin , Markus Nagel , Mart van Baalen , Andrii Skliar , Tijmen Blankevoort

Modern deep neural network models are large and computationally intensive. One typical solution to this issue is model pruning. However, most current pruning algorithms depend on hand crafted rules or domain expertise. To overcome this…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Baopu Li , Yanwen Fan , Zhihong Pan , Gang Zhang

Many learning algorithms are formulated in terms of finding model parameters which minimize a data-fitting loss function plus a regularizer. When the regularizer involves the l0 pseudo-norm, the resulting regularization path consists of a…

Machine Learning · Computer Science 2020-03-06 Toby Hocking , Joseph Vargovich

A very simple example of an algorithmic problem solvable by dynamic programming is to maximize, over sets A in {1,2,...,n}, the objective function |A| - \sum_i \xi_i 1(i \in A,i+1 \in A) for given \xi_i > 0. This problem, with random…

Probability · Mathematics 2007-10-04 David J. Aldous , Charles Bordenave , Marc Lelarge

Nowadays, it is still difficult to adapt Convolutional Neural Network (CNN) based models for deployment on embedded devices. The heavy computation and large memory footprint of CNN models become the main burden in real application. In this…

Computer Vision and Pattern Recognition · Computer Science 2017-08-09 Xin Li , Changsong Liu

In this paper, we study the problem of multiple change-point detection for a univariate sequence under the epidemic setting, where the behavior of the sequence alternates between a common normal state and different epidemic states. This is…

Methodology · Statistics 2021-01-07 Zifeng Zhao , Chun Yip Yau
‹ Prev 1 2 3 10 Next ›