English
Related papers

Related papers: Sparse Temporal Disaggregation

200 papers

This article introduces the sparse group fused lasso (SGFL) as a statistical framework for segmenting sparse regression models with multivariate time series. To compute solutions of the SGFL, a nonsmooth and nonseparable convex program, we…

Computation · Statistics 2020-10-09 David Degras

In this paper we present a novel algorithm and efficient data structure for anomaly detection based on temporal data. Time-series data are represented by a sequence of symbolic time intervals, describing increasing and decreasing trends, in…

Data Structures and Algorithms · Computer Science 2019-11-05 Roni Mateless , Michael Segal , Robert Moskovitch

Low-count time series describe sparse or intermittent events, which are prevalent in large-scale online platforms that capture and monitor diverse data types. Several distinct challenges surface when modelling low-count time series,…

Machine Learning · Computer Science 2023-11-21 Philipp Renz , Kurt Cutajar , Niall Twomey , Gavin K. C. Cheung , Hanting Xie

We present a stochastic model of population dynamics exploiting cross-sectional data in trend analysis and forecasts for groups and cohorts of a population. While sharing the convenient features of classic Markov models, it alleviates the…

Applications · Statistics 2017-06-20 Agnieszka Werpachowska , Roman Werpachowski

Gaussian processes (GPs) are important probabilistic tools for inference and learning in spatio-temporal modelling problems such as those in climate science and epidemiology. However, existing GP approximations do not simultaneously support…

Machine Learning · Computer Science 2021-06-21 Will Tebbutt , Arno Solin , Richard E. Turner

This paper proposes a fast and accurate method for sparse regression in the presence of missing data. The underlying statistical model encapsulates the low-dimensional structure of the incomplete data matrix and the sparsity of the…

Machine Learning · Statistics 2015-03-31 Ravi Ganti , Rebecca M. Willett

In this work, a method for unsupervised energy disaggregation in private households equipped with smart meters is proposed. This method aims to classify power consumption as active or passive, granting the ability to report on the…

Optimization and Control · Mathematics 2023-10-26 Christian Aarset , Andreas Habring , Martin Holler , Mario Mitter

sparseDFM is an R package for the implementation of popular estimation methods for dynamic factor models (DFMs) including the novel Sparse DFM approach of Mosley et al. (2023). The Sparse DFM ameliorates interpretability issues of factor…

Computation · Statistics 2023-03-27 Luke Mosley , Tak-Shing Chan , Alex Gibberd

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known efficient algorithm…

Methodology · Statistics 2022-11-14 Szymon Nowakowski , Piotr Pokarowski , Wojciech Rejchel , Agnieszka Sołtys

Today, huge amounts of data are being collected with spatial and temporal components from sources such as meteorological, satellite imagery etc. Efficient visualisation as well as discovery of useful knowledge from these datasets is…

Databases · Computer Science 2017-03-31 Nhien-An Le-Khac , Martin Bue , Michael Whelan , Tahar Kechadi

This work develops a block aggregation approach to spatial estimation and prediction when the response is observed at a coarse spatial scale, for example as counts of events in administrative areas, or blocks, while covariates are available…

The pseudo-marginal algorithm is a variant of the Metropolis--Hastings algorithm which samples asymptotically from a probability distribution when it is only possible to estimate unbiasedly an unnormalized version of its density.…

Computation · Statistics 2019-12-04 Sebastian M. Schmon , George Deligiannidis , Arnaud Doucet , Michael K. Pitt

Multivariate time series forecasting is widely applied in fields such as transportation, energy, and finance. However, the data commonly suffers from issues of multi-scale characteristics, weak correlations, and noise interference, which…

Machine Learning · Computer Science 2026-03-02 Xiang Ao

In order for clinicians to manage disease progression and make effective decisions about drug dosage, treatment regimens or scheduling follow up appointments, it is necessary to be able to identify both short and long-term trends in…

Quantitative Methods · Quantitative Biology 2016-12-06 Norman Poh , Simon Bull , Santosh Tirunagari , Nicholas Cole , Simon de Lusignan

We consider the estimation of a common period for a set of functions sampled at irregular intervals. The problem arises in astronomy, where the functions represent a star's brightness observed over time through different photometric…

Applications · Statistics 2016-04-15 James P. Long , Eric C. Chi , Richard G. Baraniuk

Sparse principal component analysis (SPCA) has emerged as a powerful technique for modern data analysis, providing improved interpretation of low-rank structures by identifying localized spatial structures in the data and disambiguating…

Quantitative analysis of large-scale data is often complicated by the presence of diverse subgroups, which reduce the accuracy of inferences they make on held-out data. To address the challenge of heterogeneous data analysis, we introduce…

Machine Learning · Computer Science 2021-09-01 Nazanin Alipourfard , Keith Burghardt , Kristina Lerman

Large and acute economic shocks such as the 2007-2009 financial crisis and the current COVID-19 infections rapidly change the economic environment. In such a situation, the importance of real-time economic analysis using alternative datais…

Machine Learning · Computer Science 2021-05-21 Takamichi Toda , Daisuke Moriwaki , Kazuhiro Ota

Disaggregation regression has become an important tool in spatial disease mapping for making fine-scale predictions of disease risk from aggregated response data. By including high resolution covariate information and modelling the data…

Applications · Statistics 2020-05-08 Rohan Arambepola , Tim C D Lucas , Anita K Nandi , Peter W Gething , Ewan Cameron

This paper addresses the problem of expressing a signal as a sum of frequency components (sinusoids) wherein each sinusoid may exhibit abrupt changes in its amplitude and/or phase. The Fourier transform of a narrow-band signal, with a…

Machine Learning · Computer Science 2013-02-27 Yin Ding , Ivan W. Selesnick