English
Related papers

Related papers: Model-based clustering with Hidden Markov Model re…

200 papers

Modern data-driven and distributed learning frameworks deal with diverse massive data generated by clients spread across heterogeneous environments. Indeed, data heterogeneity is a major bottleneck in scaling up many distributed learning…

Machine Learning · Computer Science 2023-08-23 Amirhossein Reisizadeh , Khashayar Gatmiry , Asuman Ozdaglar

We introduce a novel statistical significance-based approach for clustering hierarchical data using semi-parametric linear mixed-effects models designed for responses with laws in the exponential family (e.g., Poisson and Bernoulli). Within…

Methodology · Statistics 2025-02-04 Alessandra Ragni , Chiara Masci , Francesca Ieva , Anna Maria Paganoni

Time series subject to change in regime have attracted much interest in domains such as econometry, finance or meteorology. For discrete-valued regimes, some models such as the popular Hidden Markov Chain (HMC) describe time series whose…

Machine Learning · Computer Science 2021-02-26 Fatoumata Dama , Christine Sinoquet

Grouping observations into homogeneous groups is a recurrent task in statistical data analysis. We consider Gaussian Mixture Models, which are the most famous parametric model-based clustering method. We propose a new robust approach for…

Methodology · Statistics 2022-11-16 Antoine Godichon-Baggioni , Stéphane Robin

Time series forecasting has gained lots of attention recently; this is because many real-world phenomena can be modeled as time series. The massive volume of data and recent advancements in the processing power of the computers enable…

Machine Learning · Computer Science 2021-04-01 Manie Tadayon , Yumi Iwashita

A general framework for dealing with both linear regression and clustering problems is described. It includes Gaussian clusterwise linear regression analysis with random covariates and cluster analysis via Gaussian mixture models with…

Methodology · Statistics 2015-10-13 Giuliano Galimberti , Annamaria Manisi , Gabriele Soffritti

A new approach for feature extraction from time series is proposed in this paper. This approach consists of a specific regression model incorporating a discrete hidden logistic process. The model parameters are estimated by the maximum…

Methodology · Statistics 2013-12-30 Faicel Chamroukhi , Allou Samé , Gérard Govaert , Patrice Aknin

We present an approach to clustering time series data using a model-based generalization of the K-Means algorithm which we call K-Models. We prove the convergence of this general algorithm and relate it to the hard-EM algorithm for mixture…

Methodology · Statistics 2022-07-04 Derek O. Hoare , David S. Matteson , Martin T. Wells

In this paper we present a family of algorithms that can simultaneously align and cluster sets of multidimensional curves measured on a discrete time grid. Our approach is based on a generative mixture model that allows non-linear time…

Applications · Statistics 2012-12-12 Darya Chudova , Scott Gaffney , Padhraic Smyth

We describe a network clustering framework, based on finite mixture models, that can be applied to discrete-valued networks with hundreds of thousands of nodes and billions of edge variables. Relative to other recent model-based clustering…

Computation · Statistics 2020-03-13 Duy Q. Vu , David R. Hunter , Michael Schweinberger

Mixture Markov Model (MMM) is a widely used tool to cluster sequences of events coming from a finite state-space. However the MMM likelihood being multi-modal, the challenge remains in its maximization. Although Expectation-Maximization…

Optimization and Control · Mathematics 2026-04-16 Priyam Das , Deborshee Sen , Debsurya De , Jue Hou , Zahra S. H. Abad , Nicole Kim , Zongqi Xia , Tianxi Cai

We propose two approaches for selecting variables in latent class analysis (i.e.,mixture model assuming within component independence), which is the common model-based clustering method for mixed data. The first approach consists in…

Computation · Statistics 2017-03-08 Matthieu Marbac , Mohammed Sedki

Neural networks are widely used in machine learning and data mining. Typically, these networks need to be trained, implying the adjustment of weights (parameters) within the network based on the input data. In this work, we propose a novel…

Machine Learning · Computer Science 2024-08-20 Xiaosheng Li , Wenjie Xi , Jessica Lin

Through Ecological Momentary Assessment (EMA) studies, a number of time-series data is collected across multiple individuals, continuously monitoring various items of emotional behavior. Such complex data is commonly analyzed in an…

Machine Learning · Computer Science 2023-10-12 Mandani Ntekouli , Gerasimos Spanakis , Lourens Waldorp , Anne Roefs

We propose a new unsupervised learning method for clustering a large number of time series based on a latent factor structure. Each cluster is characterized by its own cluster-specific factors in addition to some common factors which impact…

Statistics Theory · Mathematics 2022-09-09 Bo Zhang , Guangming Pan , Qiwei Yao , Wang Zhou

With large quantities of data typically available nowadays, forecasting models that are trained across sets of time series, known as Global Forecasting Models (GFM), are regularly outperforming traditional univariate forecasting models that…

Machine Learning · Computer Science 2021-09-22 Rakshitha Godahewa , Kasun Bandara , Geoffrey I. Webb , Slawek Smyl , Christoph Bergmeir

We introduce a novel class of Bayesian mixtures for normal linear regression models which incorporates a further Gaussian random component for the distribution of the predictor variables. The proposed cluster-weighted model aims to…

Methodology · Statistics 2026-05-26 Panagiotis Papastamoulis , Konstantinos Perrakis

The Expectation-Maximization (EM) algorithm is one of the most popular methods used to solve the problem of parametric distribution-based clustering in unsupervised learning. In this paper, we propose to analyze a generalized EM (GEM)…

Optimization and Control · Mathematics 2021-05-19 Sarthak Chatterjee , Orlando Romero , Sérgio Pequito

Mixture of autoregressions (MoAR) models provide a model-based approach to the clustering of time series data. The maximum likelihood (ML) estimation of MoAR models requires the evaluation of products of large numbers of densities of normal…

Computation · Statistics 2016-10-19 Hien D Nguyen , Geoffrey J McLachlan , Pierre Orban , Pierre Bellec , Andrew L Janke

Subsequence clustering of multivariate time series is a useful tool for discovering repeated patterns in temporal data. Once these patterns have been discovered, seemingly complicated datasets can be interpreted as a temporal sequence of…

Machine Learning · Computer Science 2018-05-16 David Hallac , Sagar Vare , Stephen Boyd , Jure Leskovec