English
Related papers

Related papers: Estimation of large approximate dynamic matrix fac…

200 papers

Matrix factor model is drawing growing attention for simultaneous two-way dimension reduction of well-structured matrix-valued observations. This paper focuses on robust statistical inference for matrix factor model in the ``diverging…

Methodology · Statistics 2023-06-07 Yong He , Xin-Bing Kong , Dong Liu , Ran Zhao

Large-scale distributed systems such as sensor networks, often need to achieve filtering and consensus on an estimated parameter from high-dimensional measurements. Running a Kalman filter on every node in such a network is computationally…

Optimization and Control · Mathematics 2017-04-12 Mathias Hudoba de Badyn , Mehran Mesbahi

Data assimilation is an iterative approach to the problem of estimating the state of a dynamical system using both current and past observations of the system together with a model for the system's time evolution. Rather than solving the…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Brian R. Hunt , Eric J. Kostelich , Istvan Szunyogh

We propose an efficient online approximate Bayesian inference algorithm for estimating the parameters of a nonlinear function from a potentially non-stationary data stream. The method is based on the extended Kalman filter (EKF), but uses a…

Machine Learning · Statistics 2023-06-29 Peter G. Chang , Gerardo Durán-Martín , Alexander Y Shestopaloff , Matt Jones , Kevin Murphy

A new approach for feature extraction from time series is proposed in this paper. This approach consists of a specific regression model incorporating a discrete hidden logistic process. The model parameters are estimated by the maximum…

Methodology · Statistics 2013-12-30 Faicel Chamroukhi , Allou Samé , Gérard Govaert , Patrice Aknin

In this work, we propose a new estimation method of a Structural Equation Model. Our method is based on the EM likelihood-maximization algorithm. We show that this method provides estimators, not only of the coefficients of the model, but…

Statistics Theory · Mathematics 2015-10-02 Xavier Bry , Christian Lavergne , Myriam Tami

We consider the problem of state estimation in dynamical systems and propose a different mechanism for handling unmodeled system uncertainties. Instead of injecting random process noise, we assign different weights to measurements so that…

Information Theory · Computer Science 2020-09-08 Yaron Shulami , Daniel Sigalov

Finite mixture models have been widely used for the modelling and analysis of data from heterogeneous populations. Maximum likelihood estimation of the parameters is typically carried out via the Expectation-Maximization (EM) algorithm. The…

Computation · Statistics 2016-06-08 Sharon X Lee , Kaleb L Lee , Geoffrey J McLachlan

This paper considers the Linear Minimum Variance recursive state estimation for the linear discrete time dynamic system with random state transition and measurement matrices, i.e., random parameter matrices Kalman filtering. It is shown…

Information Theory · Computer Science 2007-07-13 Dandan Luo , Yunmin Zhu

We consider efficient estimation of flexible transformation models with interval-censored data. To reduce the dimension of semi-parametric models, the unknown monotone transformation function is approximated via monotone splines. A…

Methodology · Statistics 2019-12-30 Minggen Lu , Yan Liu , Chin-Shang Li , Jianguo Sun

Models for recommender systems use latent factors to explain the preferences and behaviors of users with respect to a set of items (e.g., movies, books, academic papers). Typically, the latent factors are assumed to be static and, given…

Machine Learning · Computer Science 2015-09-16 Laurent Charlin , Rajesh Ranganath , James McInerney , David M. Blei

Kappa distributions are widely used in space plasma physics to model velocity distribution functions with heavy tails. Parameter estimation in these distributions is, however, complicated by the fact that the kappa distribution does not…

Methodology · Statistics 2026-05-25 Leonardo Herrera-Fuenzalida , Sergio Davis

sparseDFM is an R package for the implementation of popular estimation methods for dynamic factor models (DFMs) including the novel Sparse DFM approach of Mosley et al. (2023). The Sparse DFM ameliorates interpretability issues of factor…

Computation · Statistics 2023-03-27 Luke Mosley , Tak-Shing Chan , Alex Gibberd

For modelling geophysical systems, large-scale processes are described through a set of coarse-grained dynamical equations while small-scale processes are represented via parameterizations. This work proposes a method for identifying the…

Atmospheric and Oceanic Physics · Physics 2018-08-01 Manuel Pulido , Pierre Tandeo , Marc Bocquet , Alberto Carrassi , Magdalena Lucini

We propose a confirmatory dynamic factor model for a large number of stocks whose returns are observed daily across multiple time zones. The model has a global factor and a continental factor that both drive the individual stock return…

Statistics Theory · Mathematics 2025-02-25 Oliver B. Linton , Haihan Tang , Jianbin Wu

In this paper we consider the behavior of Kalman Filter state estimates in the case of distribution with heavy tails .The simulated linear state space models with Gaussian measurement noises were used. Gaussian noises in state equation are…

Statistics Theory · Mathematics 2015-12-08 Valentin Konakov , Pavel Mozgunov

The problem of system identification for the Kalman filter, relying on the expectation-maximization (EM) procedure to learn the underlying parameters of a dynamical system, has largely been studied assuming that observations are sampled at…

Machine Learning · Computer Science 2024-06-28 Peter Halmos , Jonathan Pillow , David A. Knowles

This paper deals with the estimation of the hidden factor in Dynamic Generalized Factor Analysis via a generalization of Kalman filtering. Asymptotic consistency is discussed and it is shown that the Kalman one-step predictor is not the…

Statistics Theory · Mathematics 2022-11-24 Giorgio Picci , Lucia Falconi , Augusto Ferrante , Mattia Zorzi

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

This paper proposes a data-adaptive factor model (DAFM), a novel framework for extracting common factors that explain the structures of high-dimensional data. DAFM adopts a composite quantile strategy to adaptively capture the full…

Methodology · Statistics 2025-10-02 Seeun Park , Hee-Seok Oh