English
Related papers

Related papers: Estimation of large approximate dynamic matrix fac…

200 papers

We study a general factor analysis framework where the $n$-by-$p$ data matrix is assumed to follow a general exponential family distribution entry-wise. While this model framework has been proposed before, we here further relax its…

Methodology · Statistics 2025-12-02 Liang Wang , Luis Carvalho

In an effort to develop topic modeling methods that can be quickly applied to large data sets, we revisit the problem of maximum-likelihood estimation in topic models. It is known, at least informally, that maximum-likelihood estimation in…

Machine Learning · Statistics 2026-02-10 Peter Carbonetto , Abhishek Sarkar , Zihao Wang , Matthew Stephens

We propose a new class of filtering and smoothing methods for inference in high-dimensional, nonlinear, non-Gaussian, spatio-temporal state-space models. The main idea is to combine the ensemble Kalman filter and smoother, developed in the…

Methodology · Statistics 2019-03-22 Matthias Katzfuss , Jonathan R. Stroud , Christopher K. Wikle

The intricate dynamics of stock markets have led to extensive research on models that are able to effectively explain their inherent complexities. This study leverages the econometrics literature to explore the dynamic factor model as an…

Statistical Finance · Quantitative Finance 2026-01-09 Brian Godwin Lim , Dominic Dayta , Benedict Ryan Tiu , Renzo Roel Tan , Len Patrick Dominic Garces , Kazushi Ikeda

In this paper, we consider the nonstationary matrix-valued time series with common stochastic trends. Unlike the traditional factor analysis which flattens matrix observations into vectors, we adopt a matrix factor model in order to fully…

Econometrics · Economics 2025-08-25 Degui Li , Yayi Yan , Qiwei Yao

We rigorously derive novel error bounds for extended dynamic mode decomposition (EDMD) to approximate the Koopman operator for discrete- and continuous time (stochastic) systems; both for i.i.d. and ergodic sampling under non-restrictive…

Finite mixtures of matrix normal distributions are a powerful tool for classifying three-way data in unsupervised problems. The distribution of each component is assumed to be a matrix variate normal density. The mixture model can be…

Methodology · Statistics 2013-03-07 Cinzia Viroli

We develop a general framework for proving rigorous guarantees on the performance of the EM algorithm and a variant known as gradient EM. Our analysis is divided into two parts: a treatment of these algorithms at the population level (in…

Statistics Theory · Mathematics 2014-08-12 Sivaraman Balakrishnan , Martin J. Wainwright , Bin Yu

We look at a stochastic time-varying optimization problem and we formulate online algorithms to find and track its optimizers in expectation. The algorithms are derived from the intuition that standard prediction and correction steps can be…

Optimization and Control · Mathematics 2024-04-11 Andrea Simonetto , Paolo Massioni

Regression analysis with missing data is a long-standing and challenging problem, particularly when there are many missing variables with arbitrary missing patterns. Likelihood-based methods, although theoretically appealing, are often…

Methodology · Statistics 2024-10-16 Ngok Sang Kwok , Kin Yau Wong

We study the Extended Kalman Filter in constant dynamics, offering a bayesian perspective of stochastic optimization. We obtain high probability bounds on the cumulative excess risk in an unconstrained setting. In order to avoid any…

Machine Learning · Computer Science 2020-06-29 Joseph de Vilmarest , Olivier Wintenberger

Deep directed generative models have attracted much attention recently due to their expressive representation power and the ability of ancestral sampling. One major difficulty of learning directed models with many latent variables is the…

Machine Learning · Computer Science 2015-06-16 Siqi Nie , Qiang Ji

Probit models are useful for modeling correlated discrete responses in many disciplines, including consumer choice data in economics and marketing. However, the Gaussian latent variable feature of probit models coupled with identification…

Methodology · Statistics 2024-09-30 Patrick Ding , Guido Imbens , Zhaonan Qu , Yinyu Ye

The use of state estimation technique offers a means of inferring the rotor-effective wind speed based upon solely standard measurements of the turbine. For the ease of design and computational concerns, such estimators are typically built…

Systems and Control · Electrical Eng. & Systems 2021-07-01 Wai Hou Lio , Fanzhong Meng

Data can be assumed to be continuous functions defined on an infinite-dimensional space for many phenomena. However, the infinite-dimensional data might be driven by a small number of latent variables. Hence, factor models are relevant for…

Methodology · Statistics 2022-05-18 Israel Martínez-Hernández , Jesús Gonzalo , Graciela González-Farías

Accurate estimation and prediction of trajectory is essential for the capture of any high speed target. In this paper, an extended Kalman filter (EKF) is used to track the target in the first loop of the trajectory to collect data points…

Estimation of the covariance matrix of asset returns from high frequency data is complicated by asynchronous returns, market mi- crostructure noise and jumps. One technique for addressing both asynchronous returns and market microstructure…

Statistical Finance · Quantitative Finance 2019-02-19 Michael Ho , Jack Xin

We face the factor analysis problem using a particular class of auto-regressive processes. We propose an approximate moment matching approach to estimate the number of factors as well as the parameters of the model. This algorithm…

Optimization and Control · Mathematics 2020-09-08 Francesca Crescente , Lucia Falconi , Federica Rozzi , Augusto Ferrante , Mattia Zorzi

In this paper we formulate the nonnegative matrix factorisation (NMF) problem as a maximum likelihood estimation problem for hidden Markov models and propose online expectation-maximisation (EM) algorithms to estimate the NMF and the other…

Machine Learning · Computer Science 2014-01-14 Sinan Yildirim , A. Taylan Cemgil , Sumeetpal S. Singh

Expectation maximization (EM) is a technique for estimating maximum-likelihood parameters of a latent variable model given observed data by alternating between taking expectations of sufficient statistics, and maximizing the expected log…

Methodology · Statistics 2018-07-10 Donna Henderson , Gerton Lunter