English
Related papers

Related papers: On scalable ARMA models

200 papers

Alternating Minimization is a widely used and empirically successful heuristic for matrix completion and related low-rank optimization problems. Theoretical guarantees for Alternating Minimization have been hard to come by and are still…

Machine Learning · Computer Science 2014-05-15 Moritz Hardt

While matrix variate regression models have been studied in many existing works, classical statistical and computational methods for the analysis of the regression coefficient estimation are highly affected by high dimensional and noisy…

Machine Learning · Statistics 2022-05-17 Hsin-Hsiung Huang , Feng Yu , Xing Fan , Teng Zhang

The problem of finding sparse solutions to underdetermined systems of linear equations arises in several applications (e.g. signal and image processing, compressive sensing, statistical inference). A standard tool for dealing with sparse…

Optimization and Control · Mathematics 2016-08-03 Marianna De Santis , Stefano Lucidi , Francesco Rinaldi

We develop a new efficient algorithm for the analysis of large-scale time series data. We firstly define rolling averages, derive their analytical properties, and establish their asymptotic distribution. These theoretical results are…

Methodology · Statistics 2022-12-26 Ali Eshragh , Glen Livingston , Thomas McCarthy McCann , Luke Yerbury

This article considers stochastic algorithms for efficiently solving a class of large scale non-linear least squares (NLS) problems which frequently arise in applications. We propose eight variants of a practical randomized algorithm where…

Numerical Analysis · Mathematics 2015-01-27 Farbod Roosta-Khorasani , Gábor J. Székely , Uri Ascher

We utilise a sampler originating from nonequilibrium statistical mechanics, termed here Jarzynski-adjusted Langevin algorithm (JALA), to build statistical estimation methods in latent variable models. We achieve this by leveraging…

Computation · Statistics 2025-10-27 James Cuin , Davide Carbone , O. Deniz Akyildiz

The extremal index $\theta$, a measure of the degree of local dependence in the extremes of a stationary process, plays an important role in extreme value analyses. We estimate $\theta$ semiparametrically, using the relationship between the…

Methodology · Statistics 2016-06-02 Paul J. Northrop

Switching ARMA models greatly enhance the standard linear models to the extent that different ARMA model is allowed in a different regime, and the regime switching is typically assumed a Markov chain on the finite states of potential…

Statistics Theory · Mathematics 2007-06-13 Gopal K. Basak , Zhan-Qian Lu

Latent class model (LCM), which is a finite mixture of different categorical distributions, is one of the most widely used models in statistics and machine learning fields. Because of its non-continuous nature and the flexibility in shape,…

Machine Learning · Statistics 2021-03-23 Hao Chen , Lanshan Han , Alvin Lim

Stochastic gradient algorithms are more and more studied since they can deal efficiently and online with large samples in high dimensional spaces. In this paper, we first establish a Central Limit Theorem for these estimates as well as for…

Statistics Theory · Mathematics 2017-10-17 Antoine Godichon-Baggioni

We present QARMA, an efficient novel parallel algorithm for mining all Quantitative Association Rules in large multidimensional datasets where items are required to have at least a single common attribute to be specified in the rules single…

Artificial Intelligence · Computer Science 2018-04-19 Ioannis T. Christou , Emmanouil Amolochitis , Zheng-Hua Tan

A new maximum approximate likelihood (ML) estimation algorithm for the mixture of Kent distribution is proposed. The new algorithm is constructed via the BSLM (block successive lower-bound maximization) framework and incorporates manifold…

Computation · Statistics 2017-09-15 Hien D. Nguyen

Latent variable models represent a useful tool for the analysis of complex data when the constructs of interest are not observable. A problem related to these models is that the integrals involved in the likelihood function cannot be solved…

Methodology · Statistics 2015-03-05 Silvia Bianconcini , Silvia Cagnone , Dimitris Rizopoulos

The matrix factor model has drawn growing attention for its advantage in achieving two-directional dimension reduction simultaneously for matrix-structured observations. In this paper, we propose a simple iterative least squares algorithm…

Methodology · Statistics 2023-08-02 Yong He , Ran Zhao , Wen-Xin Zhou

Sharpness-aware minimization (SAM), which searches for flat minima by min-max optimization, has been shown to be useful in improving model generalization. However, since each SAM update requires computing two gradients, its computational…

Machine Learning · Computer Science 2023-05-01 Weisen Jiang , Hansi Yang , Yu Zhang , James Kwok

A trigonometrically approximated maximum likelihood estimation for $\alpha$-stable laws is proposed. The estimator solves the approximated likelihood equation, which is obtained by projecting a true score function on the space spanned by…

Statistics Theory · Mathematics 2022-09-20 Muneya Matsui , Naoya Sueishi

In this paper, we propose a novel and efficient two-stage variable selection approach for sparse GLARMA models, which are pervasive for modeling discrete-valued time series. Our approach consists in iteratively combining the estimation of…

Methodology · Statistics 2022-08-31 Marina Gomtsyan , Céline Lévy-Leduc , Sarah Ouadah , Laure Sansonnet , Thomas Blein

We propose to address the common problem of linear estimation in linear statistical models by using a model selection approach via penalization. Depending then on the framework in which the linear statistical model is considered namely the…

Statistics Theory · Mathematics 2009-09-11 Ikhlef Bechar

We consider the problem of estimating the parameters of a linear univariate autoregressive model with sub-Gaussian innovations from a limited sequence of consecutive observations. Assuming that the parameters are compressible, we analyze…

Information Theory · Computer Science 2017-04-05 Abbas Kazemipour , Sina Miran , Piya Pal , Behtash Babadi , Min Wu

In this paper, we develop a robust non-parametric realized integrated beta estimator using high-frequency financial data contaminated by microstructure noises, which is robust to the stylized features, such as the time-varying beta and the…

Methodology · Statistics 2024-09-04 Minseog Oh , Donggyu Kim , Yazhen Wang