English
Related papers

Related papers: Time Series Graphical Lasso and Sparse VAR Estimat…

200 papers

We introduce the spike-and-slab group lasso (SSGL) for Bayesian estimation and variable selection in linear regression with grouped variables. We further extend the SSGL to sparse generalized additive models (GAMs), thereby introducing the…

Methodology · Statistics 2020-07-29 Ray Bai , Gemma E. Moran , Joseph Antonelli , Yong Chen , Mary R. Boland

We propose a multiscale approach to time series autoregression, in which linear regressors for the process in question include features of its own path that live on multiple timescales. We take these multiscale features to be the recent…

Methodology · Statistics 2024-12-17 Rafal Baranowski , Yining Chen , Piotr Fryzlewicz

In this paper, we propose a novel and efficient two-stage variable selection approach for sparse GLARMA models, which are pervasive for modeling discrete-valued time series. Our approach consists in iteratively combining the estimation of…

Methodology · Statistics 2022-08-31 Marina Gomtsyan , Céline Lévy-Leduc , Sarah Ouadah , Laure Sansonnet , Thomas Blein

Local projection (LP) and structural vector autoregression (SVAR) are commonly employed to estimate dynamic causal effects of macroeconomic policies at multiple horizons. With enough lags as controls, LP estimators have little bias but…

Econometrics · Economics 2026-03-03 Aleksei Nemtyrev , Otilia Boldea

The sparse precision matrix plays an essential role in the Gaussian graphical model since a zero off-diagonal element indicates conditional independence of the corresponding two variables given others. In the Gaussian graphical model, many…

Computation · Statistics 2022-03-30 Seunghwan Lee , Sang Cheol Kim , Donghyeon Yu

Learned sparse retrieval (LSR) is a family of neural methods that encode queries and documents into sparse lexical vectors that can be indexed and retrieved efficiently with an inverted index. We explore the application of LSR to the…

Information Retrieval · Computer Science 2024-02-28 Thong Nguyen , Mariya Hendriksen , Andrew Yates , Maarten de Rijke

The central problem we address in this work is estimation of the parameter support set S, the set of indices corresponding to nonzero parameters, in the context of a sparse parametric likelihood model for discrete multivariate time series.…

Methodology · Statistics 2025-03-07 Trevor D. Ruiz , Sharmodeep Bhattacharyya , Sarah C. Emerson

In ill-posed dynamic inverse problems expected spatial features and temporal correlation between frames can be leveraged to improve the quality of the computed solution, in particular when the available data are limited and the…

This work addresses the problem of graph learning from data following a Gaussian Graphical Model (GGM) with a time-varying mean. Graphical Lasso (GL), the standard method for estimating sparse precision matrices, assumes that the observed…

Machine Learning · Computer Science 2025-03-26 Samuel Rey , Ernesto Curbelo , Luca Martino , Fernando Llorente , Antonio G. Marques

How can we compute the pseudoinverse of a sparse feature matrix efficiently and accurately for solving optimization problems? A pseudoinverse is a generalization of a matrix inverse, which has been extensively utilized as a fundamental…

Machine Learning · Computer Science 2020-11-10 Jinhong Jung , Lee Sael

Recently, high dimensional vector auto-regressive models (VAR), have attracted a lot of interest, due to novel applications in the health, engineering and social sciences. The presence of temporal dependence poses additional challenges to…

Statistics Theory · Mathematics 2022-09-20 Sagnik Halder , George Michailidis

We study the problem of estimating from data, a sparse approximation to the inverse covariance matrix. Estimating a sparsity constrained inverse covariance matrix is a key component in Gaussian graphical model learning, but one that is…

Machine Learning · Statistics 2011-06-28 Suvrit Sra , Dongmin Kim

Visual Auto-Regressive modeling (VAR) has shown promise in bridging the speed and quality gap between autoregressive image models and diffusion models. VAR reformulates autoregressive modeling by decomposing an image into successive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Hermann Kumbong , Xian Liu , Tsung-Yi Lin , Ming-Yu Liu , Xihui Liu , Ziwei Liu , Daniel Y. Fu , Christopher Ré , David W. Romero

We introduce DiverseVAR, a framework that enhances the diversity of text-conditioned visual autoregressive models (VAR) at test time without requiring retraining, fine-tuning, or substantial computational overhead. While VAR models have…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Mingue Park , Prin Phunyaphibarn , Phillip Y. Lee , Minhyuk Sung

Discovering the partial differential equations underlying spatio-temporal datasets from very limited and highly noisy observations is of paramount interest in many scientific fields. However, it remains an open question to know when model…

Machine Learning · Statistics 2021-10-06 Georges Tod , Gert-Jan Both , Remy Kusters

In this paper, we investigate the recovery of a sparse weight vector (parameters vector) from a set of noisy linear combinations. However, only partial information about the matrix representing the linear combinations is available. Assuming…

Machine Learning · Computer Science 2016-11-18 Ashkan Esmaeili , Arash Amini , Farokh Marvasti

This paper investigates a partially linear spatial autoregressive panel data model that incorporates fixed effects, constant and time-varying regression coefficients, and a time-varying spatial lag coefficient. A two-stage least squares…

Statistics Theory · Mathematics 2024-10-15 Lingling Tian , Chuanhua Wei , Mixia Wu

We explore estimation and forecast accuracy for sparse linear models, focusing on scenarios where both predictors and errors carry serial correlations. We establish a clear link between predictor serial correlation and the performance of…

Statistics Theory · Mathematics 2026-01-27 Simone Tonini , Francesca Chiaromonte , Alessandro Giovannelli

The popular Lasso approach for sparse estimation can be derived via marginalization of a joint density associated with a particular stochastic model. A different marginalization of the same probabilistic model leads to a different…

Machine Learning · Statistics 2013-02-28 Aleksandr Y. Aravkin , James V. Burke , Alessandro Chiuso , Gianluigi Pillonetto

We consider estimation of undirected Gaussian graphical models and inverse covariances in high-dimensional scenarios by penalizing the corresponding precision matrix. While single $L_1$ (Graphical Lasso) and $L_2$ (Graphical Ridge)…

Methodology · Statistics 2021-01-07 Solt Kovács , Tobias Ruckstuhl , Helena Obrist , Peter Bühlmann