English
Related papers

Related papers: Dynamic sparsity on dynamic regression models

200 papers

Survival analysis is an important area of medical research, yet existing models often struggle to balance simplicity with flexibility. Simple models require minimal adjustments but come with strong assumptions, while more flexible models…

Methodology · Statistics 2025-08-22 Peter Knaus , Daniel Winkler , Sebastian F. Schoppmann , Gerd Jomrich

Methods for choosing a fixed set of knot locations in additive spline models are fairly well established in the statistical literature. While most of these methods are in principle directly extendable to non-additive surface models, they…

Computation · Statistics 2018-07-03 Feng Li , Mattias Villani

Switching dynamical systems provide a powerful, interpretable modeling framework for inference in time-series data in, e.g., the natural sciences or engineering applications. Since many areas, such as biology or discrete-event systems, are…

Machine Learning · Computer Science 2021-09-30 Lukas Köhs , Bastian Alt , Heinz Koeppl

Linear mixed effects models are widely used in statistical modelling. We consider a mixed effects model with Bayesian variable selection in the random effects using spike-and-slab priors and developed a variational Bayes inference scheme…

Methodology · Statistics 2024-08-15 M-Z. Spyropoulou , J. Hopker , J. E. Griffin

Two-component mixture priors provide a traditional way to induce sparsity in high-dimensional Bayes models. However, several aspects of such a prior, including computational complexities in high-dimensions, interpretation of exact zeros and…

Statistics Theory · Mathematics 2016-05-19 Anirban Bhattacharya , David B. Dunson , Debdeep Pati , Natesh S. Pillai

Sparsity-promoting priors have become increasingly popular over recent years due to an increased number of regression and classification applications involving a large number of predictors. In time series applications where observations are…

Methodology · Statistics 2012-03-02 François Caron , Luke Bornn , Arnaud Doucet

We introduce Group Spike-and-slab Variational Bayes (GSVB), a scalable method for group sparse regression. A fast co-ordinate ascent variational inference (CAVI) algorithm is developed for several common model families including Gaussian,…

Methodology · Statistics 2025-11-14 Michael Komodromos , Marina Evangelou , Sarah Filippi , Kolyan Ray

Sparseness of the regression coefficient vector is often a desirable property, since, among other benefits, sparseness improves interpretability. In practice, many true regression coefficients might be negligibly small, but non-zero, which…

Methodology · Statistics 2019-10-01 Daniel Andrade , Kenji Fukumizu

We propose a Bayesian methodology for estimating spiked covariance matrices with jointly sparse structure in high dimensions. The spiked covariance matrix is reparametrized in terms of the latent factor model, where the loading matrix is…

Methodology · Statistics 2019-01-31 Fangzheng Xie , Yanxun Xu , Carey E. Priebe , Joshua Cape

We develop a novel Bayesian method to select important predictors in regression models with multiple responses of diverse types. A sparse Gaussian copula regression model is used to account for the multivariate dependencies between any…

Methodology · Statistics 2020-09-22 Angelos Alexopoulos , Leonardo Bottolo

In this paper, we propose a scalable Bayesian method for sparse covariance matrix estimation by incorporating a continuous shrinkage prior with a screening procedure. In the first step of the procedure, the off-diagonal elements with small…

Methodology · Statistics 2023-11-22 Kyoungjae Lee , Seongil Jo , Kyeongwon Lee , Jaeyong Lee

Spike-and-slab priors are popular Bayesian solutions for high-dimensional linear regression problems. Previous theoretical studies on spike-and-slab methods focus on specific prior formulations and use prior-dependent conditions and…

Statistics Theory · Mathematics 2020-02-14 Bai Jiang , Qiang Sun

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

Econometrics · Economics 2020-06-12 Matteo Mogliani , Anna Simoni

Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional…

Machine Learning · Statistics 2021-09-07 Kolyan Ray , Botond Szabo , Gabriel Clara

We propose a Bayesian vector autoregressive (VAR) model for mixed-frequency data. Our model is based on the mean-adjusted parametrization of the VAR and allows for an explicit prior on the 'steady states' (unconditional means) of the…

Econometrics · Economics 2019-11-22 Sebastian Ankargren , Måns Unosson , Yukai Yang

Robust Bayesian methods for high-dimensional regression problems under diverse sparse regimes are studied. Traditional shrinkage priors are primarily designed to detect a handful of signals from tens of thousands of predictors in the…

Statistics Theory · Mathematics 2024-10-25 Se Yoon Lee , Peng Zhao , Debdeep Pati , Bani K. Mallick

Scale-mixture shrinkage priors have recently been shown to possess robust empirical performance and excellent theoretical properties such as model selection consistency and (near) minimax posterior contraction rates. In this paper, the…

Methodology · Statistics 2022-12-27 Ahmed Alhamzawi , Gorgees Shaheed Mohammad

We develop a variational Bayes approach for dynamic variable selection in high-dimensional regression models with time-varying parameters and predictors that exhibit a predefined group structure. Through comprehensive simulation studies, we…

Methodology · Statistics 2025-04-16 Nicolas Bianco , Mauro Bernardi , Daniele Bianchi

We introduce a novel Bayesian framework for estimating time-varying volatility by extending the Random Walk Stochastic Volatility (RWSV) model with Dynamic Shrinkage Processes (DSP) in log-variances. Unlike the classical Stochastic…

Methodology · Statistics 2025-12-25 Jason B. Cho , David S. Matteson

In recent years, Ising prior with the network information for the "in" or "out" binary random variable in Bayesian variable selections has received more and more attentions. In this paper, we discover that even without the informative prior…

Methodology · Statistics 2012-06-14 Zaili Fang , Inyoung Kim