English
Related papers

Related papers: Adaptive shrinkage of smooth functional effects to…

200 papers

Sparse regression problems, where the goal is to identify a small set of relevant predictors, often require modeling not only main effects but also meaningful interactions through other variables. While the pliable lasso has emerged as a…

Methodology · Statistics 2025-09-10 The Tien Mai

We provide a framework for assessing the default nature of a prior distribution using the property of regular variation, which we study for global-local shrinkage priors. In particular, we demonstrate the horseshoe priors, originally…

Methodology · Statistics 2016-05-17 Anindya Bhadra , Jyotishka Datta , Nicholas G. Polson , Brandon T. Willard

This paper addresses the weak instruments problem in linear instrumental variable models from a Bayesian perspective. The new approach has two components. First, a novel predictor-dependent shrinkage prior is developed for the many…

Methodology · Statistics 2014-08-05 P. Richard Hahn , Hedibert Lopes

We consider the problem of model selection when grouping structure is inherent within the regressors. Using a Bayesian approach, we model the mean vector by a one-group global-local shrinkage prior belonging to a broad class of such priors…

Statistics Theory · Mathematics 2025-11-20 Sayantan Paul , Prasenjit Ghosh , Arijit Chakrabarti

We propose a novel variational Bayes approach to estimate high-dimensional vector autoregression (VAR) models with hierarchical shrinkage priors. Our approach does not rely on a conventional structural VAR representation of the parameter…

Econometrics · Economics 2023-07-03 Mauro Bernardi , Daniele Bianchi , Nicolas Bianco

High-dimensional vector autoregressive (VAR) models offer a versatile framework for multivariate time series analysis, yet face critical challenges from over-parameterization and uncertain lag order. In this paper, we systematically compare…

Methodology · Statistics 2026-02-10 Harrison Katz , Robert E. Weiss

Over the past two decades, shrinkage priors have become increasingly popular, and many proposals can be found in the literature. These priors aim to shrink small effects to zero while maintaining true large effects. Horseshoe-type priors…

Statistics Theory · Mathematics 2025-01-14 Maria De Iorio , Andreas Heinecke , Beatrice Franzolini , Rafael Cabral

This paper considers the development of spatially adaptive smoothing splines for the estimation of a regression function with non-homogeneous smoothness across the domain. Two challenging issues that arise in this context are the evaluation…

Statistics Theory · Mathematics 2013-06-11 Xiao Wang , Pang Du , Jinglai Shen

Functional data analysis almost always involves smoothing discrete observations into curves, because they are never observed in continuous time and rarely without error. Although smoothing parameters affect the subsequent inference,…

Methodology · Statistics 2025-04-07 Sunny G. W. Wang , Valentin Patilea , Nicolas Klutchnikoff

We consider estimation of a functional parameter of a realistically modeled data distribution based on observing independent and identically distributed observations. We define an $m$-th order Spline Highly Adaptive Lasso Minimum Loss…

Statistics Theory · Mathematics 2021-07-05 Mark J. van der Laan , David Benkeser , Weixin Cai

This paper presents a new methodology, called AFSSEN, to simultaneously select significant predictors and produce smooth estimates in a high-dimensional function-on-scalar linear model with a sub-Gaussian errors. Outcomes are assumed to lie…

Methodology · Statistics 2019-05-27 Ardalan Mirshani , Matthew Reimherr

Large-scale kernel approximation is an important problem in machine learning research. Approaches using random Fourier features have become increasingly popular [Rahimi and Recht, 2007], where kernel approximation is treated as empirical…

Machine Learning · Computer Science 2017-05-25 Wei-Cheng Chang , Chun-Liang Li , Yiming Yang , Barnabas Poczos

Macroeconomists using large datasets often face the choice of working with either a large Vector Autoregression (VAR) or a factor model. In this paper, we develop methods for combining the two using a subspace shrinkage prior. Subspace…

Econometrics · Economics 2021-07-19 Florian Huber , Gary Koop

Despite their widespread use in practice, the asymptotic properties of Bayesian penalized splines have not been investigated so far. We close this gap and study posterior concentration rates for Bayesian penalized splines in a Gaussian…

Statistics Theory · Mathematics 2022-03-24 Paul Bach , Nadja Klein

Prior choice can strongly influence Bayesian Dirichlet ARMA (B-DARMA) inference for compositional time-series. Using simulations with (i) correct lag order, (ii) overfitting, and (iii) underfitting, we assess five priors:…

Methodology · Statistics 2025-07-08 Harrison Katz , Liz Medina , Robert E. Weiss

This article introduces a functional method for lower-dimensional smooth representations in terms of time-varying dissimilarities. The method incorporates dissimilarity representation in multidimensional scaling and smoothness approach of…

Methodology · Statistics 2025-05-02 Liting Li

Graphs have been commonly used to represent complex data structures. In models dealing with graph-structured data, multivariate parameters may not only exhibit sparse patterns but have structured sparsity and smoothness in the sense that…

Methodology · Statistics 2021-10-28 Changwoo J. Lee , Zhao Tang Luo , Huiyan Sang

Heavy-tailed continuous shrinkage priors, such as the horseshoe prior, are widely used for sparse estimation problems. However, there is limited work extending these priors to predictors with grouping structures. Of particular interest in…

Methodology · Statistics 2023-03-09 Jonathan Boss , Jyotishka Datta , Xin Wang , Sung Kyun Park , Jian Kang , Bhramar Mukherjee

Structured additive regression provides a general framework for complex Gaussian and non-Gaussian regression models, with predictors comprising arbitrary combinations of nonlinear functions and surfaces, spatial effects, varying…

Methodology · Statistics 2015-03-19 Fabian Scheipl , Ludwig Fahrmeir , Thomas Kneib

We propose Frank--Wolfe (FW) algorithms with an adaptive Bregman step-size strategy for smooth adaptable (also called: relatively smooth) (weakly-) convex functions. This means that the gradient of the objective function is not necessarily…

Optimization and Control · Mathematics 2026-02-19 Shota Takahashi , Sebastian Pokutta , Akiko Takeda