English
Related papers

Related papers: The ARR2 prior: flexible predictive prior definiti…

200 papers

We consider a new statistical model called the circulant correlation structure model, which is a multivariate Gaussian model with unknown covariance matrix and has a scale-invariance property. We construct shrinkage priors for the circulant…

Statistics Theory · Mathematics 2025-04-18 Michiko Okudo , Tomonari Sei

Standard autoregressive language models generate text by repeatedly selecting a discrete next token, coupling prediction with irreversible commitment at every step. We show that token selection is not the only viable autoregressive…

Computation and Language · Computer Science 2026-04-07 Oshri Naparstek

We introduce a Bayesian framework for mixed-type multivariate regression using continuous shrinkage priors. Our framework enables joint analysis of mixed continuous and discrete outcomes and facilitates variable selection from the $p$…

Statistics Theory · Mathematics 2024-12-20 Shao-Hsuan Wang , Ray Bai , Hsin-Hsiung Huang

We discuss a Bayesian hierarchical copula model for clusters of financial time series. A similar approach has been developed in recent paper. However, the prior distributions proposed there do not always provide a proper posterior. In order…

Methodology · Statistics 2025-02-07 Paolo Onorati , Brunero Liseo

Estimating time-varying correlation matrices is challenging because existing methods may adapt slowly to structural changes, impose insufficient regularization, or produce diffuse posterior uncertainty. In moderate dimensions, an additional…

Methodology · Statistics 2026-05-11 Daniel Andrew Coulson , David S. Matteson , Martin T. Wells

We propose a Bayesian approach using improper priors for hierarchical linear mixed models with flexible random effects and residual error distributions. The error distribution is modelled using scale mixtures of normals, which can capture…

Methodology · Statistics 2018-02-06 F. J. Rubio , M. F. J. Steel

High-dimensional spatially correlated covariates are common in regression models encountered in environmental sciences and other fields. In such models, the regression coefficients often exhibit a sparse structure with spatial dependence.…

Methodology · Statistics 2026-05-08 Zihan Zhu , Xueying Tang , Shuang Zhou

Reduced-Rank (RR) regression is a powerful dimensionality reduction technique but it overlooks any possible group configuration among the responses by assuming a low-rank structure on the entire coefficient matrix. Moreover, the temporal…

Methodology · Statistics 2025-12-22 Maria F. Pintado , Matteo Iacopini , Luca Rossini , Alexander Y. Shestopaloff

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2014-01-22 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

The space time autoregressive model has been widely applied in science, in areas such as economics, public finance, political science, agricultural economics, environmental studies and transportation analyses. The classical space time…

Applications · Statistics 2019-05-14 Wenqian Wang , Beth Andrews

Shrinkage prior has gained great successes in many data analysis, however, its applications mostly focus on the Bayesian modeling of sparse parameters. In this work, we will apply Bayesian shrinkage to model high dimensional parameter that…

Methodology · Statistics 2018-12-31 Qifan Song , Guang Cheng

Consider the problem of high dimensional variable selection for the Gaussian linear model when the unknown error variance is also of interest. In this paper, we show that the use of conjugate shrinkage priors for Bayesian variable selection…

Methodology · Statistics 2025-04-17 Gemma E. Moran , Veronika Rockova , Edward I. George

Neural networks are popular state-of-the-art models for many different tasks.They are often trained via back-propagation to find a value of the weights that correctly predicts the observed data. Although back-propagation has shown good…

Machine Learning · Statistics 2020-12-29 Simón Rodríguez Santana , Daniel Hernández-Lobato

Over the past two decades, shrinkage priors have become increasingly popular, and many proposals can be found in the literature. These priors aim to shrink small effects to zero while maintaining true large effects. Horseshoe-type priors…

Statistics Theory · Mathematics 2025-01-14 Maria De Iorio , Andreas Heinecke , Beatrice Franzolini , Rafael Cabral

We consider estimation of a normal mean matrix under the Frobenius loss. Motivated by the Efron--Morris estimator, a generalization of Stein's prior has been recently developed, which is superharmonic and shrinks the singular values towards…

Statistics Theory · Mathematics 2024-04-19 Takeru Matsuda , Fumiyasu Komaki , William E. Strawderman

The Bayesian Optimal Phase II (BOP2) framework is a flexible trial design that can naturally facilitate complex adaptations due to its Bayesian setting. BOP2 uses equal randomisation and equally placed interim analyses in its design, but it…

Applications · Statistics 2025-11-19 Connor Fitchett , Ayon Mukherjee , Sofía S. Villar , David S. Robertson

In recent years, a rich variety of shrinkage priors have been proposed that have great promise in addressing massive regression problems. In general, these new priors can be expressed as scale mixtures of normals, but have more complex…

Methodology · Statistics 2012-03-15 Artin Armagan , David B. Dunson , Merlise Clyde

Prediction-Powered Inference (PPI) is a powerful framework for enhancing statistical estimates by combining limited gold-standard data with machine learning (ML) predictions. While prior work has demonstrated PPI's benefits for individual…

Machine Learning · Statistics 2025-11-10 Sida Li , Nikolaos Ignatiadis

Bayesian deep learning approaches assume model parameters to be latent random variables and infer posterior distributions to quantify uncertainty, increase safety and trust, and prevent overconfident and unpredictable behavior. However,…

Machine Learning · Computer Science 2023-07-13 Jihao Andreas Lin , Joe Watson , Pascal Klink , Jan Peters

We discuss Bayesian inference for parameters selected using the data. First, we provide a critical analysis of the existing positions in the literature regarding the correct Bayesian approach under selection. Second, we propose two types of…

Statistics Theory · Mathematics 2021-05-12 Daniel G. Rasines , G. Alastair Young