中文
相关论文

相关论文: Bayesian shrinkage prediction for the regression p…

200 篇论文

Reliable predictive uncertainty estimation plays an important role in enabling the deployment of neural networks to safety-critical settings. A popular approach for estimating the predictive uncertainty of neural networks is to define a…

机器学习 · 统计学 2023-12-29 Tim G. J. Rudner , Zonghao Chen , Yee Whye Teh , Yarin Gal

In the Bayesian approach, the a priori knowledge about the input of a mathematical model is described via a probability measure. The joint distribution of the unknown input and the data is then conditioned, using Bayes' formula, giving rise…

统计理论 · 数学 2015-06-15 Sebastian J. Vollmer

Bayesian neural networks attempt to combine the strong predictive performance of neural networks with formal quantification of uncertainty associated with the predictive output in the Bayesian framework. However, it remains unclear how to…

机器学习 · 统计学 2022-01-12 Takuo Matsubara , Chris J. Oates , François-Xavier Briol

Recent work has attempted to directly approximate the `function-space' or predictive posterior distribution of Bayesian models, without approximating the posterior distribution over the parameters. This is appealing in e.g. Bayesian neural…

机器学习 · 统计学 2020-11-19 David R. Burt , Sebastian W. Ober , Adrià Garriga-Alonso , Mark van der Wilk

We study frequentist properties of a Bayesian high-dimensional multivariate linear regression model with correlated responses. The predictors are separated into many groups and the group structure is pre-determined. Two features of the…

统计理论 · 数学 2019-06-13 Bo Ning , Seonghyun Jeong , Subhashis Ghosal

If we have an unbiased estimate of some parameter of interest, then its absolute value is positively biased for the absolute value of the parameter. This bias is large when the signal-to-noise ratio (SNR) is small, and it becomes even…

统计方法学 · 统计学 2020-12-01 Erik van Zwet , Andrew Gelman

Many regularization priors for Bayesian regression assume the regression coefficients are a priori independent. In particular this is the case for standard Bayesian treatments of the lasso and the elastic net. While independence may be…

统计方法学 · 统计学 2026-01-01 Christopher M. Hans , Ningyi Liu

When the sample size is not too small, M-estimators of regression coefficients are approximately normal and unbiased. This leads to the familiar frequentist inference in terms of normality-based confidence intervals and p-values. From a…

统计方法学 · 统计学 2018-10-19 Erik van Zwet

Consider a multinomial regression model where the response, which indicates a unit's membership in one of several possible unordered classes, is associated with a set of predictor variables. Such models typically involve a matrix of…

应用统计 · 统计学 2009-01-28 Paul Gustafson , Geneviève Lefebvre

Piecewise constant priors are routinely used in the Bayesian Cox proportional hazards model for survival analysis. Despite its popularity, large sample properties of this Bayesian method are not yet well understood. This work provides a…

统计理论 · 数学 2023-06-16 Bo Y. -C. Ning , Ismaël Castillo

A key problem in the theory of meta-learning is to understand how the task distributions influence transfer risk, the expected error of a meta-learner on a new task drawn from the unknown task distribution. In this paper, focusing on fixed…

机器学习 · 统计学 2021-06-15 Mikhail Konobeev , Ilja Kuzborskij , Csaba Szepesvári

The prior distribution on parameters of a sampling distribution is the usual starting point for Bayesian uncertainty quantification. In this paper, we present a different perspective which focuses on missing observations as the source of…

统计方法学 · 统计学 2021-11-23 Edwin Fong , Chris Holmes , Stephen G. Walker

We propose a generalized double Pareto prior for Bayesian shrinkage estimation and inferences in linear models. The prior can be obtained via a scale mixture of Laplace or normal distributions, forming a bridge between the Laplace and…

统计方法学 · 统计学 2015-03-19 Artin Armagan , David Dunson , Jaeyong Lee

We consider sparse Bayesian estimation in the classical multivariate linear regression model with $p$ regressors and $q$ response variables. In univariate Bayesian linear regression with a single response $y$, shrinkage priors which can be…

统计方法学 · 统计学 2018-05-21 Ray Bai , Malay Ghosh

In Simulation-based Inference, the goal is to solve the inverse problem when the likelihood is only known implicitly. Neural Posterior Estimation commonly fits a normalized density estimator as a surrogate model for the posterior. This…

机器学习 · 统计学 2023-10-04 Benjamin Kurt Miller , Marco Federici , Christoph Weniger , Patrick Forré

The behavior of Bayesian model averaging (BMA) for the normal linear regression model in the presence of influential observations that contribute to model misfit is investigated. Remedies to attenuate the potential negative impacts of such…

统计方法学 · 统计学 2021-11-23 Christopher M. Hans , Mario Peruggia , Junyan Wang

Nested error regression models are useful tools for analysis of grouped data, especially in the case of small area estimation. This paper suggests a nested error regression model using uncertain random effects in which the random effect in…

统计方法学 · 统计学 2017-02-28 Shonosuke Sugasawa , Tatsuya Kubokawa

Over the past two decades, shrinkage priors have become increasingly popular, and many proposals can be found in the literature. These priors aim to shrink small effects to zero while maintaining true large effects. Horseshoe-type priors…

统计理论 · 数学 2025-01-14 Maria De Iorio , Andreas Heinecke , Beatrice Franzolini , Rafael Cabral

Bayesian predictive inference provides a coherent description of entire predictive uncertainty through predictive distributions. We examine several widely used sparsity priors from the predictive (as opposed to estimation) inference…

统计理论 · 数学 2024-06-03 Veronika Rockova

In recent years there has been an increasing interest in the use of relational event models for dynamic social network analysis. The basis of these models is the concept of an "event", defined as a triplet of time, sender, and receiver of…

统计方法学 · 统计学 2022-03-24 Diana Karimova , Joris Mulder , Roger Th. A. J. Leenders