English
Related papers

Related papers: Adaptive Bayesian Multivariate Spline Knot Inferen…

200 papers

Methods for choosing a fixed set of knot locations in additive spline models are fairly well established in the statistical literature. While most of these methods are in principle directly extendable to non-additive surface models, they…

Computation · Statistics 2018-07-03 Feng Li , Mattias Villani

We develop a fully automatic Bayesian Lasso via variational inference. This is a scalable procedure for approximating the posterior distribution. Special attention is driven to the knot selection in regression spline. In order to carry…

Methodology · Statistics 2021-03-01 Larissa Alves , Ronaldo Dias , Helio S. Migon

Inspired by the complexity of certain real-world datasets, this article introduces a novel flexible linear spline index regression model. The model posits piecewise linear effects of an index on the response, with continuous changes…

Methodology · Statistics 2024-09-04 Lianqiang Qu , Long Lv , Meiling Hao , Liuquan Sun

In this article we revisit the auxiliary variable method introduced in Smith and kohn (1996) for the fitting of P-th order spline regression models with an unknown number of knot points. We introduce modifications which allow the location…

Methodology · Statistics 2009-11-11 Y. Fan , J. -L Dortet-Bernadet , S. A. Sisson

Sparse deep neural networks have proven to be efficient for predictive model building in large-scale studies. Although several works have studied theoretical and numerical properties of sparse neural architectures, they have primarily…

Machine Learning · Statistics 2023-09-18 Sanket Jantre , Shrijita Bhattacharya , Tapabrata Maiti

We propose a novel approach to perform approximate Bayesian inference in complex models such as Bayesian neural networks. The approach is more scalable to large data than Markov Chain Monte Carlo, it embraces more expressive models than…

Machine Learning · Statistics 2022-09-07 Joel Janek Dabrowski , Daniel Edward Pagendam

In this paper, we will outline a novel data-driven method for estimating functions in a multivariate nonparametric regression model based on an adaptive knot selection for B-splines. The underlying idea of our approach for selecting knots…

Methodology · Statistics 2024-01-26 Mary E. Savino , Céline Lévy-Leduc

Sparse, knot-based Gaussian processes have enjoyed considerable success as scalable approximations to full Gaussian processes. Certain sparse models can be derived through specific variational approximations to the true posterior, and knots…

Machine Learning · Statistics 2020-04-15 Nathaniel Garton , Jarad Niemi , Alicia Carriquiry

This paper presents a new approach to selecting knots at the same time as estimating the B-spline regression model. Such simultaneous selection of knots and model is not trivial, but our strategy can make it possible by employing a…

Optimization and Control · Mathematics 2023-04-06 Shotaro Yagishita , Jun-ya Gotoh

As modern neural networks get more complex, specifying a model with high predictive performance and sound uncertainty quantification becomes a more challenging task. Despite some promising theoretical results on the true posterior…

Machine Learning · Computer Science 2025-06-18 Alisa Sheinkman , Sara Wade

Bayesian inference in deep neural networks is challenging due to the high-dimensional, strongly multi-modal parameter posterior density landscape. Markov chain Monte Carlo approaches asymptotically recover the true posterior but are…

Regression splines are smooth, flexible, and parsimonious nonparametric function estimators. They are known to be sensitive to knot number and placement, but if assumptions such as monotonicity or convexity may be imposed on the regression…

Applications · Statistics 2008-11-12 Mary C. Meyer

In this paper we propose a model selection approach to fit a regression model using splines with a variable number of knots. We introduce a penalized criterion to estimate the number and the position of the knots where to anchor the splines…

Methodology · Statistics 2021-07-28 Alex Rodrigo dos S. Sousa , Magno T. F. Severino , Florencia G. Leonardi

The varying coefficient model has received broad attention from researchers as it is a powerful dimension reduction tool for non-parametric modeling. Most existing varying coefficient models fitted with polynomial spline assume equidistant…

Methodology · Statistics 2022-06-15 Xufei Wang , Bo Jiang , Jun S. Liu

Splines are useful building blocks when constructing priors on nonparametric models indexed by functions. Recently it has been established in the literature that hierarchical priors based on splines with a random number of equally spaced…

Statistics Theory · Mathematics 2013-03-15 Eduard Belitser , Paulo Serra

Many exact Markov chain Monte Carlo algorithms have been developed for posterior inference in Bayesian nonparametric models which involve infinite-dimensional priors. However, these methods are not generic and special methodology must be…

Computation · Statistics 2014-05-22 Jim E. Griffin

Quantile regression has received increased attention in the statistics community in recent years. This article adapts an auxiliary variable method, commonly used in Bayesian variable selection for mean regression models, to the fitting of…

Methodology · Statistics 2012-02-28 J. -L. Dortet-Bernadet , Y. Fan

We consider Bayesian analysis of a class of multiple changepoint models. While there are a variety of efficient ways to analyse these models if the parameters associated with each segment are independent, there are few general approaches…

Computation · Statistics 2009-10-19 Paul Fearnhead , Zhen Liu

Fitting B-splines to discrete data is especially challenging when the given data contain noise, jumps, or corners. Here, we describe how periodic data sets with these features can be efficiently and robustly approximated with B-splines by…

Numerical Analysis · Mathematics 2020-12-09 David Lenz , Oana Marin , Vijay Mahadevan , Raine Yeh , Tom Peterka

Bayesian analysis often concerns an evaluation of models with different dimensionality as is necessary in, for example, model selection or mixture models. To facilitate this evaluation, transdimensional Markov chain Monte Carlo (MCMC)…

Methodology · Statistics 2018-08-13 Daniel W. Heck , Antony M. Overstall , Quentin F. Gronau , Eric-Jan Wagenmakers
‹ Prev 1 2 3 10 Next ›