English
Related papers

Related papers: Bayesian Local Extrema Splines

200 papers

We provide a flexible framework for selecting among a class of additive partial linear models that allows both linear and nonlinear additive components. In practice, it is challenging to determine which additive components should be…

Methodology · Statistics 2021-09-20 Seonghyun Jeong , Taeyoung Park , David A. van Dyk

Bayesian learning is built on an assumption that the model space contains a true reflection of the data generating mechanism. This assumption is problematic, particularly in complex data environments. Here we present a Bayesian…

Machine Learning · Statistics 2018-11-05 S. P. Lyddon , S. G. Walker , C. C. Holmes

In the setting of nonparametric multivariate regression with unknown error variance, we study asymptotic properties of a Bayesian method for estimating a regression function f and its mixed partial derivatives. We use a random series of…

Statistics Theory · Mathematics 2016-04-13 William Weimin Yoo , Subhashis Ghosal

Here we establish several results on the nonlocal curvature of planar curves. First we show how to express the nonlocal curvature of a curve relative to a point in terms of the nonlocal curvatures of simpler components of that curve…

Differential Geometry · Mathematics 2025-04-14 Cole Fleming , Brian Seguin

A geometric representation for multivariate extremes, based on the shapes of scaled sample clouds in light-tailed margins and their so-called limit sets, has recently been shown to connect several existing extremal dependence concepts.…

Methodology · Statistics 2023-11-03 Jennifer Wadsworth , Ryan Campbell

Sup-norm curve estimation is a fundamental statistical problem and, in principle, a premise for the construction of confidence bands for infinite-dimensional parameters. In a Bayesian framework, the issue of whether the…

Methodology · Statistics 2016-03-22 Catia Scricciolo

Penalized B-splines are routinely used in additive models to describe smooth changes in a response with quantitative covariates. It is typically done through the conditional mean in the exponential family using generalized additive models…

Methodology · Statistics 2020-05-12 Philippe Lambert

Spherical regression explores relationships between variables on spherical domains. We develop a nonparametric model that uses a diffeomorphic map from a sphere to itself. The restriction of this mapping to diffeomorphisms is natural in…

Other Statistics · Statistics 2017-02-06 Michael Rosenthal , Wei Wu , Eric Klassen , Anuj Srivastava

This paper deals with nonparametric maximum likelihood estimation for Gaussian locally stationary processes. Our nonparametric MLE is constructed by minimizing a frequency domain likelihood over a class of functions. The asymptotic behavior…

Statistics Theory · Mathematics 2011-11-10 Rainer Dahlhaus , Wolfgang Polonik

Bayesian analysis is a framework for parameter estimation that applies even in uncertainty regimes where the commonly used local (frequentist) analysis based on the Cram\'er-Rao bound is not well defined. In particular, it applies when no…

Quantum Physics · Physics 2021-03-17 Simon Morelli , Ayaka Usui , Elizabeth Agudelo , Nicolai Friis

We propose a general algorithmic framework for Bayesian model selection. A spike-and-slab Laplacian prior is introduced to model the underlying structural assumption. Using the notion of effective resistance, we derive an EM-type algorithm…

Methodology · Statistics 2020-06-19 Youngseok Kim , Chao Gao

Many real-life applications involve estimation of curves that exhibit complicated shapes including jumps or varying-frequency oscillations. Practical methods have been devised that can adapt to a locally varying complexity of an unknown…

Statistics Theory · Mathematics 2021-05-28 Veronika Rockova , Judith Rousseau

The SLOPE estimates regression coefficients by minimizing a regularized residual sum of squares using a sorted-$\ell_1$-norm penalty. The SLOPE combines testing and estimation in regression problems. It exhibits suitable variable selection…

Methodology · Statistics 2016-09-02 Amir Sepehri

There is increasing interest in the problem of nonparametric regression with high-dimensional predictors. When the number of predictors $D$ is large, one encounters a daunting problem in attempting to estimate a $D$-dimensional surface…

Statistics Theory · Mathematics 2014-06-17 Yun Yang , David B. Dunson

Observational time series data often exhibit both cyclic temporal trends and autocorrelation and may also depend on covariates. As such, there is a need for flexible regression models that are able to capture these trends and model any…

In this paper we develop and study adaptive empirical Bayesian smoothing splines. These are smoothing splines with both smoothing parameter and penalty order determined via the empirical Bayes method from the marginal likelihood of the…

Statistics Theory · Mathematics 2015-11-18 Paulo Serra , Tatyana Krivobokova

An implementation of a nonparametric Bayesian approach to solving binary classification problems on graphs is described. A hierarchical Bayesian approach with a randomly scaled Gaussian prior is considered. The prior uses the graph…

Computation · Statistics 2017-06-16 Jarno Hartog , Harry van Zanten

Bayesian optimization is normally performed within fixed variable bounds. In cases like hyperparameter tuning for machine learning algorithms, setting the variable bounds is not trivial. It is hard to guarantee that any fixed bounds will…

Optimization and Control · Mathematics 2020-01-15 Wei Chen , Mark Fuge

We describe and analyze algorithms for shape-constrained symbolic regression, which allows the inclusion of prior knowledge about the shape of the regression function. This is relevant in many areas of engineering -- in particular whenever…

Neural and Evolutionary Computing · Computer Science 2021-07-21 Christian Haider , Fabricio Olivetti de França , Bogdan Burlacu , Gabriel Kronberger

In this paper, we propose a new semiparametric regression estimator by using a hybrid technique of a parametric approach and a nonparametric penalized spline method. The overall shape of the true regression function is captured by the…

Statistics Theory · Mathematics 2012-02-17 Takuma Yoshida , Kanta Naito