English
Related papers

Related papers: Adaptive shrinkage of smooth functional effects to…

200 papers

Accurately selecting and estimating smooth functional effects in additive models with potentially many functions is a challenging task. We introduce a novel Demmler-Reinsch basis expansion to model the functional effects that allows us to…

Methodology · Statistics 2024-01-02 Paul Bach , Nadja Klein

Time-varying parameter (TVP) regression models can involve a huge number of coefficients. Careful prior elicitation is required to yield sensible posterior and predictive inferences. In addition, the computational demands of Markov Chain…

Econometrics · Economics 2023-05-15 Niko Hauzenberger , Florian Huber , Gary Koop

We present here a new method for approximating functions defined on superreflexive Banach spaces by differentiable functions with $\alpha$-H\"older derivatives (for some $0<\alpha\leq 1$). The smooth approximation is given by means of an…

Functional Analysis · Mathematics 2016-09-07 Manuel Cepedello Boiso

Parameter shrinkage applied optimally can always reduce error and projection variances from those of maximum likelihood estimation. Many variables that actuaries use are on numerical scales, like age or year, which require parameters at…

Applications · Statistics 2020-12-22 Gary Venter , Şule Şahin

In many regression settings the unknown coefficients may have some known structure, for instance they may be ordered in space or correspond to a vectorized matrix or tensor. At the same time, the unknown coefficients may be sparse, with…

Methodology · Statistics 2023-04-28 Maryclare Griffin , Peter D. Hoff

This article revisits the problem of Bayesian shape-restricted inference in the light of a recently developed approximate Gaussian process that admits an equivalent formulation of the shape constraints in terms of the basis coefficients. We…

Methodology · Statistics 2019-02-14 Pallavi Ray , Debdeep Pati , Anirban Bhattacharya

In this paper, we propose a new regularization technique called "functional SCAD". We then combine this technique with the smoothing spline method to develop a smooth and locally sparse (i.e., zero on some sub-regions) estimator for the…

Statistics Theory · Mathematics 2020-09-21 Zhenhua Lin , Jiguo Cao , Liangliang Wang , Haonan Wang

Spatio-temporal receptive field (STRF) models are frequently used to approximate the computation implemented by a sensory neuron. Typically, such STRFs are assumed to be smooth and sparse. Current state-of-the-art approaches for estimating…

Machine Learning · Computer Science 2021-08-23 Ziwei Huang , Yanli Ran , Jonathan Oesterle , Thomas Euler , Philipp Berens

Modern biomedical studies frequently collect complex, high-dimensional physiological signals using wearables and sensors along with time-to-event outcomes, making efficient variable selection methods crucial for interpretation and improving…

Methodology · Statistics 2026-04-22 Yuanzhen Yue , Stella Self , Yichao Wu , Jiajia Zhang , Rahul Ghosal

Supremum norm loss is intuitively more meaningful to quantify function estimation error in statistics. In the context of multivariate nonparametric regression with unknown error, we propose a Bayesian procedure based on spike-and-slab prior…

Statistics Theory · Mathematics 2018-06-29 William Weimin Yoo , Vincent Rivoirard , Judith Rousseau

Bayesian deep learning approaches assume model parameters to be latent random variables and infer posterior distributions to quantify uncertainty, increase safety and trust, and prevent overconfident and unpredictable behavior. However,…

Machine Learning · Computer Science 2023-07-13 Jihao Andreas Lin , Joe Watson , Pascal Klink , Jan Peters

This paper presents a subgradient-based algorithm for constrained nonsmooth convex optimization that does not require projections onto the feasible set. While the well-established Frank-Wolfe algorithm and its variants already avoid…

Optimization and Control · Mathematics 2024-09-04 Kamiar Asgari , Michael J. Neely

Deep reinforcement learning (RL) is increasingly deployed in resource-constrained environments, yet the go-to function approximators - multilayer perceptrons (MLPs) - are often parameter-inefficient due to an imperfect inductive bias for…

Machine Learning · Computer Science 2026-02-02 Rajib Mostakim , Reza T. Batley , Sourav Saha

Seemingly unrelated regression is a natural framework for regressing multiple correlated responses on multiple predictors. The model is very flexible, with multiple linear regression and covariance selection models being special cases.…

Methodology · Statistics 2019-07-23 Yunfan Li , Jyotishka Datta , Bruce A. Craig , Anindya Bhadra

We focus on nonlinear Function-on-Scalar regression, where the predictors are scalar variables, and the responses are functional data. Most existing studies approximate the hidden nonlinear relationships using linear combinations of basis…

Methodology · Statistics 2025-04-01 Kazunori Takeshita , Yoshikazu Terada

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

Statistics Theory · Mathematics 2025-06-03 Yannick Baraud , Guillaume Maillard

Several results on constrained spline smoothing are obtained. In particular, we establish a general result, showing how one can constructively smooth any monotone or convex piecewise polynomial function (ppf) (or any $q$-monotone ppf,…

Numerical Analysis · Mathematics 2014-04-01 K. Kopotun , D. Leviatan , A. Prymak

We propose an approximation to the forward-filter-backward-sampler (FFBS) algorithm for large-scale spatio-temporal smoothing. FFBS is commonly used in Bayesian statistics when working with linear Gaussian state-space models, but it…

Methodology · Statistics 2022-07-20 Marcin Jurek , Matthias Katzfuss

In regression-based analyses of group-level neuroimage data researchers typically fit a series of marginal general linear models to image outcomes at each spatially-referenced pixel. Spatial regularization of effects of interest is usually…

Methodology · Statistics 2024-09-26 Andrew S. Whiteman , Timothy D. Johnson , Jian Kang

The Jacobi prior offers an alternative Bayesian framework, designed to achieve superior computational efficiency without compromising predictive performance. Compared to widely used methods such as Lasso, Ridge, Elastic Net, uniLasso, the…

Methodology · Statistics 2026-03-03 Sourish Das , Shouvik Sardar