English
Related papers

Related papers: Multivariate L\'evy Adaptive B-Spline Regression

200 papers

This study explores the estimation of parameters in a matrix-valued linear regression model, where the $T$ responses $(Y_t)_{t=1}^T \in \mathbb{R}^{n \times p}$ and predictors $(X_t)_{t=1}^T \in \mathbb{R}^{m \times q}$ satisfy the…

Statistics Theory · Mathematics 2025-12-08 Nayel Bettache

Regression models are used in a wide range of applications providing a powerful scientific tool for researchers from different fields. Linear, or simple parametric, models are often not sufficient to describe complex relationships between…

Machine Learning · Statistics 2021-11-24 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

We propose the Bayesian adaptive Lasso (BaLasso) for variable selection and coefficient estimation in linear regression. The BaLasso is adaptive to the signal level by adopting different shrinkage for different coefficients. Furthermore, we…

Methodology · Statistics 2010-09-14 Chenlei Leng , Minh Ngoc Tran , David Nott

This article deals with adaptive nonparametric estimation for L\'evy processes observed at low frequency. For general linear functionals of the L\'evy measure, we construct kernel estimators, provide upper risk bounds and derive rates of…

Statistics Theory · Mathematics 2014-07-15 Johanna Kappus

Multivariate adaptive regression splines (MARS) is a popular method for nonparametric regression introduced by Friedman in 1991. MARS fits simple nonlinear and non-additive functions to regression data. We propose and study a natural lasso…

Statistics Theory · Mathematics 2024-10-15 Dohyeong Ki , Billy Fang , Adityanand Guntuboyina

Additive smooth models, such as Generalized additive models (GAMs) of location, scale, and shape (GAMLSS), are a popular choice for modeling experimental data. However, software available to fit such models is usually not tailored…

Methodology · Statistics 2025-06-17 Joshua Krause , Jelmer P. Borst , Jacolien van Rij

Calibrating a L\'evy process usually requires characterizing its jump distribution. Traditionally this problem can be solved with nonparametric estimation using the empirical characteristic functions (ECF), assuming certain regularity, and…

Machine Learning · Statistics 2019-09-30 Kailai Xu , Eric Darve

We focus on nonlinear Function-on-Scalar regression, where the predictors are scalar variables, and the responses are functional data. Most existing studies approximate the hidden nonlinear relationships using linear combinations of basis…

Methodology · Statistics 2025-04-01 Kazunori Takeshita , Yoshikazu Terada

Variational Bayes (VB) is a popular tool for Bayesian inference in statistical modeling. Recently, some VB algorithms are proposed to handle intractable likelihoods with applications such as approximate Bayesian computation. In this paper,…

Numerical Analysis · Mathematics 2021-09-28 Zhijian He , Zhenghang Xu , Xiaoqun Wang

We consider the problem of static Bayesian inference for partially observed Levy-process models. We develop a methodology which allows one to infer static parameters and some states of the process, without a bias from the…

Computation · Statistics 2022-04-01 Hamza Ruzayqat , Ajay Jasra

Multilevel models (MLMs) are a central building block of the Bayesian workflow. They enable joint, interpretable modeling of data across hierarchical levels and provide a fully probabilistic quantification of uncertainty. Despite their…

Methods for choosing a fixed set of knot locations in additive spline models are fairly well established in the statistical literature. While most of these methods are in principle directly extendable to non-additive surface models, they…

Computation · Statistics 2018-07-03 Feng Li , Mattias Villani

Gaussian processes are rich distributions over functions, with generalization properties determined by a kernel function. When used for long-range extrapolation, predictions are particularly sensitive to the choice of kernel parameters. It…

Machine Learning · Statistics 2018-02-05 Phillip A. Jang , Andrew E. Loeb , Matthew B. Davidow , Andrew Gordon Wilson

Regression models are used for inference and prediction in a wide range of applications providing a powerful scientific tool for researchers and analysts from different fields. In many research fields the amount of available data as well as…

Methodology · Statistics 2018-06-08 Aliaksandr Hubin , Geir Storvik , Florian Frommlet

Discovering governing equations from data is important to many scientific and engineering applications. Despite promising successes, existing methods are still challenged by data sparsity and noise issues, both of which are ubiquitous in…

Machine Learning · Computer Science 2024-04-23 Da Long , Wei W. Xing , Aditi S. Krishnapriyan , Robert M. Kirby , Shandian Zhe , Michael W. Mahoney

The multivariate adaptive regression spline (MARS) is one of the popular estimation methods for nonparametric multivariate regressions. However, as MARS is based on marginal splines, to incorporate interactions of covariates, products of…

Methodology · Statistics 2023-07-06 Yu Liu , Degui Li , Yingcun Xia

We introduce varbvs, a suite of functions written in R and MATLAB for regression analysis of large-scale data sets using Bayesian variable selection methods. We have developed numerical optimization algorithms based on variational…

Computation · Statistics 2017-09-21 Peter Carbonetto , Xiang Zhou , Matthew Stephens

Variational Bayes (VB) is a popular scalable alternative to Markov chain Monte Carlo for Bayesian inference. We study a mean-field spike and slab VB approximation of widely used Bayesian model selection priors in sparse high-dimensional…

Machine Learning · Statistics 2021-09-07 Kolyan Ray , Botond Szabo , Gabriel Clara

Multilabel Classification (MLC) deals with the simultaneous classification of multiple binary labels. The task is challenging because, not only may there be arbitrarily different and complex relationships between predictor variables and…

Methodology · Statistics 2026-01-15 Jiahao Tian , Hugh Chipman , Thomas Loughin

This paper presents the use of spike-and-slab (SS) priors for discovering governing differential equations of motion of nonlinear structural dynamic systems. The problem of discovering governing equations is cast as that of selecting…

Methodology · Statistics 2021-06-02 Rajdip Nayek , Ramon Fuentes , Keith Worden , Elizabeth J. Cross