English
Related papers

Related papers: Nonparametric function-on-scalar regression using …

200 papers

This paper establishes statistical properties of deep neural network (DNN) estimators under dependent data. Two general results for nonparametric sieve estimators directly applicable to DNN estimators are given. The first establishes rates…

Machine Learning · Statistics 2025-01-16 Chad Brown

We consider nonparametric regression with functional covariates, that is, they are elements of an infinite-dimensional Hilbert space. A locally polynomial estimator is constructed, where an orthonormal basis and various tuning parameters…

Statistics Theory · Mathematics 2025-04-09 Moritz Jirak , Alois Kneip , Alexander Meister , Mario Pahl

Debiased machine learning estimators for smooth functionals in nonparametric models can exhibit substantial variability and instability, often leading practitioners to instead rely on parametric or semiparametric working models. Such…

Methodology · Statistics 2026-03-20 Lars van der Laan , Marco Carone , Alex Luedtke , Mark van der Laan

The function-on-function linear regression model in which the response and predictors consist of random curves has become a general framework to investigate the relationship between the functional response and functional predictors.…

Methodology · Statistics 2021-11-03 Ufuk Beyaztas , Han Lin Shang

Semi-structured networks (SSNs) merge the structures familiar from additive models with deep neural networks, allowing the modeling of interpretable partial feature effects while capturing higher-order non-linearities at the same time. A…

Machine Learning · Computer Science 2024-10-15 David Rügamer , Bernard X. W. Liew , Zainab Altai , Almond Stöcker

Spherical regression explores relationships between variables on spherical domains. We develop a nonparametric model that uses a diffeomorphic map from a sphere to itself. The restriction of this mapping to diffeomorphisms is natural in…

Other Statistics · Statistics 2017-02-06 Michael Rosenthal , Wei Wu , Eric Klassen , Anuj Srivastava

Fully nonparametric methods for regression from functional data have poor accuracy from a statistical viewpoint, reflecting the fact that their convergence rates are slower than nonparametric rates for the estimation of high-dimensional…

Statistics Theory · Mathematics 2012-11-22 Dong Chen , Peter Hall , Hans-Georg Müller

The goal of regression is to recover an unknown underlying function that best links a set of predictors to an outcome from noisy observations. In nonparametric regression, one assumes that the regression function belongs to a pre-specified…

Statistics Theory · Mathematics 2022-01-10 Tianyu Zhang , Noah Simon

Spatially distributed functional data are prevalent in many statistical applications such as meteorology, energy forecasting, census data, disease mapping, and neurological studies. Given their complex and high-dimensional nature,…

Statistics Theory · Mathematics 2024-02-06 Suneel Babu Chatla , Ruiqi Liu

A key question in modern statistics is how to make fast and reliable inferences for complex, high-dimensional data. While there has been much interest in sparse techniques, current methods do not generalize well to data with nonlinear…

Methodology · Statistics 2016-11-01 Ann B. Lee , Rafael Izbicki

We investigate the asymptotic properties of the L\'evy Adaptive B-spline (LABS) regression model, a Bayesian nonparametric method that incorporates B-spline kernels into the L\'evy Adaptive Regression Kernel (LARK) model. LABS applies…

Machine Learning · Statistics 2026-05-20 Jeunghun Oh , Sewon Park , Jaeyong Lee

We propose a method for nonstationary covariance function modeling, based on the spatial deformation method of Sampson and Guttorp [1992], but using a low-rank, scalable deformation function written as a linear combination of the tensor…

Methodology · Statistics 2020-07-03 Ronaldo Dias , Guilherme Ludwig , Paul Sampson

Bifurcating autoregressive processes, which can be seen as an adaptation of au-toregressive processes for a binary tree structure, have been extensively studied during the last decade in a parametric context. In this work we do not specify…

Statistics Theory · Mathematics 2016-02-12 Siméon Valère Bitseki Penda , Adélaïde Olivier

Traditional linear methods for forecasting multivariate time series are not able to satisfactorily model the non-linear dependencies that may exist in non-Gaussian series. We build on the theory of learning vector-valued functions in the…

Machine Learning · Computer Science 2017-06-28 Magda Gregorová , Alexandros Kalousis , Stéphane Marchand-Maillet

Variational mean field approximations tend to struggle with contemporary overparametrized deep neural networks. Where a Bayesian treatment is usually associated with high-quality predictions and uncertainties, the practical reality has been…

Let $\mathbf{x}_j = \mathbf{\theta} + \mathbf{\epsilon}_j$, $j=1,\dots,n$ be i.i.d. copies of a Gaussian random vector $\mathbf{x}\sim\mathcal{N}(\mathbf{\theta},\mathbf{\Sigma})$ with unknown mean $\mathbf{\theta} \in \mathbb{R}^d$ and…

Statistics Theory · Mathematics 2020-12-23 Fan Zhou , Ping Li

This article introduces a novel nonparametric methodology for Generalized Linear Models which combines the strengths of the binary regression and latent variable formulations for categorical data, while overcoming their disadvantages.…

Machine Learning · Statistics 2021-10-12 K. P. Chowdhury

We present a new method for high-dimensional linear regression when a scale parameter of the additive errors is unknown. The proposed estimator is based on a penalized Huber $M$-estimator, for which theoretical results on estimation error…

Statistics Theory · Mathematics 2018-11-07 Po-Ling Loh

Sufficient dimension reduction is a powerful tool to extract core information hidden in the high-dimensional data and has potentially many important applications in machine learning tasks. However, the existing nonlinear sufficient…

Machine Learning · Computer Science 2022-10-11 Siqi Liang , Yan Sun , Faming Liang

We propose a novel approach to nonlinear functional regression, called the Mapping-to-Parameter function model, which addresses complex and nonlinear functional regression problems in parameter space by employing any supervised learning…

Machine Learning · Computer Science 2024-01-29 Chengdong Shi , Ching-Hsun Tseng , Wei Zhao , Xiao-Jun Zeng