English
Related papers

Related papers: Sharp Debiasing for Smooth Functional Estimation i…

200 papers

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be…

Methodology · Statistics 2016-05-10 Simon N. Wood , Natalya Pya , Benjamin Säfken

We consider the task of computing an approximate minimizer of the sum of a smooth and non-smooth convex functional, respectively, in Banach space. Motivated by the classical forward-backward splitting method for the subgradients in Hilbert…

Numerical Analysis · Mathematics 2009-11-13 Kristian Bredies

We address the problem of learning an unknown smooth function and its derivatives from noisy pointwise evaluations under the supremum norm. While classical nonparametric regression provides a strong theoretical foundation, traditional…

Machine Learning · Computer Science 2026-03-10 Davide Maran , Marcello Restelli

We provide a MATLAB toolbox, BFDA, that implements a Bayesian hierarchical model to smooth multiple functional data with the assumptions of the same underlying Gaussian process distribution, a Gaussian process prior for the mean function,…

Other Statistics · Statistics 2017-02-06 Jingjing Yang , Peng Ren

Non-parametric inference for functional data over two-dimensional domains entails additional computational and statistical challenges, compared to the one-dimensional case. Separability of the covariance is commonly assumed to address these…

Methodology · Statistics 2021-03-19 Tomas Masak , Tomas Rubin , Victor Panaretos

Estimation and inference on causal parameters is typically reduced to a generalized method of moments problem, which involves auxiliary functions that correspond to solutions to a regression or classification problem. Recent line of work on…

Econometrics · Economics 2022-11-16 Qizhao Chen , Vasilis Syrgkanis , Morgane Austern

This paper studies a Bayesian approach to non-asymptotic minimax adaptation in nonparametric estimation. Estimating an input function on the basis of output functions in a Gaussian white-noise model is discussed. The input function is…

Statistics Theory · Mathematics 2018-08-30 Keisuke Yano , Fumiyasu Komaki

In this paper, in a multivariate setting we derive near optimal rates of convergence in the minimax sense for estimating partial derivatives of the mean function for functional data observed under a fixed synchronous design over H\"older…

Statistics Theory · Mathematics 2025-08-25 Max Berger , Hajo Holzmann

We study the problem of estimation of the value N_gamma(\theta) = sum(i=1)^d |\theta_i|^gamma for 0 < gamma <= 1 based on the observations y_i = \theta_i + \epsilon\xi_i, i = 1,...,d, where \theta = (\theta_1,...,\theta_d) are unknown…

Statistics Theory · Mathematics 2019-10-08 Olivier Collier , Laëtitia Comminges , Alexandre B. Tsybakov

We consider the problem of estimating the mean vector $\theta$ of a $d$-dimensional spherically symmetric distributed $X$ based on balanced loss functions of the forms: {\bf (i)} $\omega \rho(\|\de-\de_{0}\|^{2}) +(1-\omega)\rho(\|\de -…

Statistics Theory · Mathematics 2021-02-26 Lahoucine Hobbad , Éric Marchand , Idir Ouassou

Smooth Estimation of probability density and distribution functions from its sample is an attractive and an important problem that has applications in several fields such as, business, medicine, and environment. This article introduces a…

Methodology · Statistics 2025-04-02 Elsayed A. H. Elamir

We consider estimating the shared mean of a sequence of heavy-tailed random variables taking values in a Banach space. In particular, we revisit and extend a simple truncation-based mean estimator first proposed by Catoni and Giulini. While…

Statistics Theory · Mathematics 2025-03-25 Justin Whitehouse , Ben Chugg , Diego Martinez-Taboada , Aaditya Ramdas

Diffusion models achieve remarkable generation quality, yet face a fundamental challenge known as memorization, where generated samples can replicate training samples exactly. We develop a theoretical framework to explain this phenomenon by…

Machine Learning · Computer Science 2026-03-31 Xinyu Zhou , Jiawei Zhang , Stephen J. Wright

We define a smooth functional calculus for a non-commuting tuple of (unbounded) operators $A_j$ on a Banach space with real spectra and resolvents with temperate growth, by means of an iterated Cauchy formula. The construction is also…

Spectral Theory · Mathematics 2007-05-23 Mats Andersson , Johannes Sjoestrand

In the framework of scalar-on-function regression models, in which several functional variables are employed to predict a scalar response, we propose a methodology for selecting relevant functional predictors while simultaneously providing…

Methodology · Statistics 2026-02-19 Hedayat Fathi , Marzia A. Cremona , Federico Severino

In this paper we introduce a new class of diffeomorphic smoothers based on general spline smoothing techniques and on the use of some tools that have been recently developed in the context of image warping to compute smooth diffeomorphisms.…

Statistics Theory · Mathematics 2009-12-07 Jeremie bigot , Sebastien Gadat

The moment conditions or estimating equations for instrumental variables quantile regression involve the discontinuous indicator function. We instead use smoothed estimating equations (SEE), with bandwidth $h$. We show that the mean squared…

Methodology · Statistics 2018-02-28 David M. Kaplan , Yixiao Sun

Sampling-based methods, e.g., Deep Ensembles and Bayesian Neural Nets have become promising approaches to improve the quality of uncertainty estimation and robust generalization. However, they suffer from a large model size and high latency…

Machine Learning · Computer Science 2024-05-29 Ha Manh Bui , Anqi Liu

We propose here a smooth estimator of the mean residual life function based on randomly censored data. This is derived by smoothing the product-limit estimator using the Chaubey-Sen technique (Chaubey and Sen (1998)). The resulting…

Statistics Theory · Mathematics 2008-12-18 Yogendra P. Chaubey , Arusharka Sen

The order of smoothness chosen in nonparametric estimation problems is critical. This choice balances the tradeoff between model parsimony and data overfitting. The most common approach used in this context is cross-validation. However,…

Methodology · Statistics 2015-10-13 Daniel Taylor-Rodriguez , Sujit Ghosh