English
Related papers

Related papers: Consistency of functional learning methods based o…

200 papers

This paper studies linear reconstruction of partially observed functional data which are recorded on a discrete grid. We propose a novel estimation approach based on approximate factor models with increasing rank taking into account…

Statistics Theory · Mathematics 2024-05-22 Maximilian Ofner , Siegfried Hörmann

Regression splines are smooth, flexible, and parsimonious nonparametric function estimators. They are known to be sensitive to knot number and placement, but if assumptions such as monotonicity or convexity may be imposed on the regression…

Applications · Statistics 2008-11-12 Mary C. Meyer

Spatial prediction problems often use Gaussian process models, which can be computationally burdensome in high dimensions. Specification of an appropriate covariance function for the model can be challenging when complex non-stationarities…

Methodology · Statistics 2024-09-13 Qi Wang , Paul A. Parker , Robert B. Lund

This paper presents some applications using recently developed algorithms for smooth-continuous data reconstruction based on the digital-discrete method. The classical discrete method for data reconstruction is based on domain decomposition…

Numerical Analysis · Mathematics 2010-03-23 Li Chen

We consider the problem of estimating an unknown function f* and its partial derivatives from a noisy data set of n observations, where we make no assumptions about f* except that it is smooth in the sense that it has square integrable…

Machine Learning · Statistics 2024-05-17 Eunji Lim

In this paper we develop and study adaptive empirical Bayesian smoothing splines. These are smoothing splines with both smoothing parameter and penalty order determined via the empirical Bayes method from the marginal likelihood of the…

Statistics Theory · Mathematics 2015-11-18 Paulo Serra , Tatyana Krivobokova

This paper presents a new methodology, called AFSSEN, to simultaneously select significant predictors and produce smooth estimates in a high-dimensional function-on-scalar linear model with a sub-Gaussian errors. Outcomes are assumed to lie…

Methodology · Statistics 2019-05-27 Ardalan Mirshani , Matthew Reimherr

As machine learning continues to gain momentum in the neuroscience community, we witness the emergence of novel applications such as diagnostics, characterization, and treatment outcome prediction for psychiatric and neurological disorders,…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Maxim Sharaev , Alexander Andreev , Alexey Artemov , Alexander Bernstein , Evgeny Burnaev , Ekaterina Kondratyeva , Svetlana Sushchinskaya , Renat Akzhigitov

One of the basic principles of Approximation Theory is that the quality of approximations increase with the smoothness of the function to be approximated. Functions that are smooth in certain subdomains will have good approximations in…

Numerical Analysis · Mathematics 2016-12-23 Licia Lenarduzzi , Robert Schaback

A core principle in statistical learning is that smoothness of target functions allows to break the curse of dimensionality. However, learning a smooth function seems to require enough samples close to one another to get meaningful estimate…

Machine Learning · Statistics 2023-10-18 Vivien Cabannes , Stefano Vigogna

Uncertainty quantification for neural operators remains an open problem in the infinite-dimensional setting due to the lack of finite-sample coverage guarantees over functional outputs. While conformal prediction offers finite-sample…

Machine Learning · Computer Science 2025-09-08 David Millard , Lars Lindemann , Ali Baheri

Normalizing flows attempt to model an arbitrary probability distribution through a set of invertible mappings. These transformations are required to achieve a tractable Jacobian determinant that can be used in high-dimensional scenarios.…

Machine Learning · Statistics 2020-04-14 Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

The focus of modern biomedical studies has gradually shifted to explanation and estimation of joint effects of high dimensional predictors on disease risks. Quantifying uncertainty in these estimates may provide valuable insight into…

Methodology · Statistics 2021-03-09 Zhe Fei , Yi Li

Data noising is an effective technique for regularizing neural network models. While noising is widely adopted in application domains such as vision and speech, commonly used noising primitives have not been developed for discrete…

Machine Learning · Computer Science 2017-03-09 Ziang Xie , Sida I. Wang , Jiwei Li , Daniel Lévy , Aiming Nie , Dan Jurafsky , Andrew Y. Ng

Functional time series analysis, whether based on time of frequency domain methodology, has traditionally been carried out under the assumption of complete observation of the constituent series of curves, assumed stationary. Nevertheless,…

Methodology · Statistics 2020-04-02 Tomáš Rubín , Victor M. Panaretos

This paper explores the critical role of differentiation approaches for data-driven differential equation discovery. Accurate derivatives of the input data are essential for reliable algorithmic operation, particularly in real-world…

Machine Learning · Computer Science 2023-11-13 Mikhail Masliaev , Ilya Markov , Alexander Hvatov

Stochastic differential equations (SDEs) provide a flexible framework for modeling temporal dynamics in partially observed systems. A central task is to calibrate such models from data, which requires inferring latent trajectories and…

Machine Learning · Statistics 2026-05-08 Yu Wang , Arnab Ganguly

Understanding the learning dynamics and inductive bias of neural networks (NNs) is hindered by the opacity of the relationship between NN parameters and the function represented. We propose reparametrizing ReLU NNs as continuous piecewise…

Machine Learning · Computer Science 2020-08-06 Justin Sahs , Ryan Pyle , Aneel Damaraju , Josue Ortega Caro , Onur Tavaslioglu , Andy Lu , Ankit Patel

Sparse system identification of nonlinear dynamic systems is still challenging, especially for stiff and high-order differential equations for noisy measurement data. The use of highly correlated functions makes distinguishing between true…

Computational Physics · Physics 2025-12-19 Ashish Pal , Sutanu Bhowmick , Satish Nagarajaiah

We propose nonparametric methods for functional linear regression which are designed for sparse longitudinal data, where both the predictor and response are functions of a covariate such as time. Predictor and response processes have smooth…

Statistics Theory · Mathematics 2016-08-16 Fang Yao , Hans-Georg Müller , Jane-Ling Wang