English
Related papers

Related papers: Consistency of functional learning methods based o…

200 papers

In the last few decades, building regression models for non-scalar variables, including time series, text, image, and video, has attracted increasing interests of researchers from the data analytic community. In this paper, we focus on a…

Machine Learning · Computer Science 2020-12-01 Qiyao Wang , Haiyan Wang , Chetan Gupta , Aniruddha Rajendra Rao , Hamed Khorasgani

Deep networks realize complex mappings that are often understood by their locally linear behavior at or around points of interest. For example, we use the derivative of the mapping with respect to its inputs for sensitivity analysis, or to…

Machine Learning · Computer Science 2019-07-09 Guang-He Lee , David Alvarez-Melis , Tommi S. Jaakkola

The order of smoothness chosen in nonparametric estimation problems is critical. This choice balances the tradeoff between model parsimony and data overfitting. The most common approach used in this context is cross-validation. However,…

Methodology · Statistics 2015-10-13 Daniel Taylor-Rodriguez , Sujit Ghosh

We study nonparametric covariance function estimation for functional data observed with noise at discrete locations on a $d$-dimensional domain. Estimating the covariance function from discretely observed data is a challenging nonparametric…

Statistics Theory · Mathematics 2026-03-25 Yoshikazu Terada , Atsutomo Yara

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach

Complex systems in science and engineering sometimes exhibit behavior that changes across different regimes. Traditional global models struggle to capture the full range of this complex behavior, limiting their ability to accurately…

Machine Learning · Computer Science 2023-07-24 Okezzi F. Ukorigho , Opeoluwa Owoyele

Multivariate functions emerge naturally in a wide variety of data-driven models. Popular choices are expressions in the form of basis expansions or neural networks. While highly effective, the resulting functions tend to be hard to…

Machine Learning · Statistics 2022-06-15 Jan Decuyper , Koen Tiels , Siep Weiland , Mark C. Runacres , Johan Schoukens

This paper investigates signal prediction through the perfect reconstruction of signals from shift-invariant spaces using nonuniform samples of both the signal and its derivatives. The key advantage of derivative sampling is its ability to…

Information Theory · Computer Science 2025-12-29 Sreya T , Riya Ghosh , A. Antony Selvan

We propose a framework for computing, optimizing and integrating with respect to a smooth marginal likelihood in statistical models that involve high-dimensional parameters/latent variables and continuous low-dimensional hyperparameters.…

Methodology · Statistics 2026-02-10 Omiros Papaspiliopoulos , Timothée Stumpf-Fétizon , Jonathan Weare

We propose a generalized partially linear functional single index risk score model for repeatedly measured outcomes where the index itself is a function of time. We fuse the nonparametric kernel method and regression spline method, and…

Statistics Theory · Mathematics 2015-10-15 Fei Jiang , Yanyuan Ma , Yuanjia Wang

We extend nonparametric regression smoothing splines to a context where there is endogeneity and instrumental variables are available. Unlike popular existing estimators, the resulting estimator is one-step and relies on a unique…

Econometrics · Economics 2024-12-10 Jad Beyhum , Elia Lapenta , Pascal Lavergne

Sparse functional/longitudinal data have attracted widespread interest due to the prevalence of such data in social and life sciences. A prominent scenario where such data are routinely encountered are accelerated longitudinal studies,…

Methodology · Statistics 2024-06-24 Yidong Zhou , Hans-Georg Müller

In functional linear regression, the parameters estimation involves solving a non necessarily well-posed problem and it has points of contact with a range of methodologies, including statistical smoothing, deconvolution and projection on…

Statistics Theory · Mathematics 2018-01-04 Andrea Ghiglietti , Francesca Ieva , Anna Maria Paganoni , Giacomo Aletti

We present a sampling-based control approach that can generate smooth actions for general nonlinear systems without external smoothing algorithms. Model Predictive Path Integral (MPPI) control has been utilized in numerous robotic…

Robotics · Computer Science 2025-10-15 Taekyung Kim , Gyuhyun Park , Kiho Kwak , Jihwan Bae , Wonsuk Lee

The stock assessment model SAM contains a large number of age-dependent parameters that must be manually grouped together to obtain robust inference. This can make the model selection process slow, non-extensive and highly subjective, while…

Applications · Statistics 2025-07-29 Silius M. Vandeskog , Magne Aldrin , Daniel Howell , Edvin Fuglebakk

Functions on a bounded domain in scientific computing are often approximated using piecewise polynomial approximations on meshes that adapt to the shape of the geometry. We study the problem of function approximation using splines on a…

Numerical Analysis · Mathematics 2020-08-27 Vincent Coppé , Daan Huybrechs

Classification is a core topic in functional data analysis. A large number of functional classifiers have been proposed in the literature, most of which are based on functional principal component analysis or functional regression. In…

Methodology · Statistics 2025-10-14 Ruoxu Tan , Yiming Zang

Multi-dimensional functional data arises in numerous modern scientific experimental and observational studies. In this paper we focus on longitudinal functional data, a structured form of multidimensional functional data. Operating within a…

Methodology · Statistics 2019-09-20 John Shamshoian , Damla Senturk , Shafali Jeste , Donatello Telesca

In this paper, we consider derivative free optimization problems, where the objective function is smooth but is computed with some amount of noise, the function evaluations are expensive and no derivative information is available. We are…

Optimization and Control · Mathematics 2019-06-05 Albert S Berahas , Liyuan Cao , Krzysztof Choromanski , Katya Scheinberg

We propose a novel learning-based approach for robust 3D shape matching. Our method builds upon deep functional maps and can be trained in a fully unsupervised manner. Previous deep functional map methods mainly focus on predicting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Paul Roetzer , Florian Bernard