English
Related papers

Related papers: Methodology and convergence rates for functional l…

200 papers

Kernel methods for deconvolution have attractive features, and prevail in the literature. However, they have disadvantages, which include the fact that they are usually suitable only for cases where the error distribution is infinitely…

Statistics Theory · Mathematics 2009-09-29 Peter Hall , Alexander Meister

We prove the local convergence to minima and estimates on the rate of convergence for the stochastic gradient descent method in the case of not necessarily globally convex nor contracting objective functions. In particular, the results are…

Numerical Analysis · Mathematics 2021-11-02 Benjamin Fehrman , Benjamin Gess , Arnulf Jentzen

De-Rating or Vulnerability Factors are a major feature of failure analysis efforts mandated by today's Functional Safety requirements. Determining the Functional De-Rating of sequential logic cells typically requires computationally…

Machine Learning · Computer Science 2020-02-25 Thomas Lange , Aneesh Balakrishnan , Maximilien Glorieux , Dan Alexandrescu , Luca Sterpone

Kernel methods are powerful learning methodologies that allow to perform non-linear data analysis. Despite their popularity, they suffer from poor scalability in big data scenarios. Various approximation methods, including random feature…

Machine Learning · Statistics 2022-06-14 Bharath Sriperumbudur , Nicholas Sterge

In this paper, we propose a new semiparametric regression estimator by using a hybrid technique of a parametric approach and a nonparametric penalized spline method. The overall shape of the true regression function is captured by the…

Statistics Theory · Mathematics 2012-02-17 Takuma Yoshida , Kanta Naito

The functional linear model extends the notion of linear regression to the case where the response and covariates are iid elements of an infinite dimensional Hilbert space. The unknown to be estimated is a Hilbert-Schmidt operator, whose…

Statistics Theory · Mathematics 2016-12-22 Tung Pham , Victor Panaretos

Subsampling is an efficient method to deal with massive data. In this paper, we investigate the optimal subsampling for linear quantile regression when the covariates are functions. The asymptotic distribution of the subsampling estimator…

Numerical Analysis · Mathematics 2022-05-06 Qian Yan , Hanyu Li , Chengmei Niu

Principal component analysis (PCA) is a widely used dimension reduction technique in machine learning and multivariate statistics. To improve the interpretability of PCA, various approaches to obtain sparse principal direction loadings have…

Data Structures and Algorithms · Computer Science 2021-06-07 Agniva Chowdhury , Petros Drineas , David P. Woodruff , Samson Zhou

The problem of optimal linear estimation of linear functionals depending on the unknown values of a periodically correlated stochastic process from observations of the process with additive noise is considered. Formulas for calculating the…

Statistics Theory · Mathematics 2025-10-29 Iryna Dubovets'ka , Mykhailo Moklyachuk

Modern applications require methods that are computationally feasible on large datasets but also preserve statistical efficiency. Frequently, these two concerns are seen as contradictory: approximation methods that enable computation are…

Methodology · Statistics 2021-06-11 Darren Homrighausen , Daniel J. McDonald

Tensor regression has attracted significant attention in statistical research. This study tackles the challenge of handling covariates with smooth varying structures. We introduce a novel framework, termed functional tensor regression,…

Methodology · Statistics 2025-06-12 Tongyu Li , Fang Yao , Anru R. Zhang

Software fault prediction (SFP) is a critical task in software engineering, enabling early identification of faults in modules to improve software quality and reduce maintenance costs. This research investigates the combined effects of…

Software Engineering · Computer Science 2026-05-19 Ahmad Nauman Ghazi , Nagajyothi Devarapalli , Ashir Javeed , Sadi Alawadi , Fahed Alkhabbas , Khalid AlKharabsheh

Classical functional linear regression models the relationship between a scalar response and a functional covariate, where the coefficient function is assumed to be identical for all subjects. In this paper, the classical model is extended…

Methodology · Statistics 2022-11-29 Yifan Sun , Ziyi Liu , Wu Wang

Flexible estimation of the mean outcome under a treatment regimen (i.e., value function) is the key step toward personalized medicine. We define our target parameter as a conditional value function given a set of baseline covariates which…

Statistics Theory · Mathematics 2023-09-29 Ashkan Ertefaie , Luke Duttweiler , Brent A. Johnson , Mark J. van der Laan

The goal of regression analysis is to predict the value of a numeric outcome variable y given a vector of joint values of other (predictor) variables x. Usually a particular x-vector does not specify a repeatable value for y, but rather a…

Machine Learning · Statistics 2020-01-29 Jerome H. Friedman

The problem of optimal linear estimation of a linear functional depending on the unknown values of periodically correlated stochastic process from observations of the process with additive noise is considered. Formulas for calculating the…

Statistics Theory · Mathematics 2025-11-20 Iryna Dubovets'ka , Mykhailo Moklyachuk

The regression of principal component scores (RPCS) on covariates is a widely used analytic approach to detect and test for associations between functional measurements and study participant characteristics. Here we show that: (1) RPCS…

Methodology · Statistics 2026-05-26 Yu Lu , Nidhi Pai , Erjia Cui , Ciprian Crainiceanu

In many high-dimensional estimation problems the main task consists in minimizing a cost function, which is often strongly non-convex when scanned in the space of parameters to be estimated. A standard solution to flatten the corresponding…

Machine Learning · Statistics 2020-09-04 Giulio Biroli , Chiara Cammarota , Federico Ricci-Tersenghi

Functional principal component analysis (FPCA) is a fundamental tool and has attracted increasing attention in recent decades, while existing methods are restricted to data with a single or finite number of random functions (much smaller…

Methodology · Statistics 2021-01-22 Xiaoyu Hu , Fang Yao

Functional data analysis is an important research field in statistics which treats data as random functions drawn from some infinite-dimensional functional space, and functional principal component analysis (FPCA) based on…

Statistics Theory · Mathematics 2024-04-03 Hang Zhou , Dongyi Wei , Fang Yao