English
Related papers

Related papers: On linear regression models in infinite dimensiona…

200 papers

We propose a new method for input variable selection in nonlinear regression. The method is embedded into a kernel regression machine that can model general nonlinear functions, not being a priori limited to additive models. This is the…

Machine Learning · Computer Science 2018-09-05 Magda Gregorová , Jason Ramapuram , Alexandros Kalousis , Stéphane Marchand-Maillet

We propose a principal components regression method based on maximizing a joint pseudo-likelihood for responses and predictors. Our method uses both responses and predictors to select linear combinations of the predictors relevant for the…

Methodology · Statistics 2021-08-10 Karl Oskar Ekvall

In this paper, the estimation of parameters in the harmonic regression with cyclically dependent errors is addressed. Asymptotic properties of the least-squares estimates are analyzed by simulation experiments. By numerical simulation, we…

We consider an enlarged dimension reduction space in functional inverse regression. Our operator and functional analysis based approach facilitates a compact and rigorous formulation of the functional inverse regression problem. It also…

Statistics Theory · Mathematics 2015-03-13 Ting-Li Chen , Su-Yun Huang , Yanyuan Ma , I-Ping Tu

We investigate the problem of statistical inference for logistic regression with high-dimensional covariates in settings where dependence among individuals is induced by an underlying Markov random field. Going beyond the pairwise…

Statistics Theory · Mathematics 2026-03-23 Josh Miles , Sohom Bhattacharya

Various indicators and measures of the real life procedures rise up as functionals of the quantile process of a parent random variable Z. However, Z can be observed only through a response in a linear model whose covariates are not under…

Methodology · Statistics 2024-04-04 Jana Jurečková , Jan Picek , Jan Kalina

Recent technological developments have enabled us to collect complex and high-dimensional data in many scientific fields, such as population health, meteorology, econometrics, geology, and psychology. It is common to encounter such datasets…

Methodology · Statistics 2020-03-16 Ufuk Beyaztas , Han Lin Shang

In practice functional data are sampled on a discrete set of observation points and often susceptible to noise. We consider in this paper the setting where such data are used as explanatory variables in a regression problem. If the primary…

Methodology · Statistics 2021-12-14 Siegfried Hörmann , Fatima Jammoul

This book is meant to provide an introduction to linear models and the theories behind them. Our goal is to give a rigorous introduction to the readers with prior exposure to ordinary least squares. In machine learning, the output is…

Machine Learning · Computer Science 2025-05-12 Jun Lu

Unsupervised machine learning lacks ground truth by definition. This poses a major difficulty when designing metrics to evaluate the performance of such algorithms. In sharp contrast with supervised learning, for which plenty of quality…

Machine Learning · Computer Science 2023-03-20 Raúl Lara-Cabrera , Ángel González-Prieto , Diego Pérez-López , Diego Trujillo , Fernando Ortega

Recently, deep learning has been widely applied in functional data analysis (FDA) with notable empirical success. However, the infinite dimensionality of functional data necessitates an effective dimension reduction approach for functional…

Machine Learning · Statistics 2025-05-13 Zhongjie Shi , Jun Fan , Linhao Song , Ding-Xuan Zhou , Johan A. K. Suykens

We consider the task of low-multilinear-rank functional regression, i.e., learning a low-rank parametric representation of functions from scattered real-valued data. Our first contribution is the development and analysis of an efficient…

Computation · Statistics 2018-09-26 Alex A. Gorodetsky , John D. Jakeman

This paper studies the subspace segmentation problem which aims to segment data drawn from a union of multiple linear subspaces. Recent works by using sparse representation, low rank representation and their extensions attract much…

Computer Vision and Pattern Recognition · Computer Science 2014-04-29 Can-Yi Lu , Hai Min , Zhong-Qiu Zhao , Lin Zhu , De-Shuang Huang , Shuicheng Yan

We consider the problem of estimating the regression function in functional linear regression models by proposing a new type of projection estimators which combine dimension reduction and thresholding. The introduction of a threshold rule…

Methodology · Statistics 2009-12-19 Herve Cardot , Jan Johannes

It is often of interest to make inference on an unknown function that is a local parameter of the data-generating mechanism, such as a density or regression function. Such estimands can typically only be estimated at a…

Methodology · Statistics 2021-05-17 Aaron Hudson , Marco Carone , Ali Shojaie

We study regression discontinuity designs in which many predetermined covariates, possibly much more than the number of observations, can be used to increase the precision of treatment effect estimates. We consider a two-step estimator…

Econometrics · Economics 2022-05-06 Alexander Kreiß , Christoph Rothe

This paper studies the problem of parameter estimation in resonant, acoustic fluid-structure interaction problems over a wide frequency range. Problems with multiple resonances are known to be subjected to local minima, which represents a…

Computational Physics · Physics 2019-03-06 Peter Göransson , Jacques Cuenca , Timo Lähivaara

Additive regression provides an extension of linear regression by modeling the signal of a response as a sum of functions of covariates of relatively low complexity. We study penalized estimation in high-dimensional nonparametric additive…

Statistics Theory · Mathematics 2017-04-25 Zhiqiang Tan , Cun-Hui Zhang

This paper addresses the problem of providing robust estimators under a functional logistic regression model. Logistic regression is a popular tool in classification problems with two populations. As in functional linear regression,…

Methodology · Statistics 2023-08-16 Graciela Boente , Marina Valdora

This paper studies optimal estimation of large-dimensional nonlinear factor models. The key challenge is that the observed variables are possibly nonlinear functions of some latent variables where the functional forms are left unspecified.…

Statistics Theory · Mathematics 2023-11-14 Yingjie Feng