English
Related papers

Related papers: A reproducing kernel Hilbert space framework for f…

200 papers

In this paper, we consider regression models with a Hilbert-space-valued predictor and a scalar response, where the response depends on the predictor only through a finite number of projections. The linear subspace spanned by these…

Statistics Theory · Mathematics 2010-11-12 Yehua Li , Tailen Hsing

The notion of generalization in classical Statistical Learning is often attached to the postulate that data points are independent and identically distributed (IID) random variables. While relevant in many applications, this postulate may…

Machine Learning · Computer Science 2020-09-15 Simon Foucart , Chunyang Liao , Shahin Shahrampour , Yinsong Wang

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

Variable selection is essential in high-dimensional data analysis. Although various variable selection methods have been developed, most rely on the linear model assumption. This article proposes a nonparametric variable selection method…

Machine Learning · Statistics 2021-09-30 Jongkyeong Kang , Seung Jun Shin

This paper provides a unifying view of a wide range of problems of interest in machine learning by framing them as the minimization of functionals defined on the space of probability measures. In particular, we show that generative…

Machine Learning · Computer Science 2019-05-21 Casey Chu , Jose Blanchet , Peter Glynn

Regressing a scalar response on a random function is nowadays a common situation. In the nonparametric setting, this paper paves the way for making the local linear regression based on a projection approach a prominent method for solving…

Methodology · Statistics 2019-07-19 Frédéric Ferraty , Stanislav Nagy

We study in this paper a smoothness regularization method for functional linear regression and provide a unified treatment for both the prediction and estimation problems. By developing a tool on simultaneous diagonalization of two positive…

Statistics Theory · Mathematics 2012-11-13 Ming Yuan , T. Tony Cai

We study a non linear regression model with functional data as inputs and scalar response. We propose a pointwise estimate of the regression function that maps a Hilbert space onto the real line by a local linear method. We provide the…

Statistics Theory · Mathematics 2013-02-20 Alain Berlinet , Abdallah Elamine , André Mas

This paper presents a close form solution in Reproducing Kernel Hilbert Space (RKHS) for the famed Wiener filter, which we called the functional Wiener filter(FWF). Instead of using the Wiener-Hopf factorization theory, here we define a new…

Signal Processing · Electrical Eng. & Systems 2023-01-03 Benjamin Colburn , Luis G. Sanchez Giraldo , Jose C. Principe

This paper considers the problem of kernel regression and classification with possibly unobservable response variables in the data, where the mechanism that causes the absence of information is unknown and can depend on both predictors and…

Statistics Theory · Mathematics 2022-12-07 Majid Mojirsheibani , William Pouliot , Andre Shakhbandaryan

Accurate and efficient environment representation is crucial for robotic applications such as motion planning, manipulation, and navigation. Signed distance functions (SDFs) have emerged as a powerful representation for encoding distance to…

Robotics · Computer Science 2026-04-01 Zhirui Dai , Tianxing Fan , Mani Amani , Jaemin Seo , Ki Myung Brian Lee , Hyondong Oh , Nikolay Atanasov

Data imputation, the process of filling in missing feature elements for incomplete data sets, plays a crucial role in data-driven learning. A fundamental belief is that data imputation is helpful for learning performance, and it follows…

Machine Learning · Computer Science 2025-09-30 Ruikai Yang , Fan He , Mingzhen He , Kaijie Wang , Xiaolin Huang

The regression of a functional response on a set of scalar predictors can be a challenging task, especially if there is a large number of predictors, or the relationship between those predictors and the response is nonlinear. In this work,…

Machine Learning · Statistics 2023-08-24 Sidi Wu , Cédric Beaulac , Jiguo Cao

The theory of positive kernels and associated reproducing kernel Hilbert spaces, especially in the setting of holomorphic functions, has been an important tool for the last several decades in a number of areas of complex analysis and…

Operator Algebras · Mathematics 2016-02-03 Joseph A. Ball , Gregory Marx , Victor Vinnikov

In this draft, fault diagnosis in nonlinear dynamic systems is addressed. The objective of this work is to establish a framework, in which not only model-based but also data-driven and machine learning based fault diagnosis strategies can…

Systems and Control · Electrical Eng. & Systems 2023-10-27 Steven X. Ding , Linlin Li

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to…

Machine Learning · Computer Science 2014-08-12 Vikas Sindhwani , Ha Quang Minh , Aurelie Lozano

We propose a general matrix-valued multiple kernel learning framework for high-dimensional nonlinear multivariate regression problems. This framework allows a broad class of mixed norm regularizers, including those that induce sparsity, to…

Machine Learning · Statistics 2013-03-11 Vikas Sindhwani , Minh Ha Quang , Aurelie C. Lozano

Unlike the conventional kernel adaptive filtering (KAF) approach of using a fixed kernel to define the Reproducing Kernel Hilbert Space (RKHS), this paper embeds the statistics of the input data in the kernel definition, obtaining a…

Signal Processing · Electrical Eng. & Systems 2025-10-21 Benjamin Colburn , Luis G. Sanchez Giraldo , Kan Li , Jose C. Principe

In this paper we introduce reproducing kernel Hilbert spaces of polyanalytic functions of infinite order. First we study in details the counterpart of the Fock space and related results in this framework. In this case the kernel function is…

Complex Variables · Mathematics 2021-12-30 Daniel Alpay , Fabrizio Colombo , Kamal Diki , Irene Sabadini

This survey is an introduction to positive definite kernels and the set of methods they have inspired in the machine learning literature, namely kernel methods. We first discuss some properties of positive definite kernels as well as…

Machine Learning · Statistics 2009-12-04 Marco Cuturi