English
Related papers

Related papers: Regularized Functional Canonical Correlation Analy…

200 papers

We present DARTR: a Data Adaptive RKHS Tikhonov Regularization method for the linear inverse problem of nonparametric learning of function parameters in operators. A key ingredient is a system intrinsic data-adaptive (SIDA) RKHS, whose norm…

Machine Learning · Statistics 2022-03-09 Fei Lu , Quanjun Lang , Qingci An

In this paper the problem of recovering a regularized solution of the Fredholm integral equations of the first kind with Hermitian and square-integrable kernels, and with data corrupted by additive noise, is considered. Instead of using a…

Classical Analysis and ODEs · Mathematics 2007-05-23 Enrico De Micheli , Nicodemo Magnoli , Giovanni Alberto Viano

We consider the problem of reconstructing the cross--power spectrum of an unobservable multivariate stochatic process from indirect measurements of a second multivariate stochastic process, related to the first one through a linear…

Numerical Analysis · Mathematics 2020-04-22 Elisabetta Vallarino , Sara Sommariva , Michele Piana , Alberto Sorrentino

Primal-dual splitting involving proximity operators in order to be able to find some approximation to the minimizer for a general form of Tikhonov type functional is in the focus of this work. This approximation is produced by a pair of…

Numerical Analysis · Mathematics 2019-03-19 Erdem Altuntac

This paper presents a general vector-valued reproducing kernel Hilbert spaces (RKHS) framework for the problem of learning an unknown functional dependency between a structured input space and a structured output space. Our formulation…

Machine Learning · Statistics 2016-08-23 Ha Quang Minh , Loris Bazzani , Vittorio Murino

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a…

Machine Learning · Computer Science 2019-05-28 Kwang-Sung Jun , Ashok Cutkosky , Francesco Orabona

This short technical report presents some learning theory results on vector-valued reproducing kernel Hilbert space (RKHS) regression, where the input space is allowed to be non-compact and the output space is a (possibly…

Machine Learning · Statistics 2022-02-17 Junhyunng Park , Krikamol Muandet

Most of existing results on regularized system identification focus on regularized impulse response estimation. Since the impulse response model is a special case of orthonormal basis functions, it is interesting to consider if it is…

Systems and Control · Computer Science 2015-04-14 Tianshi Chen , Lennart Ljung

Meshless collocation with multiquadric radial basis functions (MQ-RBFs) delivers high accuracy for the three-dimensional Helmholtz equation but produces dense, severely ill-conditioned linear systems. We develop and evaluate three…

Numerical Analysis · Mathematics 2025-11-14 Mohamed El Guide , Khalide Jbilou , Kamal Lachhab , Driss Ouazar

We investigate a Tikhonov regularization scheme specifically tailored for shallow neural networks within the context of solving a classic inverse problem: approximating an unknown function and its derivatives within a unit cubic domain…

Numerical Analysis · Mathematics 2024-12-17 Yuanyuan Li , Shuai Lu

In this paper we study Tikhonov regularization for the stable solution of an ill-posed non-linear operator equation. The operator we consider, which is related to an active contour model for image segmentation, is continuous, compact, but…

Numerical Analysis · Mathematics 2012-09-12 Markus Grasmair

This paper describes and compares some structure preserving techniques for the solution of linear discrete ill-posed problems with the t-product. A new randomized tensor singular value decomposition (R-tSVD) with a t-product is presented…

Numerical Analysis · Mathematics 2021-10-18 Ugochukwu O. Ugwu , Lothar Reichel

Nonlocal operators with integral kernels have become a popular tool for designing solution maps between function spaces, due to their efficiency in representing long-range dependence and the attractive feature of being resolution-invariant.…

Machine Learning · Statistics 2022-05-24 Fei Lu , Qingci An , Yue Yu

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

We propose estimators based on kernel ridge regression for nonparametric causal functions such as dose, heterogeneous, and incremental response curves. Treatment and covariates may be discrete or continuous in general spaces. Due to a…

Econometrics · Economics 2022-10-25 Rahul Singh , Liyuan Xu , Arthur Gretton

Random feature approximation is arguably one of the most widely used techniques for kernel methods in large-scale learning algorithms. In this work, we analyze the generalization properties of random feature methods, extending previous…

Machine Learning · Statistics 2025-06-23 Mike Nguyen , Nicole Mücke

In functional data analysis (FDA), covariance function is fundamental not only as a critical quantity for understanding elementary aspects of functional data but also as an indispensable ingredient for many advanced FDA methods. This paper…

Methodology · Statistics 2017-01-24 Raymond K. W. Wong , Xiaoke Zhang

A rigorous derivation is provided for canonical correlations and partial canonical correlations for certain Hilbert space indexed stochastic processes. The formulation relies on a key congruence mapping between the space spanned by a second…

Statistics Theory · Mathematics 2015-06-02 Qing Huang , Rosemary Renaut

Regularized kernel methods such as, e.g., support vector machines and least-squares support vector regression constitute an important class of standard learning algorithms in machine learning. Theoretical investigations concerning…

Machine Learning · Statistics 2012-03-21 Robert Hable

The aim of this study is to present a good modernistic strategy for solving some well-known classes of Lane-Emden type singular differential equations. The proposed approach is based on the reproducing kernel Hilbert space (RKHS) and…