English
Related papers

Related papers: Convergence Analysis of Kernel Conjugate Gradient …

200 papers

This paper develops a frequentist solution to the functional calibration problem, where the value of a calibration parameter in a computer model is allowed to vary with the value of control variables in the physical system. The need of…

Methodology · Statistics 2021-07-20 Rui Tuo , Shiyuan He , Arash Pourhabib , Yu Ding , Jianhua Z. Huang

We study a functional linear regression model that deals with functional responses and allows for both functional covariates and high-dimensional vector covariates. The proposed model is flexible and nests several functional regression…

Statistics Theory · Mathematics 2022-08-24 Daren Wang , Zifeng Zhao , Yi Yu , Rebecca Willett

We study multivariate integration and approximation for functions belonging to a weighted reproducing kernel Hilbert space based on half-period cosine functions in the worst-case setting. The weights in the norm of the function space depend…

Numerical Analysis · Mathematics 2015-11-23 Christian Irrgeher , Peter Kritzer , Friedrich Pillichshammer

We consider frames F in a given Hilbert space, and we show that every F may be obtained in a constructive way from a reproducing kernel and an orthonormal basis in an ambient Hilbert space. The construction is operator-theoretic, building…

Classical Analysis and ODEs · Mathematics 2007-05-23 Palle E. T. Jorgensen

We consider stochastic gradient descent and its averaging variant for binary classification problems in a reproducing kernel Hilbert space. In the traditional analysis using a consistency property of loss functions, it is known that the…

Machine Learning · Statistics 2022-07-26 Atsushi Nitanda , Taiji Suzuki

This paper presents new results on Functional Analysis of Variance for fixed effect models with correlated Hilbert-valued Gaussian error components. The geometry of the Reproducing Kernel Hilbert Space (RKHS) of the error term is considered…

Statistics Theory · Mathematics 2015-09-04 M. D. Ruiz-Medina

In this article a unified approach to iterative soft-thresholding algorithms for the solution of linear operator equations in infinite dimensional Hilbert spaces is presented. We formulate the algorithm in the framework of generalized…

Functional Analysis · Mathematics 2010-10-26 Kristian Bredies , Dirk A. Lorenz

This paper generalizes regularized regression problems in a hyper-reproducing kernel Hilbert space (hyper-RKHS), illustrates its utility for kernel learning and out-of-sample extensions, and proves asymptotic convergence results for the…

Machine Learning · Computer Science 2022-10-20 Fanghui Liu , Lei Shi , Xiaolin Huang , Jie Yang , Johan A. K. Suykens

We present a novel approach to learn a kernel-based regression function. It is based on the useof conical combinations of data-based parameterized kernels and on a new stochastic convex optimization procedure of which we establish…

Machine Learning · Computer Science 2012-01-13 Pierre Machart , Thomas Peel , Liva Ralaivola , Sandrine Anthoine , Hervé Glotin

In this paper, we establish the $R$-linear rate of convergence of a golden ratio algorithm for solving an equilibrium problem in a Hilbert space. Several experiments are performed to show the numerical behavior of the algorithm and also to…

Optimization and Control · Mathematics 2018-10-09 Dang Van Hieu

We propose an optimal algorithm for estimating conditional average treatment effects (CATEs) when response functions lie in a reproducing kernel Hilbert space (RKHS). We study settings in which the contrast function is structurally simpler…

Methodology · Statistics 2026-02-25 Seok-Jin Kim

The kernel herding algorithm is used to construct quadrature rules in a reproducing kernel Hilbert space (RKHS). While the computational efficiency of the algorithm and stability of the output quadrature formulas are advantages of this…

Numerical Analysis · Mathematics 2022-07-18 Kazuma Tsuji , Ken'ichiro Tanaka

Motivated by the abundance of functional data such as time series and images, there has been a growing interest in integrating such data into neural networks and learning maps from function spaces to R (i.e., functionals). In this paper, we…

Machine Learning · Statistics 2024-03-20 Tian-Yi Zhou , Namjoon Suh , Guang Cheng , Xiaoming Huo

We consider multi-agent stochastic optimization problems over reproducing kernel Hilbert spaces (RKHS). In this setting, a network of interconnected agents aims to learn decision functions, i.e., nonlinear statistical models, that are…

Optimization and Control · Mathematics 2018-07-04 Alec Koppel , Santiago Paternain , Cedric Richard , Alejandro Ribeiro

In many instances one has to deal with parametric models. Such models in vector spaces are connected to a linear map. The reproducing kernel Hilbert space and affine- / linear- representations in terms of tensor products are directly…

Numerical Analysis · Mathematics 2018-11-26 Hermann G. Matthies , Roger Ohayon

This paper investigates the convergence properties of spectral algorithms -- a class of regularization methods originating from inverse problems -- under covariate shift. In this setting, the marginal distributions of inputs differ between…

Machine Learning · Statistics 2025-09-08 Ren-Rui Liu , Zheng-Chu Guo

In a real Hilbert space $\mathcal{H}$. Given any function $f$ convex differentiable whose solution set $\argmin_{\mathcal{H}}\,f$ is nonempty, by considering the Proximal Algorithm $x_{k+1}=\text{prox}_{\b_k f}(d x_k)$, where $0<d<1$ and…

Optimization and Control · Mathematics 2023-09-26 A. C. Bagy , Z. Chbani , H. Riahi

Important information on the structure of complex systems, consisting of more than one component, can be obtained by measuring to which extent the individual components exchange information among each other. Such knowledge is needed to…

Disordered Systems and Neural Networks · Physics 2009-11-13 Daniele Marinazzo , Mario Pellicoro , Sebastiano Stramaglia

We consider learning in decentralized heterogeneous networks: agents seek to minimize a convex functional that aggregates data across the network, while only having access to their local data streams. We focus on the case where agents seek…

Optimization and Control · Mathematics 2021-06-02 Hrusikesha Pradhan , Amrit Singh Bedi , Alec Koppel , Ketan Rajawat

Kernel ridge regression is used to approximate the kinetic energy of non-interacting fermions in a one-dimensional box as a functional of their density. The properties of different kernels and methods of cross-validation are explored, and…