English
Related papers

Related papers: Multi- and Infinite-variate Integration and $L^2$-…

200 papers

Fisher's linear discriminant analysis is a classical method for classification, yet it is limited to capturing linear features only. Kernel discriminant analysis as an extension is known to successfully alleviate the limitation through a…

Machine Learning · Statistics 2022-07-29 Jiae Kim , Yoonkyung Lee , Zhiyu Liang

We give a convergence proof for the approximation by sparse collocation of Hilbert-space-valued functions depending on countably many Gaussian random variables. Such functions appear as solutions of elliptic PDEs with lognormal diffusion…

Numerical Analysis · Mathematics 2017-03-29 Oliver G. Ernst , Björn Sprungk , Lorenzo Tamellini

We study integration in a class of Hilbert spaces of analytic functions defined on the $\mathbb{R}^s$. The functions are characterized by the property that their Hermite coefficients decay exponentially fast. We use Gauss-Hermite…

Numerical Analysis · Mathematics 2014-03-21 Christian Irrgeher , Peter Kritzer , Gunther Leobacher , Friedrich Pillichshammer

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

In this paper, we study regression problems over a separable Hilbert space with the square loss, covering non-parametric regression over a reproducing kernel Hilbert space. We investigate a class of spectral/regularized algorithms,…

Machine Learning · Statistics 2022-07-18 Junhong Lin , Alessandro Rudi , Lorenzo Rosasco , Volkan Cevher

Gaussian processes are a powerful class of non-linear models, but have limited applicability for larger datasets due to their high computational complexity. In such cases, approximate methods are required, for example, the recently…

Methodology · Statistics 2026-03-24 Soham Mukherjee , Manfred Claassen , Paul-Christian Bürkner

This paper is concerned with the numerical minimization of energy functionals in Hilbert spaces involving convex constraints coinciding with a semi-norm for a subspace. The optimization is realized by alternating minimizations of the…

Numerical Analysis · Mathematics 2007-12-17 Massimo Fornasier , Carola-Bibiane Schönlieb

We implement an all-optical setup demonstrating kernel-based quantum machine learning for two-dimensional classification problems. In this hybrid approach, kernel evaluations are outsourced to projective measurements on suitably designed…

Current methods for stochastic hyperparameter learning in Gaussian Processes (GPs) rely on approximations, such as computing biased stochastic gradients or using inducing points in stochastic variational inference. However, when using such…

Machine Learning · Computer Science 2025-08-29 Neta Shoham , Haim Avron

We propose a novel online learning paradigm for nonlinear-function estimation tasks based on the iterative projections in the L2 space with probability measure reflecting the stochastic property of input signals. The proposed learning…

Signal Processing · Electrical Eng. & Systems 2018-09-13 Motoya Ohnishi , Masahiro Yukawa

We study the fundamental problems of Gaussian mean estimation and linear regression with Gaussian covariates in the presence of Huber contamination. Our main contribution is the design of the first sample near-optimal and almost linear-time…

Data Structures and Algorithms · Computer Science 2023-12-05 Ilias Diakonikolas , Daniel M. Kane , Ankit Pensia , Thanasis Pittas

Much recent work has addressed the solution of a family of partial differential equations by computing the inverse operator map between the input and solution space. Toward this end, we incorporate function-valued reproducing kernel Hilbert…

Numerical Analysis · Mathematics 2022-04-05 Kaijun Bao , Xu Qian , Ziyuan Liu , Songhe Song

Sparse polynomial approximation has become indispensable for approximating smooth, high- or infinite-dimensional functions from limited samples. This is a key task in computational science and engineering, e.g., surrogate modelling in…

Numerical Analysis · Mathematics 2023-11-08 Ben Adcock , Simone Brugiapaglia , Nick Dexter , Sebastian Moraga

In the Bayesian approach to inverse problems, data are often informative, relative to the prior, only on a low-dimensional subspace of the parameter space. Significant computational savings can be achieved by using this subspace to…

Numerical Analysis · Mathematics 2015-07-07 Alessio Spantini , Antti Solonen , Tiangang Cui , James Martin , Luis Tenorio , Youssef Marzouk

The kernel function and its hyperparameters are the central model selection choice in a Gaussian proces (Rasmussen and Williams, 2006). Typically, the hyperparameters of the kernel are chosen by maximising the marginal likelihood, an…

Machine Learning · Statistics 2022-11-07 Vidhi Lalchand , Wessel P. Bruinsma , David R. Burt , Carl E. Rasmussen

We study the numerical integration problem for functions with infinitely many variables. The function spaces of integrands we consider are weighted reproducing kernel Hilbert spaces with norms related to the ANOVA decomposition of the…

Numerical Analysis · Mathematics 2021-09-21 Josef Dick , Michael Gnewuch

Gaussian processes are widely used for accurate emulation of unknown surfaces in sequential design of expensive simulation experiments. Integrated mean squared error (IMSE) is an effective acquisition function for sequential designs based…

Statistics Theory · Mathematics 2026-04-23 Huanyan Zhu , Cheng Li

By making a seminal use of the maximum modulus principle of holomorphic functions we prove existence of $n$-best kernel approximation for a wide class of reproducing kernel Hilbert spaces of holomorphic functions in the unit disc, and for…

Complex Variables · Mathematics 2022-01-20 Tao Qian

Adaptive filtering algorithms operating in reproducing kernel Hilbert spaces have demonstrated superiority over their linear counterpart for nonlinear system identification. Unfortunately, an undesirable characteristic of these methods is…

Machine Learning · Statistics 2013-06-25 Wei Gao , Jie Chen , Cédric Richard , Jianguo Huang

We present a Gaussian kernel loss function and training algorithm for convolutional neural networks that can be directly applied to both distance metric learning and image classification problems. Our method treats all training features…

Computer Vision and Pattern Recognition · Computer Science 2018-07-03 Benjamin J. Meyer , Ben Harwood , Tom Drummond