English
Related papers

Related papers: Worst-case optimal approximation with increasingly…

200 papers

Gaussian processes are important models in the field of probabilistic numerics. We present a procedure for optimizing Mat\'ern kernel temporal Gaussian processes with respect to the kernel covariance function's hyperparameters. It is based…

Machine Learning · Computer Science 2025-08-14 Wouter M. Kouw

This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert…

Machine Learning · Statistics 2022-09-07 Jean-Luc Akian , Luc Bonnet , Houman Owhadi , Éric Savin

In this work, we investigate Gaussian Processes indexed by multidimensional distributions. While directly constructing radial positive definite kernels based on the Wasserstein distance has been proven to be possible in the unidimensional…

In order to accelerate the Douglas--Rachford method we recently developed the circumcentered--reflection method, which provides the closest iterate to the solution among all points relying on successive reflections, for the best…

Optimization and Control · Mathematics 2020-08-11 Roger Behling , José Yunier Bello-Cruz , Luiz-Rafael Santos

For various Hilbert spaces of analytic functions on the unit disk, we characterize when a function $f$ has optimal polynomial approximants given by truncations of a single power series. We also introduce a generalized notion of optimal…

Functional Analysis · Mathematics 2023-07-11 Christopher Felder

We provide a framework for computing the exact worst-case performance of any algorithm belonging to a broad class of oracle-based first-order methods for composite convex optimization, including those performing explicit, projected,…

Optimization and Control · Mathematics 2019-11-22 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

We study the convergence of the gradient descent method for solving ill-posed problems where the solution is characterized as a global minimum of a differentiable functional in a Hilbert space. The classical least-squares functional for…

Numerical Analysis · Mathematics 2016-06-02 Stefan Kindermann

Recent advancements in Gaussian Splatting (3DGS) have introduced various modifications to the original kernel, resulting in significant performance improvements. However, many of these kernel changes are incompatible with existing datasets…

Machine Learning · Computer Science 2026-03-20 Joerg H. Mueller , Martin Winter , Markus Steinberger

The high efficiency of a recently proposed method for computing with Gaussian processes relies on expanding a (translationally invariant) covariance kernel into complex exponentials, with frequencies lying on a Cartesian equispaced grid.…

Numerical Analysis · Mathematics 2023-05-19 Alex Barnett , Philip Greengard , Manas Rachh

The decomposition of polynomial spaces on unions of Grassmannians $\mathcal G_{{k_1},d}\cup\ldots\cup \mathcal G_{{k_r},d}$ into irreducible orthogonally invariant subspaces and their reproducing kernels are investigated. We also generalize…

Numerical Analysis · Mathematics 2018-05-17 Martin Ehler , Manuel Gräf

This paper investigates the mathematical properties and numerical approximation of a class of nonlocal elliptic partial differential equations of the form \begin{equation*} -\Delta u + \lambda \, G(u) = f, \end{equation*} where $\Delta$…

Analysis of PDEs · Mathematics 2026-02-09 Dragos-Patru Covei

Functional linear regression is one of the fundamental and well-studied methods in functional data analysis. In this work, we investigate the functional linear regression model within the context of reproducing kernel Hilbert space by…

Statistics Theory · Mathematics 2024-12-12 Naveen Gupta , S. Sivananthan , Bharath K. Sriperumbudur

We consider the 1D Expected Improvement optimization based on Gaussian processes having spectral densities converging to zero faster than exponentially. We give examples of problems where the optimization trajectory is not dense in the…

Optimization and Control · Mathematics 2012-12-18 Dmitry Yarotsky

We consider discrete best approximation problems in the setting of tropical algebra, which is concerned with the theory and application of algebraic systems with idempotent operations. Given a set of input--output pairs of an unknown…

Numerical Analysis · Mathematics 2025-11-18 Nikolai Krivulin

We consider a stochastic version of the proximal point algorithm for optimization problems posed on a Hilbert space. A typical application of this is supervised learning. While the method is not new, it has not been extensively analyzed in…

Optimization and Control · Mathematics 2021-09-28 Monika Eisenmann , Tony Stillfjord , Måns Williamson

Approximation using Fourier features is a popular technique for scaling kernel methods to large-scale problems, with myriad applications in machine learning and statistics. This method replaces the integral representation of a…

Machine Learning · Statistics 2024-08-26 Ayoub Belhadji , Qianyu Julie Zhu , Youssef Marzouk

We pose the problem of approximating optimally a given nonnegative signal with the scalar autoconvolution of a nonnegative signal. The I-divergence is chosen as the optimality criterion being well suited to incorporate nonnegativity…

Optimization and Control · Mathematics 2024-06-04 Lorenzo Finesso , Peter Spreij

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

Refining low-resolution (LR) spatial fields with high-resolution (HR) information, often known as statistical downscaling, is challenging as the diversity of spatial datasets often prevents direct matching of observations. Yet, when LR…

Machine Learning · Computer Science 2021-10-27 Siu Lun Chau , Shahine Bouabid , Dino Sejdinovic

We show that if a reproducing kernel Hilbert space $H_K,$ consisting of functions defined on ${\bf E},$ enjoys Double Boundary Vanishing Condition (DBVC) and Linear Independent Condition (LIC), then for any preset natural number $n,$ and…

Complex Variables · Mathematics 2020-08-04 Wei Qu , Tao Qian , Guan-Tie Deng