English
Related papers

Related papers: Optimal Sampling Points in Reproducing Kernel Hilb…

200 papers

Bilevel optimization has emerged as a technique for addressing a wide range of machine learning problems that involve an outer objective implicitly determined by the minimizer of an inner problem. While prior works have primarily focused on…

Machine Learning · Computer Science 2025-11-18 Fares El Khoury , Edouard Pauwels , Samuel Vaiter , Michael Arbel

Reproducing kernel Hilbert spaces are elucidated without assuming prior familiarity with Hilbert spaces. Compared with extant pedagogic material, greater care is placed on motivating the definition of reproducing kernel Hilbert spaces and…

History and Overview · Mathematics 2015-11-06 Jonathan H. Manton , Pierre-Olivier Amblard

We introduce kernel thinning, a new procedure for compressing a distribution $\mathbb{P}$ more effectively than i.i.d. sampling or standard thinning. Given a suitable reproducing kernel $\mathbf{k}_{\star}$ and $O(n^2)$ time, kernel…

Machine Learning · Statistics 2024-05-14 Raaz Dwivedi , Lester Mackey

Compressed sensing (CS) MRI relies on adequate undersampling of the k-space to accelerate the acquisition without compromising image quality. Consequently, the design of optimal sampling patterns for these k-space coefficients has received…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Iris A. M. Huijben , Bastiaan S. Veeling , Ruud J. G. van Sloun

Consider a continuous signal that cannot be observed directly. Instead, one has access to multiple corrupted versions of the signal. The available corrupted signals are correlated because they carry information about the common remote…

Information Theory · Computer Science 2016-12-06 Elaheh Mohammadi , Alireza Fallah , Farokh Marvasti

An intriguing phenomenon in many instances of compressed sensing is that the reconstruction quality is governed not just by the overall sparsity of the signal, but also on its structure. This paper is about understanding this phenomenon,…

Functional Analysis · Mathematics 2014-03-28 Ben Adcock , Anders C. Hansen , Bogdan Roman

In this paper, we extend the correspondence between Bayesian estimation and optimal smoothing in a Reproducing Kernel Hilbert Space (RKHS) adding a convexe constraints on the solution. Through a sequence of approximating Hilbertian spaces…

Numerical Analysis · Mathematics 2021-07-13 X Bay , Laurence Grammont

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

This paper introduces algorithms to select/design kernels in Gaussian process regression/kriging surrogate modeling techniques. We adopt the setting of kernel method solutions in ad hoc functional spaces, namely Reproducing Kernel Hilbert…

Machine Learning · Statistics 2022-09-07 Jean-Luc Akian , Luc Bonnet , Houman Owhadi , Éric Savin

Kernel based methods have shown effective performance in many remote sensing classification tasks. However their performance significantly depend on its hyper-parameters. The conventional technique to estimate the parameter comes with high…

Machine Learning · Statistics 2018-04-17 Bharath Bhushan Damodaran

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

We present a data-driven method for computing approximate forward reachable sets using separating kernels in a reproducing kernel Hilbert space. We frame the problem as a support estimation problem, and learn a classifier of the support as…

Optimization and Control · Mathematics 2020-11-20 Adam J. Thorpe , Kendric R. Ortiz , Meeko M. K. Oishi

In this paper, we consider the nonparametric least square regression in a Reproducing Kernel Hilbert Space (RKHS). We propose a new randomized algorithm that has optimal generalization error bounds with respect to the square loss, closing a…

Machine Learning · Computer Science 2019-05-28 Kwang-Sung Jun , Ashok Cutkosky , Francesco Orabona

We present an embedding of stochastic optimal control problems, of the so called path integral form, into reproducing kernel Hilbert spaces. Using consistent, sample based estimates of the embedding leads to a model free, non-parametric…

Machine Learning · Computer Science 2012-08-14 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

Empirical data can often be considered as samples from a set of probability distributions. Kernel methods have emerged as a natural approach for learning to classify these distributions. Although numerous kernels between distributions have…

Machine Learning · Computer Science 2024-12-02 Oleksii Kachaiev , Stefano Recanatesi

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

Model reduction attempts to guarantee a desired "model quality", e.g. given in terms of accuracy requirements, with as small a model size as possible. This article highlights some recent developments concerning this issue for the so called…

Numerical Analysis · Mathematics 2015-03-03 Wolfgang Dahmen

This paper establishes error bounds for the convergence of a piecewise linear approximation of the constrained optimal smoothing problem posed in a reproducing kernel Hilbert space (RKHS). This problem can be reformulated as a Bayesian…

Statistics Theory · Mathematics 2025-06-24 Laurence Grammont , François Bachoc , Andrés F. López-Lopera

We give a new, very general, formulation of the compressed sensing problem in terms of coordinate projections of an analytic variety, and derive sufficient sampling rates for signal reconstruction. Our bounds are linear in the coherence of…

Machine Learning · Computer Science 2013-11-05 Franz J. Király , Louis Theran

Starting with a similarity function between objects, it is possible to define a distance metric on pairs of objects, and more generally on probability distributions over them. These distance metrics have a deep basis in functional analysis,…

Computational Geometry · Computer Science 2011-03-15 Sarang Joshi , Raj Varma Kommaraju , Jeff M. Phillips , Suresh Venkatasubramanian