English
Related papers

Related papers: Signal reconstruction using determinantal sampling

200 papers

In this paper, we extend the correspondence between Bayesian estimation and optimal smoothing in a Reproducing Kernel Hilbert Space (RKHS) adding a convexe constraints on the solution. Through a sequence of approximating Hilbertian spaces…

Numerical Analysis · Mathematics 2021-07-13 X Bay , Laurence Grammont

In this work we analyze a convex-programming method for estimating superpositions of point sources or spikes from nonuniform samples of their convolution with a known kernel. We consider a one-dimensional model where the kernel is either a…

Optimization and Control · Mathematics 2018-06-04 Brett Bernstein , Carlos Fernandez-Granda

The problem of establishing out-of-sample bounds for the values of an unkonwn ground-truth function is considered. Kernels and their associated Hilbert spaces are the main formalism employed herein along with an observational model where…

Machine Learning · Computer Science 2022-09-13 Paul Scharnhorst , Emilio T. Maddalena , Yuning Jiang , Colin N. Jones

For the space of functions that can be approximated by linear chirps, we prove a reconstruction theorem by random sampling at arbitrary rates.

Probability · Mathematics 2010-08-31 Eric Carlen , R. Vilela Mendes

We present an embedding of stochastic optimal control problems, of the so called path integral form, into reproducing kernel Hilbert spaces. Using consistent, sample based estimates of the embedding leads to a model free, non-parametric…

Machine Learning · Computer Science 2012-08-14 Konrad Rawlik , Marc Toussaint , Sethu Vijayakumar

We introduce a method to reconstruct an element of a Hilbert space in terms of an arbitrary finite collection of linearly independent reconstruction vectors, given a finite number of its samples with respect to any Riesz basis. As we…

Numerical Analysis · Mathematics 2010-12-01 Ben Adcock , Anders C. Hansen

Safe autonomous driving critically depends on how well the ego-vehicle can predict the trajectories of neighboring vehicles. To this end, several trajectory prediction algorithms have been presented in the existing literature. Many of these…

Robotics · Computer Science 2023-10-13 Basant Sharma , Aditya Sharma , K. Madhava Krishna , Arun Kumar Singh

We study quadrature rules for functions from an RKHS, using nodes sampled from a determinantal point process (DPP). DPPs are parametrized by a kernel, and we use a truncated and saturated version of the RKHS kernel. This link between the…

Machine Learning · Statistics 2020-01-03 Ayoub Belhadji , Rémi Bardenet , Pierre Chainais

We extend the herding algorithm to continuous spaces by using the kernel trick. The resulting "kernel herding" algorithm is an infinite memory deterministic process that learns to approximate a PDF with a collection of samples. We show that…

Machine Learning · Computer Science 2012-03-19 Yutian Chen , Max Welling , Alex Smola

In this paper we investigate the problem of estimating the regression function in models with correlated observations. The data is obtained from several experimental units each of them forms a time series. We propose a new estimator based…

Statistics Theory · Mathematics 2019-06-13 Djihad Benelmadani , Karim Benhenni , Sana Louhichi

This work is concerned with the kernel-based approximation of a complex-valued function from data, where the frequency response function of a partial differential equation in the frequency domain is of particular interest. In this setting,…

Computational Engineering, Finance, and Science · Computer Science 2024-11-26 Julien Bect , Niklas Georg , Ulrich Römer , Sebastian Schöps

In this note we study the problem of sampling and reconstructing signals which are assumed to lie on or close to one of several subspaces of a Hilbert space. Importantly, we here consider a very general setting in which we allow infinitely…

Information Theory · Computer Science 2009-12-02 Thomas Blumensath

Determinantal points processes are a promising but relatively under-developed tool in machine learning and statistical modelling, being the canonical statistical example of distributions with repulsion. While their mathematical formulation…

Machine Learning · Computer Science 2022-03-31 Nicholas P Baskerville

Compressed sensing is triggering a major evolution in signal acquisition. It consists in sampling a sparse signal at low rate and later using computational power for its exact reconstruction, so that only the necessary information is…

Statistical Mechanics · Physics 2012-06-07 Florent Krzakala , Marc Mézard , François Sausset , Yifan Sun , Lenka Zdeborová

We show that kernel-based quadrature rules for computing integrals can be seen as a special case of random feature expansions for positive definite kernels, for a particular decomposition that always exists for such kernels. We provide a…

Machine Learning · Computer Science 2015-11-10 Francis Bach

The aim of this study is to present a good modernistic strategy for solving some well-known classes of Lane-Emden type singular differential equations. The proposed approach is based on the reproducing kernel Hilbert space (RKHS) and…

Let $(X_1,\ldots,X_n)$ be an i.i.d. sequence of random variables in $\mathbb{R}^d$, $d\geq 1$. We show that, for any function $\varphi :\mathbb{R}^d\rightarrow\mathbb{R}$, under regularity conditions, \[n^…

Statistics Theory · Mathematics 2016-06-07 Bernard Delyon , François Portier

Kernel herding belongs to a family of deterministic quadratures that seek to minimize the worst-case integration error over a reproducing kernel Hilbert space (RKHS). These quadrature rules come with strong experimental evidence that this…

Machine Learning · Computer Science 2025-08-12 Martin Rouault , Rémi Bardenet , Mylène Maïda

We propose a novel approach for pixel classification in hyperspectral images, leveraging on both the spatial and spectral information in the data. The introduced method relies on a recently proposed framework for learning on distributions…

Computer Vision and Pattern Recognition · Computer Science 2016-05-31 Gianni Franchi , Jesus Angulo , Dino Sejdinovic

In the feature maps of CNNs, there commonly exists considerable spatial redundancy that leads to much repetitive processing. Towards reducing this superfluous computation, we propose to compute features only at sparsely sampled locations,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-07 Zhenda Xie , Zheng Zhang , Xizhou Zhu , Gao Huang , Stephen Lin