English
Related papers

Related papers: Error Estimates for the Kernel Gain Function Appro…

200 papers

We present a Bayesian data fusion method to approximate a posterior distribution from an ensemble of particle estimates that only have access to subsets of the data. Our approach relies on approximate probabilistic inference of model…

Computation · Statistics 2020-10-28 Caleb Miller , Michael D. Schneider , Jem N. Corcoran , Jason Bernstein

Kernel based regularized interpolation is a well known technique to approximate a continuous multivariate function using a set of scattered data points and the corresponding function evaluations, or data values. This method has some…

Numerical Analysis · Mathematics 2018-07-26 Gabriele Santin , Dominik Wittwar , Bernard Haasdonk

In this survey, we describe controlled interacting particle systems (CIPS) to approximate the solution of the optimal filtering and the optimal control problems. Part I of the survey is focussed on the feedback particle filter (FPF)…

Systems and Control · Electrical Eng. & Systems 2023-03-21 Amirhossein Taghvaei , Prashant G. Mehta

Bayesian hierarchical Poisson models are an essential tool for analyzing count data. However, designing efficient algorithms to sample from the posterior distribution of the target parameters remains a challenging task for this class of…

Methodology · Statistics 2025-02-10 Aldo Gardini , Fedele Greco , Carlo Trivisano

Inertial measurement units are widely used in different fields to estimate the attitude. Many algorithms have been proposed to improve estimation performance. However, most of them still suffer from 1) inaccurate initial estimation, 2)…

Robotics · Computer Science 2021-07-28 Yujie Tang , Liang Hu , Qingrui Zhang , Wei Pan

Many algorithms for the computation of correspondences between deformable shapes rely on some variant of nearest neighbor matching in a descriptor space. Such are, for example, various point-wise correspondence recovery algorithms used as a…

Computer Vision and Pattern Recognition · Computer Science 2017-04-10 Matthias Vestner , Roee Litman , Emanuele Rodolà , Alex Bronstein , Daniel Cremers

State estimation in non-linear models is performed by tracking the posterior distribution recursively. A plethora of algorithms have been proposed for this task. Among them, the Gaussian particle filter uses a weighted set of particles to…

Signal Processing · Electrical Eng. & Systems 2022-07-05 Karthik Comandur , Yunpeng Li , Santosh Nannuru

Nonlinear function estimation is core to modern machine learning applications. In this paper, to perform nonlinear function estimation, we reduce a nonlinear inverse problem to a linear one using a polynomial kernel expansion. These kernels…

Information Theory · Computer Science 2019-10-02 Hangjin Liu , You , Zhou , Ahmad Beirami , Dror Baron

This article gives a new insight of kernel-based (approximation) methods to solve the high-dimensional stochastic partial differential equations. We will combine the techniques of meshfree approximation and kriging interpolation to extend…

Numerical Analysis · Mathematics 2015-02-20 Qi Ye

The Poisson distribution arises naturally when dealing with data involving counts, and it has found many applications in inverse problems and imaging. In this work, we develop an approximate Bayesian inference technique based on expectation…

Numerical Analysis · Mathematics 2019-09-04 Chen Zhang , Simon Arridge , Bangti Jin

We propose a Gradient Boosting algorithm for learning an ensemble of kernel functions adapted to the task at hand. Unlike state-of-the-art Multiple Kernel Learning techniques that make use of a pre-computed dictionary of kernel functions to…

Machine Learning · Statistics 2019-06-17 Léo Gautheron , Pascal Germain , Amaury Habrard , Emilie Morvant , Marc Sebban , Valentina Zantedeschi

We present a kernel-based methodology for constructing Lyapunov functions for nonlinear dynamical systems using approximate Koopman eigenfunctions. Our approach decomposes principal Koopman eigenfunctions into linear and nonlinear…

Numerical Analysis · Mathematics 2026-02-26 P. Giesl , S. Hafstein , B. Hamzi , J. Lee , H. Owhadi , G. Santin , U. Vaidya

In supervised learning using kernel methods, we often encounter a large-scale finite-sum minimization over a reproducing kernel Hilbert space (RKHS). Large-scale finite-sum problems can be solved using efficient variants of Newton method,…

Machine Learning · Computer Science 2022-06-07 Ting-Jui Chang , Shahin Shahrampour

We propose a novel approach to parameter estimation for simulator-based statistical models with intractable likelihood. Our proposed method involves recursive application of kernel ABC and kernel herding to the same observed data. We…

Machine Learning · Statistics 2018-06-13 Takafumi Kajihara , Motonobu Kanagawa , Keisuke Yamazaki , Kenji Fukumizu

The filtering of a Markov diffusion process on a manifold from counting process observations leads to `large' changes in the conditional distribution upon an observed event, corresponding to a multiplication of the density by the intensity…

Optimization and Control · Mathematics 2019-11-01 Simone Carlo Surace , Anna Kutschireiter , Jean-Pascal Pfister

Kernel-based methods enjoy powerful generalization capabilities in handling a variety of learning tasks. When such methods are provided with sufficient training data, broadly-applicable classes of nonlinear functions can be approximated…

Machine Learning · Statistics 2017-12-29 Fatemeh Sheikholeslami , Dimitris Berberidis , Georgios B. Giannakis

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

Gaussian Process (GP) models are often used as mathematical approximations of computationally expensive experiments. Provided that its kernel is suitably chosen and that enough data is available to obtain a reasonable fit of the simulator,…

Machine Learning · Statistics 2011-03-22 Nicolas Durrande , David Ginsbourger , Olivier Roustant

Random Fourier Features (RFF) demonstrate wellappreciated performance in kernel approximation for largescale situations but restrict kernels to be stationary and positive definite. And for non-stationary kernels, the corresponding RFF could…

Machine Learning · Statistics 2021-04-15 Qin Luo , Kun Fang , Jie Yang , Xiaolin Huang

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

Computation · Statistics 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä