English
Related papers

Related papers: Generalized Gaussian Kernel Adaptive Filtering

200 papers

The Grassmannian manifold G(k, n) serves as a fundamental tool in signal processing, computer vision, and machine learning, where problems often involve classifying, clustering, or comparing subspaces. In this work, we propose a…

Signal Processing · Electrical Eng. & Systems 2025-05-01 Rémi Delogne , Laurent Jacques

Gaussian process regression generally does not scale to beyond a few thousands data points without applying some sort of kernel approximation method. Most approximations focus on the high eigenvalue part of the spectrum of the kernel…

Machine Learning · Statistics 2018-01-31 Yi Ding , Risi Kondor , Jonathan Eskreis-Winkler

This paper is an attempt to bridge the conceptual gaps between researchers working on the two widely used approaches based on positive definite kernels: Bayesian learning or inference using Gaussian processes on the one side, and…

Machine Learning · Statistics 2018-07-10 Motonobu Kanagawa , Philipp Hennig , Dino Sejdinovic , Bharath K Sriperumbudur

Learning the kernel parameters for Gaussian processes is often the computational bottleneck in applications such as online learning, Bayesian optimization, or active learning. Amortizing parameter inference over different datasets is a…

Machine Learning · Computer Science 2023-06-19 Matthias Bitzer , Mona Meister , Christoph Zimmer

A generalized Gaussian process model (GGPM) is a unifying framework that encompasses many existing Gaussian process (GP) models, such as GP regression, classification, and counting. In the GGPM framework, the observation likelihood of the…

Machine Learning · Statistics 2013-11-28 Lifeng Shang , Antoni B. Chan

Gaussian Processes (GPs) provide a general and analytically tractable way of modeling complex time-varying, nonparametric functions. The Automatic Bayesian Covariance Discovery (ABCD) system constructs natural-language description of…

Machine Learning · Computer Science 2016-02-15 Yunseong Hwang , Anh Tong , Jaesik Choi

Sequential Bayesian filters in non-linear dynamic systems require the recursive estimation of the predictive and posterior distributions. This paper introduces a Bayesian filter called the adaptive kernel Kalman filter (AKKF). With this…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Mengwei Sun , Mike E. Davies , Ian K. Proudler , James R. Hopgood

State estimation is a key ingredient in most robotic systems. Often, state estimation is performed using some form of least squares minimization. Basically, all error minimization procedures that work on real-world data use robust kernels…

Robotics · Computer Science 2021-02-19 Nived Chebrolu , Thomas Läbe , Olga Vysotska , Jens Behley , Cyrill Stachniss

Panel-based, kernel-split quadrature is currently one of the most efficient methods available for accurate evaluation of singular and nearly singular layer potentials in two dimensions. However, it can fail completely for the layer…

Numerical Analysis · Mathematics 2021-08-04 Fredrik Fryklund , Ludvig af Klinteberg , Anna-Karin Tornberg

Complex-valued signals are used in the modeling of many systems in engineering and science, hence being of fundamental interest. Often, random complex-valued signals are considered to be proper. A proper complex random variable or process…

Machine Learning · Computer Science 2015-02-19 Rafael Boloix-Tortosa , F. Javier Payán-Somet , Eva Arias-de-Reyna , Juan José Murillo-Fuentes

The application of Gaussian processes (GPs) to large data sets is limited due to heavy memory and computational requirements. A variety of methods has been proposed to enable scalability, one of which is to exploit structure in the kernel…

Machine Learning · Computer Science 2019-12-30 Jan Graßhoff , Alexandra Jankowski , Philipp Rostalski

The robustness of the kernel recursive least square (KRLS) algorithm has recently been improved by combining them with more robust information-theoretic learning criteria, such as minimum error entropy (MEE) and generalized MEE (GMEE),…

Information Theory · Computer Science 2023-09-07 Jiacheng He , Gang Wang , Kun Zhang , Shan Zhong , Bei Peng

To accelerate kernel methods, we propose a near input sparsity time algorithm for sampling the high-dimensional feature space implicitly defined by a kernel transformation. Our main contribution is an importance sampling method for…

Data Structures and Algorithms · Computer Science 2020-07-15 David P. Woodruff , Amir Zandieh

Previous work generally believes that improving the spatial invariance of convolutional networks is the key to object counting. However, after verifying several mainstream counting networks, we surprisingly found too strict pixel-level…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Zhi-Qi Cheng , Qi Dai , Hong Li , JingKuan Song , Xiao Wu , Alexander G. Hauptmann

Stein variational gradient descent (SVGD) is a kernel-based and non-parametric particle method for sampling from a target distribution, such as in Bayesian inference and other machine learning tasks. Different from other particle methods,…

Optimization and Control · Mathematics 2025-10-02 Viktor Stein , Wuchen Li

In simulation-based engineering design with time-consuming simulators, Gaussian process (GP) models are widely used as fast emulators to speed up the design optimization process. In its most commonly used form, the input of GP is a simple…

Machine Learning · Computer Science 2024-07-24 Xi Chen , Yashika Sharma , Hao Helen Zhang , Xin Hao , Qiang Zhou

Bayesian optimization relies on iteratively constructing and optimizing an acquisition function. The latter turns out to be a challenging, non-convex optimization problem itself. Despite the relative importance of this step, most algorithms…

Optimization and Control · Mathematics 2026-04-22 Yilin Xie , Shiqiang Zhang , Joel A. Paulson , Calvin Tsay

This research employs Gaussian Process Regression (GPR) with an ensemble kernel, integrating Exponential Squared, Revised Mat\'ern, and Rational Quadratic kernels to analyze pharmaceutical sales data. Bayesian optimization was used to…

Machine Learning · Computer Science 2024-05-01 Shahin Mirshekari , Mohammadreza Moradi , Hossein Jafari , Mehdi Jafari , Mohammad Ensaf

This paper establishes the first polynomial convergence rates for Gaussian kernel ridge regression (KRR) with a fixed hyperparameter in both the uniform and the $L^{2}$-norm. The uniform convergence result closes a gap in the theoretical…

Machine Learning · Statistics 2025-09-12 Paul Dommel , Rajmadan Lakshmanan

Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with…

Machine Learning · Computer Science 2017-08-29 R. C. de Lamare , André Flores