English
Related papers

Related papers: Kernel Least Mean Square with Adaptive Kernel Size

200 papers

The kernel least mean squares (KLMS) algorithm is a computationally efficient nonlinear adaptive filtering method that "kernelizes" the celebrated (linear) least mean squares algorithm. We demonstrate that the least mean squares algorithm…

Machine Learning · Statistics 2013-10-22 Il Memming Park , Sohan Seth , Steven Van Vaerenbergh

Kernel Adaptive Filtering (KAF) are mathematically principled methods which search for a function in a Reproducing Kernel Hilbert Space. While they work well for tasks such as time series prediction and system identification they are…

Machine Learning · Computer Science 2023-12-20 Benjamin Colburn , Jose C. Principe , Luis G. Sanchez Giraldo

In the last decade, a considerable research effort has been devoted to developing adaptive algorithms based on kernel functions. One of the main features of these algorithms is that they form a family of universal approximation techniques,…

Signal Processing · Electrical Eng. & Systems 2018-08-21 A. Flores , R. C. de Lamare

In most adaptive signal processing applications, system linearity is assumed and adaptive linear filters are thus used. The traditional class of supervised adaptive filters rely on error-correction learning for their adaptive capability.…

Machine Learning · Computer Science 2015-08-31 Songlin Zhao

We propose the adaptive random Fourier features Gaussian kernel LMS (ARFF-GKLMS). Like most kernel adaptive filters based on stochastic gradient descent, this algorithm uses a preset number of random Fourier features to save computation…

Signal Processing · Electrical Eng. & Systems 2022-07-18 Wei Gao , Jie Chen , Cédric Richard , Wentao Shi , Qunfei Zhang

Sequential Bayesian filters in non-linear dynamic systems require the recursive estimation of the predictive and posterior distributions. This paper introduces a Bayesian filter called the adaptive kernel Kalman filter (AKKF). With this…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Mengwei Sun , Mike E. Davies , Ian K. Proudler , James R. Hopgood

Adaptive filtering algorithms operating in reproducing kernel Hilbert spaces have demonstrated superiority over their linear counterpart for nonlinear system identification. Unfortunately, an undesirable characteristic of these methods is…

Machine Learning · Statistics 2013-06-25 Wei Gao , Jie Chen , Cédric Richard , Jianguo Huang

The kernel least-mean-square (KLMS) algorithm is an appealing tool for online identification of nonlinear systems due to its simplicity and robustness. In addition to choosing a reproducing kernel and setting filter parameters, designing a…

Machine Learning · Statistics 2013-11-01 Jie Chen , Wei Gao , Cédric Richard , Jose-Carlos M. Bermudez

This work presents a distributed algorithm for nonlinear adaptive learning. In particular, a set of nodes obtain measurements, sequentially one per time step, which are related via a nonlinear function; their goal is to collectively…

Information Theory · Computer Science 2016-02-09 Symeon Chouvardas , Moez Draief

We propose a novel adaptive kernel based regression method for complex-valued signals: the generalized complex-valued kernel least-mean-square (gCKLMS). We borrow from the new results on widely linear reproducing kernel Hilbert space…

Machine Learning · Statistics 2019-10-02 Rafael Boloix-Tortosa , Juan José Murillo-Fuentes , Sotirios A. Tsaftaris

Adaptive algorithms based on kernel structures have been a topic of significant research over the past few years. The main advantage is that they form a family of universal approximators, offering an elegant solution to problems with…

Machine Learning · Computer Science 2017-08-29 R. C. de Lamare , André Flores

Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform…

Machine Learning · Statistics 2017-07-14 Felipe Tobar

We present a probabilistic framework for both (i) determining the initial settings of kernel adaptive filters (KAFs) and (ii) constructing fully-adaptive KAFs whereby in addition to weights and dictionaries, kernel parameters are learnt…

Machine Learning · Statistics 2017-07-21 Iván Castro , Cristóbal Silva , Felipe Tobar

The robustness of the kernel recursive least square (KRLS) algorithm has recently been improved by combining them with more robust information-theoretic learning criteria, such as minimum error entropy (MEE) and generalized MEE (GMEE),…

Information Theory · Computer Science 2023-09-07 Jiacheng He , Gang Wang , Kun Zhang , Shan Zhong , Bei Peng

The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision…

Machine Learning · Computer Science 2021-05-20 Tomoya Wada , Kosuke Fukumori , Toshihisa Tanaka , Simone Fiori

We present a new framework for online Least Squares algorithms for nonlinear modeling in RKH spaces (RKHS). Instead of implicitly mapping the data to a RKHS (e.g., kernel trick), we map the data to a finite dimensional Euclidean space,…

Machine Learning · Computer Science 2016-06-14 Pantelis Bouboulis , Spyridon Pougkakiotis , Sergios Theodoridis

In this paper, a kernel least mean absolute third (KLMAT) algorithm is developed for adaptive prediction. Combining the benefits of the kernel method and the least mean absolute third (LMAT) algorithm, the proposed KLMAT algorithm performs…

Systems and Control · Computer Science 2017-08-15 Lu Lu , Haiquan Zhao , Badong Chen

We consider the random-design least-squares regression problem within the reproducing kernel Hilbert space (RKHS) framework. Given a stream of independent and identically distributed input/output data, we aim to learn a regression function…

Statistics Theory · Mathematics 2016-03-30 Aymeric Dieuleveut , Francis Bach

We study the relationship between online Gaussian process (GP) regression and kernel least mean squares (KLMS) algorithms. While the latter have no capacity of storing the entire posterior distribution during online learning, we discover…

Machine Learning · Statistics 2016-09-13 Steven Van Vaerenbergh , Jesus Fernandez-Bes , Víctor Elvira

Kernel adaptive filtering (KAF) integrates traditional linear algorithms with kernel methods to generate nonlinear solutions in the input space. The standard approach relies on the representer theorem and the kernel trick to perform…

Signal Processing · Electrical Eng. & Systems 2025-01-16 Kan Li , Jose C. Principe
‹ Prev 1 2 3 10 Next ›