English
Related papers

Related papers: Generalized Minimum Error Entropy for Adaptive Fil…

200 papers

The conventional Minimum Error Entropy criterion (MEE) has its limitations, showing reduced sensitivity to error mean values and uncertainty regarding error probability density function locations. To overcome this, a MEE with fiducial…

Signal Processing · Electrical Eng. & Systems 2023-09-12 Haiquan Zhao , Yuan Gao , Yingying Zhu

As a robust nonlinear similarity measure in kernel space, correntropy has received increasing attention in domains of machine learning and signal processing. In particular, the maximum correntropy criterion (MCC) has recently been…

Machine Learning · Statistics 2016-07-12 Badong Chen , Lei Xing , Haiquan Zhao , Nanning Zheng , José C. Príncipe

The present paper proposes generalized Gaussian kernel adaptive filtering, where the kernel parameters are adaptive and data-driven. The Gaussian kernel is parametrized by a center vector and a symmetric positive definite (SPD) precision…

Machine Learning · Computer Science 2021-05-20 Tomoya Wada , Kosuke Fukumori , Toshihisa Tanaka , Simone Fiori

To date most linear and nonlinear Kalman filters (KFs) have been developed under the Gaussian assumption and the well-known minimum mean square error (MMSE) criterion. In order to improve the robustness with respect to impulsive (or…

Systems and Control · Computer Science 2019-04-18 Badong Chen , Lujuan Dang , Yuantao Gu , Nanning Zheng , Jose C. Prıncipe

The minimum error entropy (MEE) has been extensively used in unscented Kalman filter (UKF) to handle impulsive noises or abnormal measurement data in non-Gaussian systems. However, the MEE-UKF has poor numerical stability due to the inverse…

Signal Processing · Electrical Eng. & Systems 2023-09-19 Boyu Tian , Haiquan Zhao

The minimum error entropy (MEE) criterion has been verified as a powerful approach for non-Gaussian signal processing and robust machine learning. However, the implementation of MEE on robust classification is rather a vacancy in the…

Machine Learning · Computer Science 2025-08-07 Yuanhao Li , Badong Chen , Natsue Yoshimura , Yasuharu Koike

In recent years, correntropy has been seccessfully applied to robust adaptive filtering to eliminate adverse effects of impulsive noises or outliers. Correntropy is generally defined as the expectation of a Gaussian kernel between two…

Signal Processing · Electrical Eng. & Systems 2021-11-02 Badong Chen , Yuqing Xie , Zhuang Li , Yingsong Li , Pengju Ren

The ensemble Gaussian mixture filter (EnGMF) is a non-linear filter suited to data assimilation of highly non-Gaussian and non-linear models that has practical utility in the case of a small number of samples, and theoretical convergence to…

Optimization and Control · Mathematics 2024-06-03 Andrey A. Popov , Enrico M. Zucchelli , Renato Zanetti

The robustness of the kernel recursive least square (KRLS) algorithm has recently been improved by combining them with more robust information-theoretic learning criteria, such as minimum error entropy (MEE) and generalized MEE (GMEE),…

Information Theory · Computer Science 2023-09-07 Jiacheng He , Gang Wang , Kun Zhang , Shan Zhong , Bei Peng

Linear regression model (LRM) based on mean square error (MSE) criterion is widely used in Granger causality analysis (GCA), which is the most commonly used method to detect the causality between a pair of time series. However, when signals…

Methodology · Statistics 2019-02-20 Badong Chen , Rongjin Ma , Siyu Yu , Shaoyi Du , Jing Qin

In real applications, non-Gaussian distributions are frequently caused by outliers and impulsive disturbances, and these will impair the performance of the classical cubature Kalman filter (CKF) algorithm. In this letter, a modified…

Information Theory · Computer Science 2023-08-15 Jiacheng He , Gang Wang , Zhenyu Feng , Shan Zhong , Bei Peng

Constrained adaptive filtering algorithms inculding constrained least mean square (CLMS), constrained affine projection (CAP) and constrained recursive least squares (CRLS) have been extensively studied in many applications. Most existing…

Machine Learning · Statistics 2016-12-15 Siyuan Peng , Badong Chen , Lei Sun , Zhiping Lin , Wee Ser

This paper introduces the minimum error entropy (MEE) criterion as an advanced information-theoretic loss function tailored for deep learning applications in wireless communications. The MEE criterion leverages higher-order statistical…

Information Theory · Computer Science 2024-11-03 Rumeshika Pallewela , Eslam Eldeeb , Hirley Alves

Kernel adaptive filters, a class of adaptive nonlinear time-series models, are known by their ability to learn expressive autoregressive patterns from sequential data. However, for trivial monotonic signals, they struggle to perform…

Machine Learning · Statistics 2017-07-14 Felipe Tobar

In this work, a kernel-based Ensemble Gaussian Mixture Probability Hypothesis Density (EnGM-PHD) filter is presented for multi-target filtering applications. The EnGM-PHD filter combines the Gaussian-mixture-based techniques of the Gaussian…

Machine Learning · Computer Science 2025-05-02 Dalton Durant , Renato Zanetti

This paper introduces a novel kernel density estimator (KDE) based on the generalised exponential (GE) distribution, designed specifically for positive continuous data. The proposed GE KDE offers a mathematically tractable form that avoids…

Methodology · Statistics 2026-02-18 Laura M. Craig , Wagner Barreto-Souza

Several emerging post-Bayesian methods target a probability distribution for which an entropy-regularised variational objective is minimised. This increased flexibility introduces a computational challenge, as one loses access to an…

Computation · Statistics 2025-12-17 Clémentine Chazal , Heishiro Kanagawa , Zheyang Shen , Anna Korba , Chris. J. Oates

Consider the minimum mean-square error (MMSE) of estimating an arbitrary random variable from its observation contaminated by Gaussian noise. The MMSE can be regarded as a function of the signal-to-noise ratio (SNR) as well as a functional…

Information Theory · Computer Science 2010-04-21 Dongning Guo , Yihong Wu , Shlomo Shamai , Sergio Verdu

Belonging to the family of Bayesian nonparametrics, Gaussian process (GP) based approaches have well-documented merits not only in learning over a rich class of nonlinear functions, but also in quantifying the associated uncertainty.…

Machine Learning · Statistics 2021-10-14 Qin Lu , Georgios V. Karanikolas , Georgios B. Giannakis

We consider the minimum error entropy (MEE) criterion and an empirical risk minimization learning algorithm in a regression setting. A learning theory approach is presented for this MEE algorithm and explicit error bounds are provided in…

Machine Learning · Computer Science 2013-02-26 Ting Hu , Jun Fan , Qiang Wu , Ding-Xuan Zhou
‹ Prev 1 2 3 10 Next ›