English
Related papers

Related papers: Complex Correntropy: Probabilistic Interpretation …

200 papers

In this paper, we study the robust subspace clustering problem, which aims to cluster the given possibly noisy data points into their underlying subspaces. A large pool of previous subspace clustering methods focus on the graph construction…

Computer Vision and Pattern Recognition · Computer Science 2015-01-20 Canyi Lu , Jinhui Tang , Min Lin , Liang Lin , Shuicheng Yan , Zhouchen Lin

In this paper, we present a local information theoretic approach to explicitly learn probabilistic clustering of a discrete random variable. Our formulation yields a convex maximization problem for which it is NP-hard to find the global…

Machine Learning · Computer Science 2018-10-12 David Qiu , Anuran Makur , Lizhong Zheng

In this paper we formulate a solution of the robust linear regression problem in a general framework of correntropy maximization. Our formulation yields a unified class of estimators which includes the Gaussian and Laplacian kernel-based…

Systems and Control · Computer Science 2017-09-04 Laurent Bako

In recent years, correntropy has been seccessfully applied to robust adaptive filtering to eliminate adverse effects of impulsive noises or outliers. Correntropy is generally defined as the expectation of a Gaussian kernel between two…

Signal Processing · Electrical Eng. & Systems 2021-11-02 Badong Chen , Yuqing Xie , Zhuang Li , Yingsong Li , Pengju Ren

The Partial Least Square Regression (PLSR) exhibits admirable competence for predicting continuous variables from inter-correlated brain recordings in the brain-computer interface. However, PLSR is in essence formulated based on the least…

Signal Processing · Electrical Eng. & Systems 2023-11-22 Yuanhao Li , Badong Chen , Gang Wang , Natsue Yoshimura , Yasuharu Koike

A robust adaptive model predictive control (MPC) algorithm is presented for linear, time invariant systems with unknown dynamics and subject to bounded measurement noise. The system is characterized by an impulse response model, which is…

Systems and Control · Electrical Eng. & Systems 2019-11-21 Anilkumar Parsi , Andrea Iannelli , Mingzhou Yin , Mohammad Khosravi , Roy S. Smith

This paper suggests a few novel Cholesky-based square-root algorithms for the maximum correntropy criterion Kalman filtering. In contrast to the previously obtained results, new algorithms are developed in the so-called {\it condensed} form…

Optimization and Control · Mathematics 2023-10-31 Maria Kulikova

Distributed estimation over networks draws much attraction in recent years. In many situations, due to imperfect information communication among nodes, the performance of traditional diffusion adaptive algorithms such as the diffusion LMS…

Information Theory · Computer Science 2018-02-15 Yicong He , Fei Wang , Shiyuan Wang , Pengju Ren , Badong Chen

Process monitoring and control requires detection of structural changes in a data stream in real time. This article introduces an efficient sequential Monte Carlo algorithm designed for learning unknown changepoints in continuous time. The…

Applications · Statistics 2015-09-29 Melissa J. M. Turcotte , Nicholas A. Heard

In recent years, correntropy and its applications in machine learning have been drawing continuous attention owing to its merits in dealing with non-Gaussian noise and outliers. However, theoretical understanding of correntropy, especially…

Machine Learning · Computer Science 2019-09-06 Yunlong Feng , Yiming Ying

Nonnegative matrix factorization (NMF) has been successfully applied to many areas for classification and clustering. Commonly-used NMF algorithms mainly target on minimizing the $l_2$ distance or Kullback-Leibler (KL) divergence, which may…

Information Retrieval · Computer Science 2014-10-07 Le Li , Jianjun Yang , Yang Xu , Zhen Qin , Honggang Zhang

Traditional Kalman filter (KF) is derived under the well-known minimum mean square error (MMSE) criterion, which is optimal under Gaussian assumption. However, when the signals are non-Gaussian, especially when the system is disturbed by…

Machine Learning · Statistics 2015-09-16 Badong Chen , Xi Liu , Haiquan Zhao , José C. Príncipe

We consider the problem of robust estimation involving filtering and smoothing for nonlinear state space models which are disturbed by heavy-tailed impulsive noises. To deal with heavy-tailed noises and improve the robustness of the…

Applications · Statistics 2020-12-01 Hongwei Wang , Hongbin Li , Junyi Zuo , Wei Zhang , Heping Wang

Optimization problems involving complex variables, when solved, are typically transformed into real variables, often at the expense of convergence rate and interpretability. This paper introduces a novel formalism for a prominent problem in…

Optimization and Control · Mathematics 2025-04-07 Raneem Madani , Abdel Lisser

Over the last few years, machine learning unlocked previously infeasible features for compression, such as providing guarantees for users' privacy or tailoring compression to specific data statistics (e.g., satellite images or audio…

Information Theory · Computer Science 2026-03-25 Gergely Flamich

The Kalman filter provides an optimal estimation for a linear system with Gaussian noise. However when the noises are non-Gaussian in nature, its performance deteriorates rapidly. For non-Gaussian noises, maximum correntropy Kalman filter…

Optimization and Control · Mathematics 2023-02-07 Joydeb Saha , Shovan Bhaumik

Currently, adaptive filtering algorithms have been widely applied in frequency estimation for power systems. However, research on diffusion tasks remains insufficient. Existing diffusion adaptive frequency estimation algorithms exhibit…

Signal Processing · Electrical Eng. & Systems 2025-04-11 Haiquan Zhao , Yi Peng , Jinsong Chen , Jinhui Hu

Computing conceptual structures, like formal concept lattices, is in the age of massive data sets a challenging task. There are various approaches to deal with this, e.g., random sampling, parallelization, or attribute extraction. A so far…

Artificial Intelligence · Computer Science 2020-02-28 Tom Hanika , Maren Koyda , Gerd Stumme

As an effective and efficient discriminative learning method, Broad Learning System (BLS) has received increasing attention due to its outstanding performance in various regression and classification problems. However, the standard BLS is…

Machine Learning · Computer Science 2023-04-06 Yunfei Zheng , Badong Chen , Shiyuan Wang , Weiqun Wang

In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization…

Probability · Mathematics 2018-03-30 C. Soizea , R. Ghanem , C. Safta , X. Huan , Z. P. Vane , J. Oefelein , G. Lacaz , H. N. Najm , Q. Tang , X. Chen