English

Learnable Faster Kernel-PCA for Nonlinear Fault Detection: Deep Autoencoder-Based Realization

Machine Learning 2024-10-28 v1 Systems and Control Systems and Control

Abstract

Kernel principal component analysis (KPCA) is a well-recognized nonlinear dimensionality reduction method that has been widely used in nonlinear fault detection tasks. As a kernel trick-based method, KPCA inherits two major problems. First, the form and the parameters of the kernel function are usually selected blindly, depending seriously on trial-and-error. As a result, there may be serious performance degradation in case of inappropriate selections. Second, at the online monitoring stage, KPCA has much computational burden and poor real-time performance, because the kernel method requires to leverage all the offline training data. In this work, to deal with the two drawbacks, a learnable faster realization of the conventional KPCA is proposed. The core idea is to parameterize all feasible kernel functions using the novel nonlinear DAE-FE (deep autoencoder based feature extraction) framework and propose DAE-PCA (deep autoencoder based principal component analysis) approach in detail. The proposed DAE-PCA method is proved to be equivalent to KPCA but has more advantage in terms of automatic searching of the most suitable nonlinear high-dimensional space according to the inputs. Furthermore, the online computational efficiency improves by approximately 100 times compared with the conventional KPCA. With the Tennessee Eastman (TE) process benchmark, the effectiveness and superiority of the proposed method is illustrated.

Keywords

Cite

@article{arxiv.2112.04193,
  title  = {Learnable Faster Kernel-PCA for Nonlinear Fault Detection: Deep Autoencoder-Based Realization},
  author = {Zelin Ren and Xuebing Yang and Yuchen Jiang and Wensheng Zhang},
  journal= {arXiv preprint arXiv:2112.04193},
  year   = {2024}
}

Comments

11 pages, 7 figures. This work has been submitted to the IEEE for possible publication

R2 v1 2026-06-24T08:08:46.053Z