English

Anomaly Detection by Recombining Gated Unsupervised Experts

Machine Learning 2022-10-14 v5 Machine Learning

Abstract

Anomaly detection has been considered under several extents of prior knowledge. Unsupervised methods do not require any labelled data, whereas semi-supervised methods leverage some known anomalies. Inspired by mixture-of-experts models and the analysis of the hidden activations of neural networks, we introduce a novel data-driven anomaly detection method called ARGUE. Our method is not only applicable to unsupervised and semi-supervised environments, but also profits from prior knowledge of self-supervised settings. We designed ARGUE as a combination of dedicated expert networks, which specialise on parts of the input data. For its final decision, ARGUE fuses the distributed knowledge across the expert systems using a gated mixture-of-experts architecture. Our evaluation motivates that prior knowledge about the normal data distribution may be as valuable as known anomalies.

Keywords

Cite

@article{arxiv.2008.13763,
  title  = {Anomaly Detection by Recombining Gated Unsupervised Experts},
  author = {J. -P. Schulze and P. Sperl and K. Böttinger},
  journal= {arXiv preprint arXiv:2008.13763},
  year   = {2022}
}

Comments

Accepted at IJCNN 2022

R2 v1 2026-06-23T18:13:07.669Z