English
Related papers

Related papers: Explainable Unsupervised Anomaly Detection with Ra…

200 papers

We propose a principled method for autoencoding with random forests. Our strategy builds on foundational results from nonparametric statistics and spectral graph theory to learn a low-dimensional embedding of the model that optimally…

Machine Learning · Statistics 2026-01-16 Binh Duc Vu , Jan Kapar , Marvin Wright , David S. Watson

Intrusion detection has been a key topic in the field of cyber security, and the common network threats nowadays have the characteristics of varieties and variation. Considering the serious imbalance of intrusion detection datasets will…

Cryptography and Security · Computer Science 2022-04-15 Zhewei Chen , Wenwen Yu , Linyue Zhou

We introduce a powerful student-teacher framework for the challenging problem of unsupervised anomaly detection and pixel-precise anomaly segmentation in high-resolution images. Student networks are trained to regress the output of a…

Computer Vision and Pattern Recognition · Computer Science 2020-09-08 Paul Bergmann , Michael Fauser , David Sattlegger , Carsten Steger

Anomaly detection at scale is an extremely challenging problem of great practicality. When data is large and high-dimensional, it can be difficult to detect which observations do not fit the expected behaviour. Recent work has coalesced on…

Machine Learning · Computer Science 2020-08-05 Charlie Dickens , Eric Meissner , Pablo G. Moreno , Tom Diethe

Random Forests have been extensively used in regression and classification, inspiring the development of various forest-based methods. Among these, Mondrian Forests, derived from the Mondrian process, mark a significant advancement.…

Statistics Theory · Mathematics 2025-02-28 Haoran Zhan , Jingli Wang , Yingcun Xia

Random forests have become an established tool for classification and regression, in particular in high-dimensional settings and in the presence of complex predictor-response relationships. For bounded outcome variables restricted to the…

Methodology · Statistics 2019-01-21 Leonie Weinhold , Matthias Schmid , Marvin N. Wright , Moritz Berger

We propose a supervised anomaly detection method based on neural density estimators, where the negative log likelihood is used for the anomaly score. Density estimators have been widely used for unsupervised anomaly detection. By the recent…

Machine Learning · Statistics 2019-04-15 Tomoharu Iwata , Yuki Yamanaka

Despite widespread interest and practical use, the theoretical properties of random forests are still not well understood. In this paper we contribute to this understanding in two ways. We present a new theoretically tractable variant of…

Machine Learning · Statistics 2013-10-08 Misha Denil , David Matheson , Nando de Freitas

Systematic sampling is often used to select plot locations for forest inventory estimation. However, it is not possible to derive a design-unbiased variance estimator for a systematic sample using one random start. As a result, many forest…

Applications · Statistics 2018-10-22 Chad Babcock , Andrew O. Finley , Timothy G. Gregoire , Hans-Erik Andersen

Complex devices are connected daily and eagerly generate vast streams of multidimensional state measurements. These devices often operate in distinct modes based on external conditions (day/night, occupied/vacant, etc.), and to prevent…

Signal Processing · Electrical Eng. & Systems 2020-07-21 John Sipple

This paper investigates unsupervised anomaly detection in multivariate time-series data using reinforcement learning (RL) in the latent space of an autoencoder. A significant challenge is the limited availability of anomalous data, often…

Machine Learning · Computer Science 2025-02-11 Saba Sanami , Amir G. Aghdam

Random forests are a very effective and commonly used statistical method, but their full theoretical analysis is still an open problem. As a first step, simplified models such as purely random forests have been introduced, in order to shed…

Statistics Theory · Mathematics 2014-07-16 Sylvain Arlot , Robin Genuer

Decision forests (Forests), in particular random forests and gradient boosting trees, have demonstrated state-of-the-art accuracy compared to other methods in many supervised learning scenarios. In particular, Forests dominate other methods…

Anomaly detection has many applications ranging from bank-fraud detection and cyber-threat detection to equipment maintenance and health monitoring. However, choosing a suitable algorithm for a given application remains a challenging design…

We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. This is a common scenario in many important applications. Existing related methods either exclusively…

Machine Learning · Computer Science 2021-06-11 Guansong Pang , Anton van den Hengel , Chunhua Shen , Longbing Cao

Online unsupervised detection of anomalies is crucial to guarantee the correct operation of cyber-physical systems and the safety of humans interacting with them. State-of-the-art approaches based on deep learning via neural networks…

Machine Learning · Computer Science 2024-07-30 Daniele Meli

Random Forests (RF) is a popular machine learning method for classification and regression problems. It involves a bagging application to decision tree models. One of the primary advantages of the Random Forests model is the reduction in…

Machine Learning · Statistics 2022-07-06 Sai K Popuri

Financial literature consists of ample research on similarity and comparison of financial assets and securities such as stocks, bonds, mutual funds, etc. However, going beyond correlations or aggregate statistics has been arduous since…

Computational Finance · Quantitative Finance 2022-10-27 Jerinsh Jeyapaulraj , Dhruv Desai , Peter Chu , Dhagash Mehta , Stefano Pasquali , Philip Sommer

Distance-based methods involve the computation of distance values between features and are a well-established paradigm in machine learning. In anomaly detection, anomalies are identified by their large distance from normal data points.…

Instrumentation and Methods for Astrophysics · Physics 2025-10-29 Siddharth Chaini , Federica B. Bianco , Ashish Mahabal

A random forest is a popular tool for estimating probabilities in machine learning classification tasks. However, the means by which this is accomplished is unprincipled: one simply counts the fraction of trees in a forest that vote for a…

Machine Learning · Statistics 2018-12-17 Matthew A. Olson , Abraham J. Wyner