English
Related papers

Related papers: Do Ensembling and Meta-Learning Improve Outlier De…

200 papers

This paper proposes a novel fast online methodology for outlier detection called the exception maximization outlier detection method(EMODM), which employs probabilistic models and statistical algorithms to detect abnormal patterns from the…

Machine Learning · Statistics 2025-06-03 Zhikun Zhang , Yiting Duan , Xiangjun Wang , Mingyuan Zhang

Outlying observations can be challenging to handle and adversely affect subsequent analyses, especially in data with increasing dimensional complexity. Although outliers are not always undesired anomalies in the data and may possess…

Methodology · Statistics 2025-09-18 Anthony-Alexander Christidis , Gabriela Cohen-Freue

In anomaly detection, a prominent task is to induce a model to identify anomalies learned solely based on normal data. Generally, one is interested in finding an anomaly detector that correctly identifies anomalies, i.e., data points that…

Machine Learning · Computer Science 2022-11-28 David Schubert , Pritha Gupta , Marcel Wever

Unsupervised anomaly detection (AD) is critical for a wide range of practical applications, from network security to health and medical tools. Due to the diversity of problems, no single algorithm has been found to be superior for all AD…

Machine Learning · Computer Science 2023-05-18 Małgorzata Gutowska , Suzanne Little , Andrew McCarren

Ensemble learning, the machine learning paradigm where multiple algorithms are combined, has exhibited promising perfomance in a variety of tasks. The present work focuses on unsupervised ensemble classification. The term unsupervised…

Machine Learning · Computer Science 2020-12-22 Panagiotis A. Traganitis , Georgios B. Giannakis

Today there exists no shortage of outlier detection algorithms in the literature, yet the complementary and critical problem of unsupervised outlier model selection (UOMS) is vastly understudied. In this work we propose ELECT, a new…

Machine Learning · Computer Science 2022-11-04 Yue Zhao , Sean Zhang , Leman Akoglu

In unsupervised ensemble learning, one obtains predictions from multiple sources or classifiers, yet without knowing the reliability and expertise of each source, and with no labeled data to assess it. The task is to combine these possibly…

Machine Learning · Computer Science 2016-02-24 Ariel Jaffe , Ethan Fetaya , Boaz Nadler , Tingting Jiang , Yuval Kluger

Ensemble Learning methods combine multiple algorithms performing the same task to build a group with superior quality. These systems are well adapted to the distributed setup, where each peer or machine of the network hosts one algorithm…

Machine Learning · Computer Science 2021-10-19 Gaëlle Candel , David Naccache

Unsupervised learning, and more specifically clustering, suffers from the need for expertise in the field to be of use. Researchers must make careful and informed decisions on which algorithm to use with which set of hyperparameters for a…

Machine Learning · Computer Science 2021-12-28 Antoine Zambelli

A common challenge faced in practical supervised learning, such as medical image processing and robotic interactions, is that there are plenty of tasks but each task cannot afford to collect enough labeled examples to be learned in…

Machine Learning · Computer Science 2020-06-22 Weihao Kong , Raghav Somani , Sham Kakade , Sewoong Oh

Incipient anomalies present milder symptoms compared to severe ones, and are more difficult to detect and diagnose due to their close resemblance to normal operating conditions. The lack of incipient anomaly examples in the training data…

Machine Learning · Computer Science 2020-08-21 Yingshui Tan , Baihong Jin , Qiushi Cui , Xiangyu Yue , Alberto Sangiovanni Vincentelli

Model ensembling is a well-established technique for improving the performance of machine learning models. Conventionally, this involves averaging the output distributions of multiple models and selecting the most probable label. This idea…

Machine Learning · Computer Science 2026-05-26 Jiale Fu , Yuchu Jiang , Peijun Wu , Chonghan Liu , Joey Tianyi Zhou , Xu Yang

To address the challenges of imbalanced multi-class datasets typically used for rare event detection in critical cyber-physical systems, we propose an optimal, efficient, and adaptable mixed integer programming (MIP) ensemble weighting…

Machine Learning · Computer Science 2025-04-16 Georgios Tertytchny , Georgios L. Stavrinides , Maria K. Michael

The success of machine learning algorithms heavily relies on the quality of samples and the accuracy of their corresponding labels. However, building and maintaining large, high-quality datasets is an enormous task. This is especially true…

Image and Video Processing · Electrical Eng. & Systems 2024-08-02 Mohammad Tariqul Islam , Jason W. Fleischer

Anomaly detection aims at identifying data points that show systematic deviations from the majority of data in an unlabeled dataset. A common assumption is that clean training data (free of anomalies) is available, which is often violated…

Machine Learning · Computer Science 2022-07-20 Chen Qiu , Aodong Li , Marius Kloft , Maja Rudolph , Stephan Mandt

Feature selection places an important role in improving the performance of outlier detection, especially for noisy data. Existing methods usually perform feature selection and outlier scoring separately, which would select feature subsets…

Machine Learning · Computer Science 2020-01-17 Li Cheng , Yijie Wang , Xinwang Liu , Bin Li

We study the classic $k$-means/median clustering, which are fundamental problems in unsupervised learning, in the setting where data are partitioned across multiple sites, and where we are allowed to discard a small portion of the data by…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-12 Jiecao Chen , Erfan Sadeqi Azer , Qin Zhang

Several multi-target regression methods were devel-oped in the last years aiming at improving predictive performanceby exploring inter-target correlation within the problem. However, none of these methods outperforms the others for all…

Classification and clustering algorithms have been proved to be successful individually in different contexts. Both of them have their own advantages and limitations. For instance, although classification algorithms are more powerful than…

Machine Learning · Computer Science 2017-08-30 Tanmoy Chakraborty

The subpopulationtion shift, characterized by a disparity in subpopulation distributibetween theween the training and target datasets, can significantly degrade the performance of machine learning models. Current solutions to subpopulation…