English
Related papers

Related papers: ICS for complex data with application to outlier d…

200 papers

We study a novel outlier detection problem that aims to identify abnormal input-output associations in data, whose instances consist of multi-dimensional input (context) and output (responses) pairs. We present our approach that works by…

Artificial Intelligence · Computer Science 2017-08-04 Charmgil Hong , Siqi Liu , Milos Hauskrecht

There is a growing need for machine learning-based anomaly detection strategies to broaden the search for Beyond-the-Standard-Model (BSM) physics at the Large Hadron Collider (LHC) and elsewhere. The first step of any anomaly detection…

High Energy Physics - Phenomenology · Physics 2023-01-18 Gregor Kasieczka , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , Mariel Pettee , David Shih

The density based clustering method {\em Density-Based Spatial Clustering of Applications with Noise (DBSCAN)} is a popular method for outlier recognition and has received tremendous attention from many different areas. A major issue of the…

Computational Geometry · Computer Science 2020-02-28 Hu Ding , Fan Yang

Outlier detection and cleaning are essential steps in data preprocessing to ensure the integrity and validity of data analyses. This paper focuses on outlier points within individual trajectories, i.e., points that deviate significantly…

Databases · Computer Science 2025-11-26 Mariana M Garcez Duarte , Mahmoud Sakr

In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outliers can lead to better datasets by (1) removing noise in…

Outlier generation is a popular technique used for solving important outlier detection tasks. Generating outliers with realistic behavior is challenging. Popular existing methods tend to disregard the 'multiple views' property of outliers…

Machine Learning · Computer Science 2024-09-04 Jose Cribeiro-Ramallo , Vadim Arzamasov , Klemens Böhm

The neighbor-based method has become a powerful tool to handle the outlier detection problem, which aims to infer the abnormal degree of the sample based on the compactness of the sample and its neighbors. However, the existing methods…

Machine Learning · Computer Science 2024-05-30 Zhuang Qi , Junlin Zhang , Xiaming Chen , Xin Qi

Outlying observations, which significantly deviate from other measurements, may distort the conclusions of data analysis. Therefore, identifying outliers is one of the important problems that should be solved to obtain reliable results.…

Computation · Statistics 2014-05-01 Soo-Heang Eo , Seung-Mo Hong , HyungJun Cho

While nowadays visual anomaly detection algorithms use deep neural networks to extract salient features from images, the high dimensionality of extracted features makes it difficult to apply those algorithms to large data with 1000s of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Teng-Yok Lee

The scores of distance-based outlier detection methods are difficult to interpret, making it challenging to determine a cut-off threshold between normal and outlier data points without additional context. We describe a generic…

Machine Learning · Computer Science 2023-07-20 David Muhr , Michael Affenzeller , Josef Küng

With predictive models becoming prevalent, companies are expanding the types of data they gather. As a result, the collected datasets consist not only of simple numerical features but also more complex objects such as time series, images,…

Machine Learning · Computer Science 2025-07-01 Sebastian Chwilczyński , Dariusz Brzezinski

Intrusion detection system (IDS) is one of extensively used techniques in a network topology to safeguard the integrity and availability of sensitive assets in the protected systems. Although many supervised and unsupervised learning…

Cryptography and Security · Computer Science 2020-04-03 Yuyang Zhou , Guang Cheng , Shanqing Jiang , Mian Dai

We consider the multi-class classification problem when the training data and the out-of-sample test data may have different distributions and propose a method called BCOPS (balanced and conformal optimized prediction sets). BCOPS…

Methodology · Statistics 2019-06-26 Leying Guan , Rob Tibshirani

We consider the problem of analyzing the heterogeneity of clustering distributions for multiple groups of observed data, each of which is indexed by a covariate value, and inferring global clusters arising from observations aggregated over…

Methodology · Statistics 2012-12-06 XuanLong Nguyen

Modern machine learning-based recognition approaches require large-scale datasets with large number of labelled training images. However, such datasets are inherently difficult and costly to collect and annotate. Hence there is a great and…

Machine Learning · Computer Science 2019-12-30 Yanwei Fu , De-An Huang , Leonid Sigal

Data depth is an efficient tool for robustly summarizing the distribution of functional data and detecting potential magnitude and shape outliers. Commonly used functional data depth notions, such as the modified band depth and extremal…

Methodology · Statistics 2023-11-07 Cristian F. Jimenez-Varon , Fouzi Harrou , Ying Sun

Anomaly detection is a critical task in data mining and management with applications spanning fraud detection, network security, and log monitoring. Despite extensive research, existing unsupervised anomaly detection methods still face…

Machine Learning · Computer Science 2025-10-16 Yang Cao , Sikun Yang , Hao Tian , Kai He , Lianyong Qi , Ming Liu , Yujiu Yang

Distance-based anomaly detection methods rely on compact in-distribution (ID) embeddings that are well separated from anomalies. However, conventional contrastive learning strategies often struggle to achieve this balance, either promoting…

Machine Learning · Computer Science 2026-02-02 Willian T. Lunardi , Abdulrahman Banabila , Dania Herzalla , Martin Andreoni

We propose two new outlier detection methods, for identifying and classifying different types of outliers in (big) functional data sets. The proposed methods are based on an existing method called Massive Unsupervised Outlier Detection…

Methodology · Statistics 2021-10-15 Oluwasegun Taiwo Ojo , Antonio Fernández Anta , Rosa E. Lillo , Carlo Sguera

Methods for anomaly detection of new physics processes are often limited to low-dimensional spaces due to the difficulty of learning high-dimensional probability densities. Particularly at the constituent level, incorporating desirable…

High Energy Physics - Phenomenology · Physics 2024-03-06 Vinicius Mikuni , Benjamin Nachman