English
Related papers

Related papers: Comparison of outlier detection methods on astrono…

200 papers

The curse of outlier measurements in estimation problems is a well known issue in a variety of fields. Therefore, outlier removal procedures, which enables the identification of spurious measurements within a set, have been developed for…

Information Theory · Computer Science 2017-08-02 Marco Compagnoni , Alessia Pini , Antonio Canclini , Paolo Bestagini , Fabio Antonacci , Stefano Tubaro , Augusto Sarti

We present a proof of concept for a new algorithm which can be used to detect exoplanets in high contrast images. The algorithm properly combines mutliple observations acquired during different nights, taking into account the orbital motion…

Instrumentation and Methods for Astrophysics · Physics 2018-08-01 M. Nowak , H. Le Coroller , L. Arnold , K. Dohlen , D. Estevez , T. Fusco , J. -F. Sauvage , A. Vigan

An outlier is an event or observation that is defined as an unusual activity, intrusion, or a suspicious data point that lies at an irregular distance from a population. The definition of an outlier event, however, is subjective and depends…

Machine Learning · Computer Science 2021-12-02 Md Nazmul Kabir Sikder , Feras A. Batarseh

I describe two novel techniques originally devised to select strongly lensed quasar candidates in wide-field surveys. The first relies on outlier selection in optical and mid-infrared magnitude space; the second combines mid-infrared colour…

Astrophysics of Galaxies · Physics 2017-08-23 Adriano Agnello

Unsupervised Anomaly detection (AD) requires building a notion of normalcy, distinguishing in-distribution (ID) and out-of-distribution (OOD) data, using only available ID samples. Recently, large gains were made on this task for the domain…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Mohamed Yousef , Marcel Ackermann , Unmesh Kurup , Tom Bishop

We present a nonparametric method for outlier detection that takes full account of local variations in intrinsic dimensionality within the dataset. Using the theory of Local Intrinsic Dimensionality (LID), our 'dimensionality-aware' outlier…

We propose a simple multiple outlier identification method for parametric location-scale and shape-scale models when the number of possible outliers is not specified. The method is based on a result giving asymptotic properties of extreme…

Statistics Theory · Mathematics 2020-12-07 Vilijandas Bagdonavicius , Linas Petkevicius

We consider the problem of detecting anomalies in the directional distribution of fibre materials observed in 3D images. We divide the image into a set of scanning windows and classify them into two clusters: homogeneous material and…

Outlier Detection is a critical and cardinal research task due its array of applications in variety of domains ranging from data mining, clustering, statistical analysis, fraud detection, network intrusion detection and diagnosis of…

Machine Learning · Computer Science 2018-03-15 Archit Harsh , John E. Ball , Pan Wei

Distance-based methods involve the computation of distance values between features and are a well-established paradigm in machine learning. In anomaly detection, anomalies are identified by their large distance from normal data points.…

Instrumentation and Methods for Astrophysics · Physics 2025-10-29 Siddharth Chaini , Federica B. Bianco , Ashish Mahabal

This year, a second generation of coronagraphs dedicated to high-contrast direct imaging of exoplanets is starting operations. Among them, SPHERE, installed at the focus of the UT3 Very Large Telescope, reaches unprecedented contrast ratios…

Instrumentation and Methods for Astrophysics · Physics 2015-10-22 H. Le Coroller , M. Nowak , L. Arnold , K. Dohlen , T. Fusco , J. F. Sauvage , A. Vigan

This study investigates the effectiveness of unsupervised outlier detection methods in audit analytics, utilizing USA spending data from the U.S. Department of Health and Human Services (DHHS) as a case example. We employ and compare…

Machine Learning · Computer Science 2025-09-25 Buhe Li , Berkay Kaplan , Maksym Lazirko , Aleksandr Kogan

Normalization and outlier detection belong to the preprocessing of gene expression data. We propose a natural normalization procedure based on statistical data depth which normalizes to the distribution of gene expressions of the most…

Methodology · Statistics 2022-06-29 Alicia Nieto-Reyes , Javier Cabrera

It is important to detect anomalous inputs when deploying machine learning systems. The use of larger and more complex inputs in deep learning magnifies the difficulty of distinguishing between anomalous and in-distribution examples. At the…

Machine Learning · Computer Science 2019-01-30 Dan Hendrycks , Mantas Mazeika , Thomas Dietterich

Most real-world IoT data analysis tasks, such as clustering and anomaly event detection, are unsupervised and highly susceptible to the presence of outliers. In addition to sporadic scattered outliers caused by factors such as faulty sensor…

Machine Learning · Computer Science 2026-03-16 Yiqun Zhang , Zexi Tan , Xiaopeng Luo , Yunlin Liu

In the problem of out-of-distribution (OOD) detection, the usage of auxiliary data as outlier data for fine-tuning has demonstrated encouraging performance. However, previous methods have suffered from a trade-off between classification…

Machine Learning · Computer Science 2023-08-03 Hyunjun Choi , JaeHo Chung , Hawook Jeong , Jin Young Choi

The detection of out of distribution samples for image classification has been widely researched. Safety critical applications, such as autonomous driving, would benefit from the ability to localise the unusual objects causing the image to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-11 Matt Angus , Krzysztof Czarnecki , Rick Salay

Detecting test data deviating from training data is a central problem for safe and robust machine learning. Likelihoods learned by a generative model, e.g., a normalizing flow via standard log-likelihood training, perform poorly as an…

Machine Learning · Computer Science 2023-04-28 Robert Schmier , Ullrich Köthe , Christoph-Nikolas Straehle

Automating anomaly detection is an open problem in many scientific fields, particularly in time-domain astronomy, where modern telescopes generate millions of alerts per night. Currently, most anomaly detection algorithms for astronomical…

Machine Learning · Computer Science 2024-08-20 Rithwik Gupta , Daniel Muthukrishna , Michelle Lochner

Given an unlabeled dataset, wherein we have access only to pairwise similarities (or distances), how can we effectively (1) detect outliers, and (2) annotate/tag the outliers by type? Outlier detection has a large literature, yet we find a…

Machine Learning · Computer Science 2021-10-19 Guilherme D. F. Silva , Leman Akoglu , Robson L. F. Cordeiro