English
Related papers

Related papers: Comparison of outlier detection methods on astrono…

200 papers

Over the decades, traditional outlier detectors have ignored the group-level factor when calculating outlier scores for objects in data by evaluating only the object-level factor, failing to capture the collective outliers. To mitigate this…

Machine Learning · Computer Science 2022-12-22 Jiawei Yang , Yu Chen , Sylwan Rahardja

The ability to collect and store ever more massive databases has been accompanied by the need to process them efficiently. In many cases, most observations have the same behavior, while a probable small proportion of these observations are…

Statistics Theory · Mathematics 2021-09-21 Myrto Limnios , Nathan Noiry , Stéphan Clémençon

Due to the intractability of characterizing everything that looks unlike the normal data, anomaly detection (AD) is traditionally treated as an unsupervised problem utilizing only normal samples. However, it has recently been found that…

Computer Vision and Pattern Recognition · Computer Science 2023-01-29 Philipp Liznerski , Lukas Ruff , Robert A. Vandermeulen , Billy Joe Franks , Klaus-Robert Müller , Marius Kloft

This work describes an outlier detection procedure (named "OutlierTree") loosely based on the GritBot software developed by RuleQuest research, which works by evaluating and following supervised decision tree splits on variables, in whose…

Machine Learning · Statistics 2020-01-06 David Cortes

Outlier or anomaly detection is an important task in data analysis. We discuss the problem from a geometrical perspective and provide a framework that exploits the metric structure of a data set. Our approach rests on the manifold…

Machine Learning · Statistics 2022-08-01 Moritz Herrmann , Florian Pfisterer , Fabian Scheipl

This study explores the application of autoencoder-based machine learning techniques for anomaly detection to identify exoplanet atmospheres with unconventional chemical signatures using a low-dimensional data representation. We use the…

Earth and Planetary Astrophysics · Physics 2026-01-06 Alexander Roman , Emilie Panek , Roy T. Forestano , Eyup B. Unlu , Katia Matcheva , Konstantin T. Matchev

We present a methodology to discover outliers in catalogs of periodic light-curves. We use cross-correlation as measure of ``similarity'' between two individual light-curves and then classify light-curves with lowest average ``similarity''…

Astrophysics · Physics 2009-11-11 P. Protopapas , J. M. Giammarco , L. Faccioli , M. F. Struble , R. Dave , C. Alcock

We present a novel mathematical optimization framework for outlier detection in multimodal datasets, extending Support Vector Data Description approaches. We provide a primal formulation, in the shape of a Mixed Integer Second Order Cone…

Optimization and Control · Mathematics 2025-07-16 Víctor Blanco , Inmaculada Espejo , Raúl Páez , Antonio M. Rodríguez-Chía

Solar flares not only pose risks to outer space technologies and astronauts' well being, but also cause disruptions on earth to our hight-tech, interconnected infrastructure our lives highly depend on. While a number of machine-learning…

Machine Learning · Computer Science 2022-06-16 Junzhi Wen , Md Reazul Islam , Azim Ahmadzadeh , Rafal A. Angryk

Detecting anomalies in time series data is important in a variety of fields, including system monitoring, healthcare, and cybersecurity. While the abundance of available methods makes it difficult to choose the most appropriate method for a…

Machine Learning · Computer Science 2023-02-03 Ferdinand Rewicki , Joachim Denzler , Julia Niebling

Recent advances in technology have brought major breakthroughs in data collection, enabling a large amount of data to be gathered over time and thus generating time series. Mining this data has become an important task for researchers and…

Machine Learning · Computer Science 2020-02-12 Ane Blázquez-García , Angel Conde , Usue Mori , Jose A. Lozano

Outlier detection is a critical task in data mining, aimed at identifying objects that significantly deviate from the norm. Semi-supervised methods improve detection performance by leveraging partially labeled data but typically overlook…

Machine Learning · Computer Science 2025-12-23 Baiyang Chen , Zhong Yuan , Zheng Liu , Dezhong Peng , Yongxiang Li , Chang Liu , Guiduo Duan

Star clusters are often hard to find, as they may lie in a dense field of background objects or, because in the case of embedded clusters, they are surrounded by a more dispersed population of young stars. This paper discusses four…

Astrophysics of Galaxies · Physics 2011-02-16 S. Schmeja

In subjective assessment of image and video quality, observers rate or compare selected stimuli. Before calculating the mean opinion scores (MOS) for these stimuli from the ratings, it is recommended to identify and deal with outliers that…

Image and Video Processing · Electrical Eng. & Systems 2025-09-09 Dietmar Saupe , Tim Bleile

Outlier detection algorithms typically assign an outlier score to each observation in a dataset, indicating the degree to which an observation is an outlier. However, these scores are often not comparable across algorithms and can be…

Machine Learning · Computer Science 2024-10-31 Philipp Röchner , Henrique O. Marques , Ricardo J. G. B. Campello , Arthur Zimek , Franz Rothlauf

We propose an anomaly detection method for multi-variate scientific data based on analysis of high-order joint moments. Using kurtosis as a reliable measure of outliers, we suggest that principal kurtosis vectors, by analogy to principal…

Computational Physics · Physics 2019-05-01 Konduri Aditya , Hemanth Kolla , W. Philip Kegelmeyer , Timothy M. Shead , Julia Ling , Warren L. Davis

Context: In astronomy, new approaches to process and analyze the exponentially increasing amount of data are inevitable. While classical approaches (e.g. template fitting) are fine for objects of well-known classes, alternative techniques…

Astrophysics of Galaxies · Physics 2016-08-08 S. D. Kügler , K. Polsterer , M. Hoecker

We consider state estimation for networked systems where measurements from sensor nodes are contaminated by outliers. A new hierarchical measurement model is formulated for outlier detection by integrating the outlier-free measurement model…

Applications · Statistics 2022-11-08 Hongwei Wang , Hongbin Li , Wei Zhang , Junyi Zuo , Heping Wang , Jun Fang

The impact of outliers and anomalies on model estimation and data processing is of paramount importance, as evidenced by the extensive body of research spanning various fields over several decades: thousands of research papers have been…

Artificial Intelligence · Computer Science 2023-12-13 Madalina Olteanu , Fabrice Rossi , Florian Yger

Modern astronomical surveys are producing datasets of unprecedented size and richness, increasing the potential for high-impact scientific discovery. This possibility, coupled with the challenge of exploring a large number of sources, has…

Instrumentation and Methods for Astrophysics · Physics 2024-04-01 Verlon Etsebeth , Michelle Lochner , Mike Walmsley , Margherita Grespan