English
Related papers

Related papers: Comparison of outlier detection methods on astrono…

200 papers

This paper presents a novel anomaly and outlier detection algorithm from the SPINEX (Similarity-based Predictions with Explainable Neighbors Exploration) family. This algorithm leverages the concept of similarity and higher-order…

Machine Learning · Computer Science 2024-07-09 MZ Naser , Ahmed Z Naser

In this work we apply and expand on a recently introduced outlier detection algorithm that is based on an unsupervised random forest. We use the algorithm to calculate a similarity measure for stellar spectra from the Apache Point…

Instrumentation and Methods for Astrophysics · Physics 2018-05-29 Itamar Reis , Dovi Poznanski , Dalya Baron , Gail Zasowski , Sahar Shahaf

Outlier recognition is a fundamental problem in data analysis and has attracted a great deal of attention in the past decades. However, most existing methods still suffer from several issues such as high time and space complexities or…

Computational Geometry · Computer Science 2019-04-09 Hu Ding , Mingquan Ye

The development of synoptic sky surveys has led to a massive amount of data for which resources needed for analysis are beyond human capabilities. To process this information and to extract all possible knowledge, machine learning…

Computational Engineering, Finance, and Science · Computer Science 2015-05-29 Isadora Nun , Karim Pichara , Pavlos Protopapas , Dae-Won Kim

When applying outlier detection in settings where data is sensitive, mechanisms which guarantee the privacy of the underlying data are needed. The $k$-nearest neighbors ($k$-NN) algorithm is a simple and one of the most effective methods…

Machine Learning · Computer Science 2021-04-19 Jens Rauch , Iyiola E. Olatunji , Megha Khosla

We hypothesize that similar objects should have similar outlier scores. To our knowledge, all existing outlier detectors calculate the outlier score for each object independently regardless of the outlier scores of the other objects.…

Machine Learning · Computer Science 2023-03-20 Jiawei Yang , Susanto Rahardja , Pasi Franti

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

We propose a new assumption in outlier detection: Normal data instances are commonly located in the area that there is hardly any fluctuation on data density, while outliers are often appeared in the area that there is violent fluctuation…

Machine Learning · Computer Science 2020-06-09 Ding Liu , Hui Li

This paper introduces two novel, outlyingness scores (OSs) based on Cluster Catch Digraphs (CCDs): Outbound Outlyingness Score (OOS) and Inbound Outlyingness Score (IOS). These scores enhance the interpretability of outlier detection…

Machine Learning · Statistics 2025-11-12 Rui Shi , Elvan Ceyhan , Nedret Billor

This paper presents a batch-wise density-based clustering approach for local outlier detection in massive-scale datasets. Unlike the well-known traditional algorithms, which assume that all the data is memory-resident, our proposed method…

Machine Learning · Computer Science 2021-07-06 Sayyed Ahmad Naghavi Nozad , Maryam Amir Haeri , Gianluigi Folino

The interactive exploration of large and evolving datasets is challenging as relationships between underlying variables may not be fully understood. There may be hidden trends and patterns in the data that are worthy of further exploration…

Machine Learning · Computer Science 2023-04-06 A. Ravishankar Rao , Daniel Clarke , Subrata Garai , Soumyabrata Dey

This paper introduces a novel family of outlier detection algorithms based on Cluster Catch Digraphs (CCDs), specifically tailored to address the challenges of high dimensionality and varying cluster shapes, which deteriorate the…

Machine Learning · Statistics 2024-10-10 Rui Shi , Nedret Billor , Elvan Ceyhan

Clustering, or unsupervised classification, is a task often plagued by outliers. Yet there is a paucity of work on handling outliers in clustering. Outlier identification algorithms tend to fall into three broad categories: outlier…

Methodology · Statistics 2024-05-31 Katharine M. Clark , Paul D. McNicholas

Real data often contain anomalous cases, also known as outliers. These may spoil the resulting analysis but they may also contain valuable information. In either case, the ability to detect such anomalies is essential. A useful tool for…

Machine Learning · Statistics 2021-01-13 Peter J. Rousseeuw , Mia Hubert

Outlier detection refers to the identification of rare items that are deviant from the general data distribution. Existing approaches suffer from high computational complexity, low predictive capability, and limited interpretability. As a…

Machine Learning · Statistics 2022-01-04 Zheng Li , Yue Zhao , Nicola Botta , Cezar Ionescu , Xiyang Hu

The Solar System Notification Alert Processing System (SNAPS) is a ZTF and Rubin Observatory alert broker that will send alerts to the community regarding interesting events in the Solar System. SNAPS is actively monitoring Solar System…

Earth and Planetary Astrophysics · Physics 2024-07-23 Michael Gowanlock , David E. Trilling , Daniel Kramer , Maria Chernyavskaya , Andrew McNeill

Selecting and combining the outlier scores of different base detectors used within outlier ensembles can be quite challenging in the absence of ground truth. In this paper, an unsupervised outlier detector combination framework called DCSO…

Machine Learning · Computer Science 2019-11-26 Yue Zhao , Maciej K. Hryniewicki

This paper presents a new approach for detecting outliers by introducing the notion of object's proximity. The main idea is that normal point has similar characteristics with several neighbors. So the point in not an outlier if it has a…

Computer Vision and Pattern Recognition · Computer Science 2014-11-26 Amina Dik , Khalid Jebari , Abdelaziz Bouroumi , Aziz Ettouhami

Outlier detection aims to identify unusual data instances that deviate from expected patterns. The outlier detection is particularly challenging when outliers are context dependent and when they are defined by unusual combinations of…

Artificial Intelligence · Computer Science 2015-05-18 Charmgil Hong , Milos Hauskrecht

The discovery of exoplanets has expanded our understanding of planetary systems and opened new avenues for astronomical research. In this study, we present a machine learning (ML) framework for exoplanet identification using a time-series…

Earth and Planetary Astrophysics · Physics 2025-08-14 Reihaneh Karimi , Mahdiyar Mousavi-Sadr , Mohammad H. Zhoolideh Haghighi , Fatemeh S. Tabatabaei