English
Related papers

Related papers: Density Based Outlier Scoring on Kepler Data

200 papers

High-dimensional data poses unique challenges in outlier detection process. Most of the existing algorithms fail to properly address the issues stemming from a large number of features. In particular, outlier detection algorithms perform…

Machine Learning · Computer Science 2020-09-22 Firuz Kamalov , Ho Hon Leung

Advances in astronomy are often driven by serendipitous discoveries. As survey astronomy continues to grow, the size and complexity of astronomical databases will increase, and the ability of astronomers to manually scour data and make such…

Instrumentation and Methods for Astrophysics · Physics 2019-01-09 Daniel Giles , Lucianne Walkowicz

Among the many challenges posed by the huge data volumes produced by the new generation of astronomical instruments there is also the search for rare and peculiar objects. Unsupervised outlier detection algorithms may provide a viable…

Instrumentation and Methods for Astrophysics · Physics 2021-05-12 Lars Doorenbos , Stefano Cavuoti , Massimo Brescia , Antonio D'Isanto , Giuseppe Longo

Outliers are the points which are different from or inconsistent with the rest of the data. They can be novel, new, abnormal, unusual or noisy information. Outliers are sometimes more interesting than the majority of the data. The main…

Computer Vision and Pattern Recognition · Computer Science 2014-06-20 Singh Vijendra , Pathak Shivani

The development of synoptic sky surveys has led to a massive amount of data for which resources needed for analysis are beyond human capabilities. To process this information and to extract all possible knowledge, machine learning…

Computational Engineering, Finance, and Science · Computer Science 2015-05-29 Isadora Nun , Karim Pichara , Pavlos Protopapas , Dae-Won Kim

This paper presents a simple but effective density-based outlier detection approach with the local kernel density estimation (KDE). A Relative Density-based Outlier Score (RDOS) is introduced to measure the local outlierness of objects, in…

Artificial Intelligence · Computer Science 2016-06-29 Bo Tang , Haibo He

Outlier detection is an essential capability in safety-critical applications of supervised visual recognition. Most of the existing methods deliver best results by encouraging standard closed-set models to produce low-confidence predictions…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Anja Delić , Matej Grcić , Siniša Šegvić

Outlier detection has gained increasing interest in recent years, due to newly emerging technologies and the huge amount of high-dimensional data that are now available. Outlier detection can help practitioners to identify unwanted noise…

Statistics Theory · Mathematics 2021-05-20 Mads Lindskou , Torben Tvedebrink , Poul Svante Eriksen , Niels Morling

When applying outlier detection in settings where data is sensitive, mechanisms which guarantee the privacy of the underlying data are needed. The $k$-nearest neighbors ($k$-NN) algorithm is a simple and one of the most effective methods…

Machine Learning · Computer Science 2021-04-19 Jens Rauch , Iyiola E. Olatunji , Megha Khosla

Finding rare information hidden in a huge amount of data from the Internet is a necessary but complex issue. Many researchers have studied this issue and have found effective methods to detect anomaly data in low dimensional space. However,…

Artificial Intelligence · Computer Science 2014-05-07 Zhana Bao

We present a methodology to discover outliers in catalogs of periodic light-curves. We use cross-correlation as measure of ``similarity'' between two individual light-curves and then classify light-curves with lowest average ``similarity''…

Astrophysics · Physics 2009-11-11 P. Protopapas , J. M. Giammarco , L. Faccioli , M. F. Struble , R. Dave , C. Alcock

We propose a new method to define anomaly scores and apply this to particle physics collider events. Anomalies can be either rare, meaning that these events are a minority in the normal dataset, or different, meaning they have values that…

High Energy Physics - Phenomenology · Physics 2022-03-09 Sascha Caron , Luc Hendriks , Rob Verheyen

The Dark Energy Survey is able to collect image data of an extremely large number of extragalactic objects, and it can be reasonably assumed that many unusual objects of high scientific interest are hidden inside these data. Due to the…

Astrophysics of Galaxies · Physics 2023-05-04 Lior Shamir

Outlier detection refers to the identification of rare items that are deviant from the general data distribution. Existing approaches suffer from high computational complexity, low predictive capability, and limited interpretability. As a…

Machine Learning · Statistics 2022-01-04 Zheng Li , Yue Zhao , Nicola Botta , Cezar Ionescu , Xiyang Hu

How can we discover objects we did not know existed within the large datasets that now abound in astronomy? We present an outlier detection algorithm that we developed, based on an unsupervised Random Forest. We test the algorithm on more…

Astrophysics of Galaxies · Physics 2017-01-11 Dalya Baron , Dovi Poznanski

Outlier recognition is a fundamental problem in data analysis and has attracted a great deal of attention in the past decades. However, most existing methods still suffer from several issues such as high time and space complexities or…

Computational Geometry · Computer Science 2019-04-09 Hu Ding , Mingquan Ye

Often the challenge associated with tasks like fraud and spam detection[1] is the lack of all likely patterns needed to train suitable supervised learning models. In order to overcome this limitation, such tasks are attempted as outlier or…

Machine Learning · Computer Science 2018-08-22 Utkarsh Porwal , Smruthi Mukund

The ability to collect and store ever more massive databases has been accompanied by the need to process them efficiently. In many cases, most observations have the same behavior, while a probable small proportion of these observations are…

Statistics Theory · Mathematics 2021-09-21 Myrto Limnios , Nathan Noiry , Stéphan Clémençon

Machine learning techniques can automatically identify outliers in massive datasets, much faster and more reproducible than human inspection ever could. But finding such outliers immediately leads to the question: which features render this…

Machine Learning · Computer Science 2023-11-01 Jeff Shen , Peter Melchior

The neighbor-based method has become a powerful tool to handle the outlier detection problem, which aims to infer the abnormal degree of the sample based on the compactness of the sample and its neighbors. However, the existing methods…

Machine Learning · Computer Science 2024-05-30 Zhuang Qi , Junlin Zhang , Xiaming Chen , Xin Qi
‹ Prev 1 2 3 10 Next ›