English
Related papers

Related papers: A Hitchhiker's Guide to Anomaly Detection with Ast…

200 papers

Modern machine learning tools offer exciting possibilities to qualitatively change the paradigm for new particle searches. In particular, new methods can broaden the search program by gaining sensitivity to unforeseen scenarios by learning…

High Energy Physics - Phenomenology · Physics 2020-10-29 Benjamin Nachman

With the increasing volume of astronomical data generated by modern survey telescopes, automated pipelines and machine learning techniques have become crucial for analyzing and extracting knowledge from these datasets. Anomaly detection,…

Automated detection of abnormalities in data has been studied in research area in recent years because of its diverse applications in practice including video surveillance, industrial damage detection and network intrusion detection.…

Computer Vision and Pattern Recognition · Computer Science 2017-08-18 Hung Vu , Dinh Phung , Tu Dinh Nguyen , Anthony Trevors , Svetha Venkatesh

Supernovae mark the explosive deaths of stars and enrich the cosmos with heavy elements. Future telescopes will discover thousands of new supernovae nightly, creating a need to flag astrophysically interesting events rapidly for followup…

Instrumentation and Methods for Astrophysics · Physics 2020-10-23 V. Ashley Villar , Miles Cranmer , Gabriella Contardo , Shirley Ho , Joshua Yao-Yu Lin

In the fields of statistics and unsupervised machine learning a fundamental and well-studied problem is anomaly detection. Anomalies are difficult to define, yet many algorithms have been proposed. Underlying the approaches is the nebulous…

Cryptography and Security · Computer Science 2022-05-16 Nassir Mohammad

We review the current state of data mining and machine learning in astronomy. 'Data Mining' can have a somewhat mixed connotation from the point of view of a researcher in this field. If used correctly, it can be a powerful approach,…

Instrumentation and Methods for Astrophysics · Physics 2010-08-11 Nicholas M. Ball , Robert J. Brunner

Anomaly detection is the process of identifying abnormal instances or events in data sets which deviate from the norm significantly. In this study, we propose a signatures based machine learning algorithm to detect rare or unexpected items…

Computational Finance · Quantitative Finance 2022-02-09 Erdinc Akyildirim , Matteo Gambara , Josef Teichmann , Syang Zhou

In programming education, teachers need to monitor and assess the progress of their students by investigating the code they write. Code quality of programs written in traditional programming languages can be automatically assessed with…

Software Engineering · Computer Science 2021-02-16 Nina Körber , Katharina Geldreich , Andreas Stahlbauer , Gordon Fraser

With the volume and availability of astronomical data growing rapidly, astronomers will soon rely on the use of machine learning algorithms in their daily work. This proceeding aims to give an overview of what machine learning is and delve…

Instrumentation and Methods for Astrophysics · Physics 2025-08-06 Sara A. Webb , Simon R. Goode

In the research area of anomaly detection, novel and promising methods are frequently developed. However, most existing studies exclusively focus on the detection task only and ignore the interpretability of the underlying models as well as…

Machine Learning · Computer Science 2023-01-16 Cheng Feng , Pingge Hu

Anomaly detection seeks to identify unusual phenomena, a central task in science and industry. The task is inherently unsupervised as anomalies are unexpected and unknown during training. Recent advances in self-supervised representation…

Machine Learning · Computer Science 2022-10-20 Tal Reiss , Niv Cohen , Eliahu Horwitz , Ron Abutbul , Yedid Hoshen

The detection of anomalies in time series data is a critical task with many monitoring applications. Existing systems often fail to encompass an end-to-end detection process, to facilitate comparative analysis of various anomaly detection…

Machine Learning · Computer Science 2022-04-21 Sarah Alnegheimish , Dongyu Liu , Carles Sala , Laure Berti-Equille , Kalyan Veeramachaneni

In many real-world AD applications including computer security and fraud prevention, the anomaly detector must be configurable by the human analyst to minimize the effort on false positives. One important way to configure the detector is by…

Machine Learning · Computer Science 2024-05-15 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

AstronomicAL is a human-in-the-loop interactive labelling and training dashboard that allows users to create reliable datasets and robust classifiers using active learning. This technique prioritises data that offer high information gain,…

Instrumentation and Methods for Astrophysics · Physics 2021-09-14 Grant Stevens , Sotiria Fotopoulou , Malcolm N. Bremer , Oliver Ray

We present a new algorithm for anomaly detection called Anomaly Awareness. The algorithm learns about normal events while being made aware of the anomalies through a modification of the cost function. We show how this method works in…

Machine Learning · Computer Science 2023-08-02 Charanjit K. Khosa , Veronica Sanz

Anomaly detection is the problem of recognizing abnormal inputs based on the seen examples of normal data. Despite recent advances of deep learning in recognizing image anomalies, these methods still prove incapable of handling complex…

Computer Vision and Pattern Recognition · Computer Science 2021-09-14 Nina Shvetsova , Bart Bakker , Irina Fedulova , Heinrich Schulz , Dmitry V. Dylov

Anomaly detection is a longstanding and active research area that has many applications in domains such as finance, security, and manufacturing. However, the efficiency and performance of anomaly detection algorithms are challenged by the…

Machine Learning · Computer Science 2025-04-16 Yang Cao , Haolong Xiang , Hang Zhang , Ye Zhu , Kai Ming Ting

Despite inherent ill-definition, anomaly detection is a research endeavor of great interest within machine learning and visual scene understanding alike. Most commonly, anomaly detection is considered as the detection of outliers within a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Samet Akçay , Amir Atapour-Abarghouei , Toby P. Breckon

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

Anomaly detection in spatiotemporal data is a challenging problem encountered in a variety of applications, including video surveillance, medical imaging data, and urban traffic monitoring. Existing anomaly detection methods focus mainly on…

Machine Learning · Computer Science 2025-10-02 Rachita Mondal , Mert Indibi , Tapabrata Maiti , Selin Aviyente