English
Related papers

Related papers: Systematic Serendipity: A Test of Unsupervised Mac…

200 papers

The next generation of telescopes such as the SKA and the Rubin Observatory will produce enormous data sets, requiring automated anomaly detection to enable scientific discovery. Here, we present an overview and friendly user guide to the…

Instrumentation and Methods for Astrophysics · Physics 2022-01-26 Michelle Lochner , Bruce A. Bassett

We present the first evidence that adaptive learning techniques can boost the discovery of unusual objects within astronomical light curve data sets. Our method follows an active learning strategy where the learning algorithm chooses…

Much hope for finding new physics phenomena at microscopic scale relies on the observations obtained from High Energy Physics experiments, like the ones performed at the Large Hadron Collider (LHC). However, current experiments do not…

We present a new algorithm for anomaly detection called Anomaly Awareness. The algorithm learns about normal events while being made aware of the anomalies through a modification of the cost function. We show how this method works in…

Machine Learning · Computer Science 2023-08-02 Charanjit K. Khosa , Veronica Sanz

Anomalies are samples that significantly deviate from the rest of the data and their detection plays a major role in building machine learning models that can be reliably used in applications such as data-driven design and novelty…

Machine Learning · Statistics 2023-06-19 Amin Yousefpour , Mehdi Shishehbor , Zahra Zanjani Foumani , Ramin Bostanabad

How can we discover objects we did not know existed within the large datasets that now abound in astronomy? We present an outlier detection algorithm that we developed, based on an unsupervised Random Forest. We test the algorithm on more…

Astrophysics of Galaxies · Physics 2017-01-11 Dalya Baron , Dovi Poznanski

Owing to the remarkable photometric precision of space observatories like Kepler, stellar and planetary systems beyond our own are now being characterized en masse for the first time. These characterizations are pivotal for endeavors such…

Solar and Stellar Astrophysics · Physics 2017-04-03 Earl P. Bellinger , George C. Angelou , Saskia Hekker , Sarbani Basu , Warrick Ball , Elisabeth Guggenberger

Anomaly detection methods used in a recent search for new phenomena by CMS at the CERN LHC are presented. The methods use machine learning to detect anomalous jets produced in the decay of new massive particles. The effectiveness of these…

High Energy Physics - Experiment · Physics 2025-12-24 CMS Collaboration

Anomaly detection is being regarded as an unsupervised learning task as anomalies stem from adversarial or unlikely events with unknown distributions. However, the predictive performance of purely unsupervised anomaly detection often fails…

Machine Learning · Computer Science 2014-01-27 Nico Goernitz , Marius Micha Kloft , Konrad Rieck , Ulf Brefeld

Modern machine learning tools offer exciting possibilities to qualitatively change the paradigm for new particle searches. In particular, new methods can broaden the search program by gaining sensitivity to unforeseen scenarios by learning…

High Energy Physics - Phenomenology · Physics 2020-10-29 Benjamin Nachman

The discovery of exoplanets has expanded our understanding of planetary systems and opened new avenues for astronomical research. In this study, we present a machine learning (ML) framework for exoplanet identification using a time-series…

Earth and Planetary Astrophysics · Physics 2025-08-14 Reihaneh Karimi , Mahdiyar Mousavi-Sadr , Mohammad H. Zhoolideh Haghighi , Fatemeh S. Tabatabaei

We investigate unsupervised anomaly detection for high-dimensional data and introduce a deep metric learning (DML) based framework. In particular, we learn a distance metric through a deep neural network. Through this metric, we project the…

Machine Learning · Computer Science 2020-05-13 Selim F. Yilmaz , Suleyman S. Kozat

With the upcoming plethora of astronomical time-domain datasets and surveys, anomaly detection as a way to discover new types of variable stars and transients has inspired a new wave of research. Yet, the fundamental definition of what…

Solar and Stellar Astrophysics · Physics 2023-01-26 Dennis A. Crake , Juan Rafael Martínez-Galarza

In the fields of statistics and unsupervised machine learning a fundamental and well-studied problem is anomaly detection. Anomalies are difficult to define, yet many algorithms have been proposed. Underlying the approaches is the nebulous…

Cryptography and Security · Computer Science 2022-05-16 Nassir Mohammad

Methods for unsupervised anomaly detection suffer from the fact that the data is unlabeled, making it difficult to assess the optimality of detection algorithms. Ensemble learning has shown exceptional results in classification and…

Machine Learning · Statistics 2016-10-26 Edward Yu , Parth Parekh

Anomaly detection is the process of finding data points that deviate from a baseline. In a real-life setting, anomalies are usually unknown or extremely rare. Moreover, the detection must be accomplished in a timely manner or the risk of…

Machine Learning · Computer Science 2019-04-26 Mariem Ben Fadhel , Kofi Nyarko

We apply several machine learning algorithms to the problem of anomaly detection in operational data for large-scale, high-voltage electric power grids. We observe important differences in the performance of the algorithms. Neural networks…

Systems and Control · Electrical Eng. & Systems 2026-02-12 Marc Gillioz , Guillaume Dubuis , Étienne Voutaz , Philippe Jacquod

There is a growing need for machine learning-based anomaly detection strategies to broaden the search for Beyond-the-Standard-Model (BSM) physics at the Large Hadron Collider (LHC) and elsewhere. The first step of any anomaly detection…

High Energy Physics - Phenomenology · Physics 2023-01-18 Gregor Kasieczka , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , Mariel Pettee , David Shih

Detecting anomalies in time series data is important in a variety of fields, including system monitoring, healthcare, and cybersecurity. While the abundance of available methods makes it difficult to choose the most appropriate method for a…

Machine Learning · Computer Science 2023-02-03 Ferdinand Rewicki , Joachim Denzler , Julia Niebling

This review summarizes popular unsupervised learning methods, and gives an overview of their past, current, and future uses in astronomy. Unsupervised learning aims to organise the information content of a dataset, in such a way that…

Instrumentation and Methods for Astrophysics · Physics 2024-06-26 Sotiria Fotopoulou