English
Related papers

Related papers: A Hitchhiker's Guide to Anomaly Detection with Ast…

200 papers

Environmental and instrumental conditions can cause anomalies in astronomical images, which can potentially bias all kinds of measurements if not excluded. Detection of the anomalous images is usually done by human eyes, which is slow and…

Instrumentation and Methods for Astrophysics · Physics 2023-10-25 Pedro Alonso , Jun Zhang , Xiao-Dong Li

Advances in astronomy are often driven by serendipitous discoveries. As survey astronomy continues to grow, the size and complexity of astronomical databases will increase, and the ability of astronomers to manually scour data and make such…

Instrumentation and Methods for Astrophysics · Physics 2019-01-09 Daniel Giles , Lucianne Walkowicz

Anomaly detection in supercomputers is a very difficult problem due to the big scale of the systems and the high number of components. The current state of the art for automated anomaly detection employs Machine Learning methods or…

Machine Learning · Computer Science 2020-07-30 Andrea Borghesi , Andrea Bartolini , Michele Lombardi , Michela Milano , Luca Benini

Anomalies represent rare observations (e.g., data records or events) that deviate significantly from others. Over several decades, research on anomaly mining has received increasing interests due to the implications of these occurrences in…

Machine Learning · Computer Science 2022-04-21 Xiaoxiao Ma , Jia Wu , Shan Xue , Jian Yang , Chuan Zhou , Quan Z. Sheng , Hui Xiong , Leman Akoglu

Machine learning is often viewed as a black box when it comes to understanding its output, be it a decision or a score. Automatic anomaly detection is no exception to this rule, and quite often the astronomer is left to independently…

There is a growing need for machine learning-based anomaly detection strategies to broaden the search for Beyond-the-Standard-Model (BSM) physics at the Large Hadron Collider (LHC) and elsewhere. The first step of any anomaly detection…

High Energy Physics - Phenomenology · Physics 2023-01-18 Gregor Kasieczka , Radha Mastandrea , Vinicius Mikuni , Benjamin Nachman , Mariel Pettee , David Shih

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

The increasing automation in many areas of the Industry expressly demands to design efficient machine-learning solutions for the detection of abnormal events. With the ubiquitous deployment of sensors monitoring nearly continuously the…

Anomaly detection with convolutional autoencoders is a popular method to search for new physics in a model-agnostic manner. These techniques are powerful, but they are still a "black box," since we do not know what high-level physical…

High Energy Physics - Phenomenology · Physics 2022-09-13 Layne Bradshaw , Spencer Chang , Bryan Ostdiek

Distance-based methods involve the computation of distance values between features and are a well-established paradigm in machine learning. In anomaly detection, anomalies are identified by their large distance from normal data points.…

Instrumentation and Methods for Astrophysics · Physics 2025-10-29 Siddharth Chaini , Federica B. Bianco , Ashish Mahabal

Spacecraft faces various situations when carrying out exploration missions in complex space, thus monitoring the anomaly status of spacecraft is crucial to the development of \textcolor{blue}{the} aerospace industry. The time series…

Machine Learning · Computer Science 2023-03-14 Liang Liu , Ling Tian , Zhao Kang , Tianqi Wan

We present a novel method for anomaly detection in Solar System object data, in preparation for the Legacy Survey of Space and Time. We train a deep autoencoder for anomaly detection and use the learned latent space to search for other…

Earth and Planetary Astrophysics · Physics 2024-02-22 Brian Rogers , Chris J. Lintott , Steve Croft , Megan E. Schwamb , James R. A. Davenport

The paper explores the use of various machine learning methods to search for heterogeneous or atypical structures on astronomical maps. The study was conducted on the maps of the cosmic microwave background radiation from the Planck mission…

Instrumentation and Methods for Astrophysics · Physics 2024-11-14 I. A. Karkin , A. A. Kirillov , E. P. Savelova

Automating the analysis of surveillance video footage is of great interest when urban environments or industrial sites are monitored by a large number of cameras. As anomalies are often context-specific, it is hard to predefine events of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Bo Li , Sam Leroux , Pieter Simoens

The use of AI and ML for scientific applications is currently a very exciting and dynamic field. Much of this excitement for HPC has focused on ML applications whose analysis and classification generate very large numbers of flops. Others…

Machine Learning · Computer Science 2020-09-08 Drew Schmidt , Bronson Messer , M. Todd Young , Michael Matheson

Modern astronomy relies on massive databases collected by robotic telescopes and digital sky surveys, acquiring data in a much faster pace than what manual analysis can support. Among other data, these sky surveys collect information about…

Instrumentation and Methods for Astrophysics · Physics 2018-10-29 Evan Kuminski , Lior Shamir

One of the contemporary challenges in anomaly detection is the ability to detect, and differentiate between, both point and collective anomalies within a data sequence or time series. The anomaly package has been developed to provide users…

Applications · Statistics 2024-01-30 Alex Fisch , Daniel Grose , Idris A. Eckley , Paul Fearnhead , Lawrence Bardwell

Photometric Redshift is critical for analyzing astronomical objects, but existing ML methods often overlook the aleatoric uncertainties inherent in observed data. We introduce Starkindler, a novel training objective that explicitly…

Instrumentation and Methods for Astrophysics · Physics 2025-12-30 Raahul Singh , Ashutosh Pandey

Machine Learning algorithms are good tools for both classification and prediction purposes. These algorithms can further be used for scientific discoveries from the enormous data being collected in our era. We present ways of discovering…

Instrumentation and Methods for Astrophysics · Physics 2021-02-26 Shraddha Surana , Yogesh Wadadekar , Divya Oberoi

Anomaly detection in large datasets is essential in astronomy and computer vision. However, due to a scarcity of labelled data, it is often infeasible to apply supervised methods to anomaly detection. We present AnomalyMatch, an anomaly…

Machine Learning · Computer Science 2025-10-31 Pablo Gómez , Laslo E. Ruhberg , Maria Teresa Nardone , David O'Ryan