English
Related papers

Related papers: A Deep Learning Approach for Active Anomaly Detect…

200 papers

The impending era of wide-field radio surveys has the potential to revolutionize our understanding of astrophysical transients. Here we evaluate the prospects of a wide range of planned and hypothetical radio surveys using the properties…

High Energy Astrophysical Phenomena · Physics 2015-02-06 Brian D. Metzger , Peter K. G. Williams , Edo Berger

We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. This is a common scenario in many important applications. Existing related methods either exclusively…

Machine Learning · Computer Science 2021-06-11 Guansong Pang , Anton van den Hengel , Chunhua Shen , Longbing Cao

In critical applications of anomaly detection including computer security and fraud prevention, the anomaly detector must be configurable by the analyst to minimize the effort on false positives. One important way to configure the anomaly…

Machine Learning · Computer Science 2018-09-19 Shubhomoy Das , Md Rakibul Islam , Nitthilan Kannappan Jayakodi , Janardhan Rao Doppa

Anomaly detection is an important problem in many application areas, such as network security. Many deep learning methods for unsupervised anomaly detection produce good empirical performance but lack theoretical guarantees. By casting…

Machine Learning · Statistics 2024-09-16 Tian-Yi Zhou , Matthew Lau , Jizhou Chen , Wenke Lee , Xiaoming Huo

Digitalization leads to data transparency for production systems that we can benefit from with data-driven analysis methods like neural networks. For example, automated anomaly detection enables saving resources and optimizing the…

Machine Learning · Computer Science 2021-06-23 Tom Hammerbacher , Markus Lange-Hegermann , Gorden Platz

Anomaly detection is the task of recognising novel samples which deviate significantly from pre-establishednormality. Abnormal classes are not present during training meaning that models must learn effective rep-resentations solely across…

Machine Learning · Computer Science 2023-03-08 Jack W Barker , Neelanjan Bhowmik , Yona Falinie A Gaus , Toby P Breckon

An anomaly detection method based on deep autoencoders is proposed to address anomalies that often occur in enterprise-level ETL data streams. The study first analyzes multiple types of anomalies in ETL processes, including delays, missing…

Machine Learning · Computer Science 2025-11-04 Xin Chen , Saili Uday Gadgil , Kangning Gao , Yi Hu , Cong Nie

Our understanding of the Universe has profited from deliberate, targeted studies of known phenomena, as well as from serendipitous, unexpected discoveries, such as the discovery of a complex variability pattern in the direction of KIC…

Neural networks follow a gradient-based learning scheme, adapting their mapping parameters by back-propagating the output loss. Samples unlike the ones seen during training cause a different gradient distribution. Based on this intuition,…

Machine Learning · Computer Science 2023-04-25 Jan-Philipp Schulze , Philip Sperl , Ana Răduţoiu , Carla Sagebiel , Konstantin Böttinger

A web-based tool called ADFilter was developed to process collision events using autoencoders based on a deep unsupervised neural network. The autoencoders are trained on a small fraction of either collision data or Standard Model Monte…

High Energy Physics - Phenomenology · Physics 2025-03-26 Sergei V. Chekanov , Wasikul Islam , Rui Zhang , Nicholas Luongo

We describe an iterative active-learning algorithm to recognise rare traffic signs. A standard ResNet is trained on a training set containing only a single sample of the rare class. We demonstrate that by sorting the samples of a large,…

Machine Learning · Computer Science 2022-11-29 S. Jaghouar , H. Gustafsson , B. Mehlig , E. Werner , N. Gustafsson

Ongoing large-scale optical time-domain surveys, such as the Zwicky Transient Facility (ZTF), are producing alerts at unprecedented rates. Analysis of transient sources has so far followed two distinct paths: archival analysis of data on…

In anomaly detection, a prominent task is to induce a model to identify anomalies learned solely based on normal data. Generally, one is interested in finding an anomaly detector that correctly identifies anomalies, i.e., data points that…

Machine Learning · Computer Science 2022-11-28 David Schubert , Pritha Gupta , Marcel Wever

The tens of millions of spectra being captured by the Dark Energy Spectroscopic Instrument (DESI) provide tremendous discovery potential. In this work we show how Machine Learning, in particular Variational Autoencoders (VAE), can detect…

Gravitationally lensed supernovae (SNe) are extremely rare and fade quickly; as a result, they are challenging to detect. To identify lensed SNe in large imaging datasets, current surveys primarily rely on the {\it magnification} effect of…

Instrumentation and Methods for Astrophysics · Physics 2025-12-24 Fawad Kirmani , Arjun Karki , Steve Rodney , Kyle Lackey , Varsha P. Kulkarni , John R. Rose , Justin Pierel

The detection of exoplanets with the radial velocity method consists in detecting variations of the stellar velocity caused by an unseen sub-stellar companion. Instrumental errors, irregular time sampling, and different noise sources…

Earth and Planetary Astrophysics · Physics 2023-09-06 L. A. Nieto , R. F. Díaz

Astrophysical observations taken from Earth are subject to weather, environmental, and scientific constraints that lead to sparse, irregular light curves. On the eve of the Vera C. Rubin Observatory Legacy Survey of Space and Time, its…

Instrumentation and Methods for Astrophysics · Physics 2026-05-28 Siddharth Chaini , Federica B. Bianco , Ashish Mahabal

Deep learning-based approaches have achieved significant improvements on public video anomaly datasets, but often do not perform well in real-world applications. This paper addresses two issues: the lack of labeled data and the difficulty…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Giacomo D'Amicantonio , Egor Bondarau , Peter H. N. de With

This paper addresses the problem of joint detection and recounting of abnormal events in videos. Recounting of abnormal events, i.e., explaining why they are judged to be abnormal, is an unexplored but critical task in video surveillance,…

Computer Vision and Pattern Recognition · Computer Science 2017-09-27 Ryota Hinami , Tao Mei , Shin'ichi Satoh

Anomaly detection algorithms are often thought to be limited because they don't facilitate the process of validating results performed by domain experts. In Contrast, deep learning algorithms for anomaly detection, such as autoencoders,…

Machine Learning · Computer Science 2020-07-02 Liat Antwarg , Ronnie Mindlin Miller , Bracha Shapira , Lior Rokach