English
Related papers

Related papers: Anomaly detection for machine learning redshifts a…

200 papers

We explore how information in images of nearby galaxies can be used to estimate their distance. We train a convolutional Neural Network (NN) to do this, using galaxy images from the Illustris simulation. We show that if the NN is trained on…

Cosmology and Nongalactic Astrophysics · Physics 2022-04-21 Kevin M. Quigley , Samuel Hori , Rupert A. C. Croft

Unsupervised anomaly detection is a challenging computer vision task, in which 2D-based anomaly detection methods have been extensively studied. However, multimodal anomaly detection based on RGB images and 3D point clouds requires further…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhongbin Sun , Xiaolong Li , Yiran Li , Yue Ma

We showcase machine learning (ML) inspired target selection algorithms to determine which of all potential targets should be selected first for spectroscopic follow up. Efficient target selection can improve the ML redshift uncertainties as…

Instrumentation and Methods for Astrophysics · Physics 2016-06-16 Ben Hoyle , Kerstin Paech , Markus Michael Rau , Stella Seitz , Jochen Weller

Anomaly detection (AD) is the machine learning task of identifying highly discrepant abnormal samples by solely relying on the consistency of the normal training samples. Under the constraints of a distribution shift, the assumption that…

Machine Learning · Computer Science 2023-12-25 João B. S. Carvalho , Mengtao Zhang , Robin Geyer , Carlos Cotrini , Joachim M. Buhmann

Anomaly detection is the task of identifying abnormal behavior of a system. Anomaly detection in computational workflows is of special interest because of its wide implications in various domains such as cybersecurity, finance, and social…

Machine Learning · Computer Science 2023-10-03 Hongwei Jin , Krishnan Raghavan , George Papadimitriou , Cong Wang , Anirban Mandal , Ewa Deelman , Prasanna Balaprakash

Time series anomaly detection is instrumental in maintaining system availability in various domains. Current work in this research line mainly focuses on learning data normality deeply and comprehensively by devising advanced neural network…

Machine Learning · Computer Science 2024-04-25 Hongzuo Xu , Yijie Wang , Songlei Jian , Qing Liao , Yongjun Wang , Guansong Pang

We propose a supervised anomaly detection method based on neural density estimators, where the negative log likelihood is used for the anomaly score. Density estimators have been widely used for unsupervised anomaly detection. By the recent…

Machine Learning · Statistics 2019-04-15 Tomoharu Iwata , Yuki Yamanaka

Anomaly detection is a challenging task that frequently arises in practically all areas of industry and science, from fraud detection and data quality monitoring to finding rare cases of diseases and searching for new physics. Most of the…

Machine Learning · Computer Science 2021-11-22 Artem Ryzhikov , Maxim Borisyak , Andrey Ustyuzhanin , Denis Derkach

Anomaly detection is to recognize samples that differ in some respect from the training observations. These samples which do not conform to the distribution of normal data are called outliers or anomalies. In real-world anomaly detection…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , Yalda Mohsenzadeh

Anomaly detection is the task of identifying rarely occurring (i.e. anormal or anomalous) samples that differ from almost all other samples in a dataset. As the patterns of anormal samples are usually not known a priori, this task is highly…

Applications · Statistics 2025-06-30 Nicolas Thewes , Philipp Steinhauer , Patrick Trampert , Markus Pauly , Georg Schneider

Anomaly detection is a critical task in industrial manufacturing, aiming to identify defective parts of products. Most industrial anomaly detection methods assume the availability of sufficient normal data for training. This assumption may…

Computer Vision and Pattern Recognition · Computer Science 2024-08-06 Zhenyu Yan , Qingqing Fang , Wenxi Lv , Qinliang Su

Visual defect assessment is a form of anomaly detection. This is very relevant in finding faults such as cracks and markings in various surface inspection tasks like pavement and automotive parts. The task involves detection of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Manpreet Singh Minhas , John Zelek

We present results of using individual galaxies' probability distribution over redshift as a method of identifying potential catastrophic outliers in empirical photometric redshift estimation. In the course of developing this approach we…

Astrophysics of Galaxies · Physics 2021-03-04 M. Wyatt , J. Singal

We present results of using a basic binary classification neural network model to identify likely catastrophic outlier photometric redshift estimates of individual galaxies, based only on the galaxies' measured photometric band magnitude…

Cosmology and Nongalactic Astrophysics · Physics 2022-03-30 J. Singal , G. Silverman , E. Jones , T. Do , B. Boscoe , Y. Wan

Medical imaging data suffers from the limited availability of annotation because annotating 3D medical data is a time-consuming and expensive task. Moreover, even if the annotation is available, supervised learning-based approaches suffer…

Image and Video Processing · Electrical Eng. & Systems 2020-11-12 Abinav Ravi Venkatakrishnan , Seong Tae Kim , Rami Eisawy , Franz Pfister , Nassir Navab

We present a new machine learning model for estimating photometric redshifts with improved accuracy for galaxies in Pan-STARRS1 data release 1. Depending on the estimation range of redshifts, this model based on neural networks can handle…

Instrumentation and Methods for Astrophysics · Physics 2021-12-09 Joongoo Lee , Min-Su Shin

Anomalies represent deviations from the intended system operation and can lead to decreased efficiency as well as partial or complete system failure. As the causes of anomalies are often unknown due to complex system dynamics, efficient…

Machine Learning · Computer Science 2021-08-31 Benjamin Lindemann , Benjamin Maschler , Nada Sahlab , Michael Weyrich

Deep Learning (DL) is vulnerable to out-of-distribution and adversarial examples resulting in incorrect outputs. To make DL more robust, several posthoc (or runtime) anomaly detection techniques to detect (and discard) these anomalous…

Machine Learning · Computer Science 2021-02-23 Saikiran Bulusu , Bhavya Kailkhura , Bo Li , Pramod K. Varshney , Dawn Song

Quickly growing computing facilities and an increasing number of extragalactic observations encourage the application of data-driven approaches to uncover hidden relations from astronomical data. In this work we raise the problem of…

Cosmology and Nongalactic Astrophysics · Physics 2020-03-25 A. Elyiv , O. Melnyk , I. Vavilova , D. Dobrycheva , V. Karachentseva

Unsupervised learning of anomaly detection in high-dimensional data, such as images, is a challenging problem recently subject to intense research. Through careful modelling of the data distribution of normal samples, it is possible to…

Computer Vision and Pattern Recognition · Computer Science 2019-11-21 Amanda Berg , Jörgen Ahlberg , Michael Felsberg