English
Related papers

Related papers: Backpropagated Gradient Representations for Anomal…

200 papers

Anomaly detection is to identify samples that do not conform to the distribution of the normal data. Due to the unavailability of anomalous data, training a supervised deep neural network is a cumbersome task. As such, unsupervised methods…

Computer Vision and Pattern Recognition · Computer Science 2022-07-05 Vahid Reza Khazaie , Anthony Wong , John Taylor Jewell , Yalda Mohsenzadeh

Deep neural networks (DNNs) are vulnerable to adversarial examples and other data perturbations. Especially in safety critical applications of DNNs, it is therefore crucial to detect misclassified samples. The current state-of-the-art…

Machine Learning · Computer Science 2020-04-21 Julia Lust , Alexandru Paul Condurache

Anomaly detection using a network-based approach is one of the most efficient ways to identify abnormal events such as fraud, security breaches, and system faults in a variety of applied domains. While most of the earlier works address the…

Artificial Intelligence · Computer Science 2025-01-22 Hossein Rafieizadeh , Hadi Zare , Mohsen Ghassemi Parsa , Hadi Davardoust , Meshkat Shariat Bagheri

Neural networks are trained primarily based on their inputs and outputs, without regard for their internal mechanisms. These neglected mechanisms determine properties that are critical for safety, like (i) transparency; (ii) the absence of…

Machine Learning · Computer Science 2024-12-02 Alex Cloud , Jacob Goldman-Wetzler , Evžen Wybitul , Joseph Miller , Alexander Matt Turner

The detection of anomalies is essential mining task for the security and reliability in computer systems. Logs are a common and major data source for anomaly detection methods in almost every computer system. They collect a range of…

Machine Learning · Computer Science 2020-08-24 Sasho Nedelkoski , Jasmin Bogatinovski , Alexander Acker , Jorge Cardoso , Odej Kao

Forward Gradients - the idea of using directional derivatives in forward differentiation mode - have recently been shown to be utilizable for neural network training while avoiding problems generally associated with backpropagation gradient…

Machine Learning · Computer Science 2023-06-13 Louis Fournier , Stéphane Rivaud , Eugene Belilovsky , Michael Eickenberg , Edouard Oyallon

Obtaining models that capture imaging markers relevant for disease progression and treatment monitoring is challenging. Models are typically based on large amounts of data with annotated examples of known markers aiming at automating…

Computer Vision and Pattern Recognition · Computer Science 2017-03-20 Thomas Schlegl , Philipp Seeböck , Sebastian M. Waldstein , Ursula Schmidt-Erfurth , Georg Langs

One critical challenge in deploying highly performant machine learning models in real-life applications is out of distribution (OOD) detection. Given a predictive model which is accurate on in distribution (ID) data, an OOD detection system…

Machine Learning · Computer Science 2022-05-24 Conor Igoe , Youngseog Chung , Ian Char , Jeff Schneider

Backpropagation is the default learning rule for artificial neural networks and is often treated as the settled approach whenever differentiability is available. In this work, we revisit this convention through a theoretical lens of sample…

Machine Learning · Statistics 2026-05-28 Yibo Jacky Zhang , Zeyu Tang , Sanmi Koyejo

Anomaly detection is fundamental yet, challenging problem with practical applications in industry. The current approaches neglect the higher-order dependencies within the networks of interconnected sensors in the high-dimensional time…

Machine Learning · Computer Science 2024-08-22 Sakhinana Sagar Srinivas , Rajat Kumar Sarkar , Venkataramana Runkana

We address the challenging problem of deep representation learning--the efficient adaption of a pre-trained deep network to different tasks. Specifically, we propose to explore gradient-based features. These features are gradients of the…

Machine Learning · Computer Science 2020-04-14 Fangzhou Mu , Yingyu Liang , Yin Li

We propose a one-class neural network (OC-NN) model to detect anomalies in complex data sets. OC-NN combines the ability of deep networks to extract a progressively rich representation of data with the one-class objective of creating a…

Machine Learning · Computer Science 2019-01-14 Raghavendra Chalapathy , Aditya Krishna Menon , Sanjay Chawla

This work proposes an algorithm for taking advantage of backpropagation gradients to determine feature importance at different stages of training. Additionally, we propose a way to represent the learning process qualitatively. Experiments…

Machine Learning · Computer Science 2020-12-08 Roberto Reyes-Ochoa , Servando Lopez-Aguayo

Nowadays, graph-structured data are increasingly used to model complex systems. Meanwhile, detecting anomalies from graph has become a vital research problem of pressing societal concerns. Anomaly detection is an unsupervised learning task…

Machine Learning · Computer Science 2021-03-29 Xuhong Wang , Baihong Jin , Ying Du , Ping Cui , Yupu Yang

Graph anomaly detection in this paper aims to distinguish abnormal nodes that behave differently from the benign ones accounting for the majority of graph-structured instances. Receiving increasing attention from both academia and industry,…

Machine Learning · Computer Science 2022-10-19 Fanzhen Liu , Xiaoxiao Ma , Jia Wu , Jian Yang , Shan Xue , Amin Beheshti , Chuan Zhou , Hao Peng , Quan Z. Sheng , Charu C. Aggarwal

The complexity of modern electro-mechanical systems require the development of sophisticated diagnostic methods like anomaly detection capable of detecting deviations. Conventional anomaly detection approaches like signal processing and…

Machine Learning · Computer Science 2025-01-07 Abhishek Srinivasan , Varun Singapuri Ravi , Juan Carlos Andresen , Anders Holst

As a kind of generative self-supervised learning methods, generative adversarial nets have been widely studied in the field of anomaly detection. However, the representation learning ability of the generator is limited since it pays too…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Xuan Xia , Xizhou Pan , Xing He , Jingfei Zhang , Ning Ding , Lin Ma

In this paper we address the abnormality detection problem in crowded scenes. We propose to use Generative Adversarial Nets (GANs), which are trained using normal frames and corresponding optical-flow images in order to learn an internal…

Computer Vision and Pattern Recognition · Computer Science 2017-09-01 Mahdyar Ravanbakhsh , Moin Nabi , Enver Sangineto , Lucio Marcenaro , Carlo Regazzoni , Nicu Sebe

Anomaly detection - identifying deviations from Standard Model predictions - is a key challenge at the Large Hadron Collider due to the size and complexity of its datasets. This is typically addressed by transforming high-dimensional…

High Energy Physics - Experiment · Physics 2025-12-03 Kyle Metzger , Lana Xu , Mia Sodini , Thea K. Arrestad , Katya Govorkova , Gaia Grosso , Philip Harris

With the rise of generative models, there is a growing interest in unifying all tasks within a generative framework. Anomaly detection methods also fall into this scope and utilize diffusion models to generate or reconstruct normal samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xiaofan Li , Xin Tan , Zhuo Chen , Zhizhong Zhang , Ruixin Zhang , Rizen Guo , Guannan Jiang , Yulong Chen , Yanyun Qu , Lizhuang Ma , Yuan Xie