English
Related papers

Related papers: Anomalies, Representations, and Self-Supervision

200 papers

One-class classification has been a prevailing method in building deep anomaly detection models under the assumption that a dataset consisting of normal samples is available. In practice, however, abnormal samples are often mixed in a…

Machine Learning · Computer Science 2023-02-14 Minkyung Kim , Junsik Kim , Jongmin Yu , Jun Kyun Choi

Anomalies are samples that significantly deviate from the rest of the data and their detection plays a major role in building machine learning models that can be reliably used in applications such as data-driven design and novelty…

Machine Learning · Statistics 2023-06-19 Amin Yousefpour , Mehdi Shishehbor , Zahra Zanjani Foumani , Ramin Bostanabad

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung

A new Lossy Causal Temporal Convolutional Neural Network Autoencoder for anomaly detection is proposed in this work. Our framework uses a rate-distortion loss and an entropy bottleneck to learn a compressed latent representation for the…

Machine Learning · Computer Science 2022-12-06 Christopher P. Ley , Jorge F. Silva

Anomaly detection seeks to identify unusual phenomena, a central task in science and industry. The task is inherently unsupervised as anomalies are unexpected and unknown during training. Recent advances in self-supervised representation…

Machine Learning · Computer Science 2022-10-20 Tal Reiss , Niv Cohen , Eliahu Horwitz , Ron Abutbul , Yedid Hoshen

Unsupervised anomaly detection aims to build models to effectively detect unseen anomalies by only training on the normal data. Although previous reconstruction-based methods have made fruitful progress, their generalization ability is…

Machine Learning · Computer Science 2022-01-04 Yuxin Zhang , Jindong Wang , Yiqiang Chen , Han Yu , Tao Qin

There is a growing need for anomaly detection methods that can broaden the search for new particles in a model-agnostic manner. Most proposals for new methods focus exclusively on signal sensitivity. However, it is not enough to select…

Machine Learning · Computer Science 2022-10-21 Vinicius Mikuni , Benjamin Nachman , David Shih

We investigate a method of model-agnostic anomaly detection through studying jets, collimated sprays of particles produced in high-energy collisions. We train a transformer neural network to encode simulated QCD "event space" dijets into a…

High Energy Physics - Phenomenology · Physics 2023-05-17 Barry M. Dillon , Radha Mastandrea , Benjamin Nachman

Semi-supervised anomaly detection for sensor signals is critical in ensuring system reliability in smart manufacturing. However, existing methods rely heavily on data correlation, neglecting causality and leading to potential…

Machine Learning · Computer Science 2024-05-17 Xiangwei Chen , Ruliang Xiaoa , Zhixia Zeng , Zhipeng Qiu , Shi Zhang , Xin Du

In this study, we present a simple multi-channel framework for contrastive learning (MC-SimCLR) to encode 'what' and 'where' of spatial audios. MC-SimCLR learns joint spectral and spatial representations from unlabeled spatial audios,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Xilin Jiang , Cong Han , Yinghao Aaron Li , Nima Mesgarani

This paper addresses the increasingly prominent problem of anomaly detection in distributed systems. It proposes a detection method based on federated contrastive learning. The goal is to overcome the limitations of traditional centralized…

Machine Learning · Computer Science 2025-06-25 Renzi Meng , Heyi Wang , Yumeng Sun , Qiyuan Wu , Lian Lian , Renhan Zhang

Contrastive learning (CL) methods effectively learn data representations in a self-supervision manner, where the encoder contrasts each positive sample over multiple negative samples via a one-vs-many softmax cross-entropy loss. By…

Machine Learning · Computer Science 2023-08-16 Huangjie Zheng , Xu Chen , Jiangchao Yao , Hongxia Yang , Chunyuan Li , Ya Zhang , Hao Zhang , Ivor Tsang , Jingren Zhou , Mingyuan Zhou

Current deep learning methods for anomaly detection in text rely on supervisory signals in inliers that may be unobtainable or bespoke architectures that are difficult to tune. We study a simpler alternative: fine-tuning Transformers on the…

Computation and Language · Computer Science 2022-04-13 Kimberly T. Mai , Toby Davies , Lewis D. Griffin

Deep anomaly detection methods have become increasingly popular in recent years, with methods like Stacked Autoencoders, Variational Autoencoders, and Generative Adversarial Networks greatly improving the state-of-the-art. Other methods…

Computation and Language · Computer Science 2024-01-09 Andrei Manolache

Anomaly detection is referred to as a process in which the aim is to detect data points that follow a different pattern from the majority of data points. Anomaly detection methods suffer from several well-known challenges that hinder their…

Machine Learning · Computer Science 2021-08-31 Kasra Babaei , Zhi Yuan Chen , Tomas Maul

Unsupervised anomaly detection is a daunting task, as it relies solely on normality patterns from the training data to identify unseen anomalies during testing. Recent approaches have focused on leveraging domain-specific transformations or…

Machine Learning · Computer Science 2024-09-17 Hyuntae Kim , Changhee Lee

We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. This is a common scenario in many important applications. Existing related methods either exclusively…

Machine Learning · Computer Science 2021-06-11 Guansong Pang , Anton van den Hengel , Chunhua Shen , Longbing Cao

High-dimensional feature spaces in particle physics events pose a fundamental challenge to density-estimation-based weakly supervised anomaly detection, whose fidelity degrades rapidly with an increasing number of dimensions. We propose a…

High Energy Physics - Phenomenology · Physics 2026-03-30 Runze Li , Benjamin Nachman , Dennis Noll

Anomaly detection on attributed networks attracts considerable research interests due to wide applications of attributed networks in modeling a wide range of complex systems. Recently, the deep learning-based anomaly detection methods have…

Machine Learning · Computer Science 2021-05-07 Yixin Liu , Zhao Li , Shirui Pan , Chen Gong , Chuan Zhou , George Karypis

Much hope for finding new physics phenomena at microscopic scale relies on the observations obtained from High Energy Physics experiments, like the ones performed at the Large Hadron Collider (LHC). However, current experiments do not…