English
Related papers

Related papers: Adaptive Memory Networks with Self-supervised Lear…

200 papers

In recent years, self-supervised representation learning for skeleton-based action recognition has been developed with the advance of contrastive learning methods. The existing contrastive learning methods use normal augmentations to…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Tianyu Guo , Hong Liu , Zhan Chen , Mengyuan Liu , Tao Wang , Runwei Ding

Self-supervised learning allows for better utilization of unlabelled data. The feature representation obtained by self-supervision can be used in downstream tasks such as classification, object detection, segmentation, and anomaly…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Rabia Ali , Muhammad Umar Karim Khan , Chong Min Kyung

In this work, a novel deep neural network, designed to enhance the efficiency and effectiveness of unsupervised sound anomaly detection, is presented. The proposed model exploits an attention module and separable convolutions to identify…

Audio and Speech Processing · Electrical Eng. & Systems 2024-10-14 Michael Neri , Marco Carli

Exfiltration of data via email is a serious cybersecurity threat for many organizations. Detecting data exfiltration (anomaly) patterns typically requires labeling, most often done by a human annotator, to reduce the high number of false…

Machine Learning · Computer Science 2023-07-19 Jaturong Kongmanee , Mark Chignell , Khilan Jerath , Abhay Raman

Anomaly detection is a significant and hence well-studied problem. However, developing effective anomaly detection methods for complex and high-dimensional data remains a challenge. As Generative Adversarial Networks (GANs) are able to…

Machine Learning · Computer Science 2018-12-07 Houssam Zenati , Manon Romain , Chuan Sheng Foo , Bruno Lecouat , Vijay Ramaseshan Chandrasekhar

Unsupervised representation learning has been extensively employed in anomaly detection, achieving impressive performance. Extracting valuable feature vectors that can remarkably improve the performance of anomaly detection are essential in…

Machine Learning · Computer Science 2022-04-26 Muhao Xu , Xueying Zhou , Xizhan Gao , WeiKai He , Sijie Niu

Unsupervised Anomaly Detection has become a popular method to detect pathologies in medical images as it does not require supervision or labels for training. Most commonly, the anomaly detection model generates a "normal" version of an…

Image and Video Processing · Electrical Eng. & Systems 2023-09-26 Felix Meissen , Johannes Paetzold , Georgios Kaissis , Daniel Rueckert

We investigate anomaly detection in an unsupervised framework and introduce Long Short Term Memory (LSTM) neural network based algorithms. In particular, given variable length data sequences, we first pass these sequences through our LSTM…

Signal Processing · Electrical Eng. & Systems 2020-02-25 Tolga Ergen , Ali Hassan Mirza , Suleyman Serdar Kozat

How can we detect anomalies: that is, samples that significantly differ from a given set of high-dimensional data, such as images or sensor data? This is a practical problem with numerous applications and is also relevant to the goal of…

Machine Learning · Computer Science 2022-06-16 Adam Goodge , Bryan Hooi , See Kiong Ng , Wee Siong Ng

Machine anomalous sound detection (ASD) is a valuable technique across various applications. However, its generalization performance is often limited due to challenges in data collection and the complexity of acoustic environments. Inspired…

Sound · Computer Science 2025-08-19 Bing Han , Anbai Jiang , Xinhu Zheng , Wei-Qiang Zhang , Jia Liu , Pingyi Fan , Yanmin Qian

Unsupervised anomaly detection (UAD) learns one-class classifiers exclusively with normal (i.e., healthy) images to detect any abnormal (i.e., unhealthy) samples that do not conform to the expected normal patterns. UAD has two main…

Computer Vision and Pattern Recognition · Computer Science 2021-07-01 Yu Tian , Guansong Pang , Fengbei Liu , Yuanhong chen , Seon Ho Shin , Johan W. Verjans , Rajvinder Singh , Gustavo Carneiro

Current unsupervised anomaly localization approaches rely on generative models to learn the distribution of normal images, which is later used to identify potential anomalous regions derived from errors on the reconstructed images. However,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-13 Julio Silva-Rodríguez , Valery Naranjo , Jose Dolz

In the field of multi-class anomaly detection, reconstruction-based methods derived from single-class anomaly detection face the well-known challenge of "learning shortcuts", wherein the model fails to learn the patterns of normal samples…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Liren He , Zhengkai Jiang , Jinlong Peng , Liang Liu , Qiangang Du , Xiaobin Hu , Wenbing Zhu , Mingmin Chi , Yabiao Wang , Chengjie Wang

Deep anomaly detection methods learn representations that separate between normal and anomalous images. Although self-supervised representation learning is commonly used, small dataset sizes limit its effectiveness. It was previously shown…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Tal Reiss , Yedid Hoshen

Transformer-based audio self-supervised learning (SSL) models commonly use spectrograms, vision-style Transformers, and masked modeling objectives. However, convolutional patchification with temporal downsampling lowers the effective…

Sound · Computer Science 2026-05-15 Kohei Yamamoto , Kosuke Okusa

Few-shot learning (FSL) enables machine learning models to generalize effectively with minimal labeled data, making it crucial for data-scarce domains such as healthcare, robotics, and natural language processing. Despite its potential, FSL…

Machine Learning · Computer Science 2025-01-24 Rishabh Agrawal

Anomaly detection has wide applications in machine intelligence but is still a difficult unsolved problem. Major challenges include the rarity of labeled anomalies and it is a class highly imbalanced problem. Traditional unsupervised…

Machine Learning · Computer Science 2021-04-27 Zhi Chen , Jiang Duan , Li Kang , Guoping Qiu

Anomaly detection with only prior knowledge from normal samples attracts more attention because of the lack of anomaly samples. Existing CNN-based pixel reconstruction approaches suffer from two concerns. First, the reconstruction source…

Computer Vision and Pattern Recognition · Computer Science 2022-12-12 Zhiyuan You , Kai Yang , Wenhan Luo , Lei Cui , Yu Zheng , Xinyi Le

Unsupervised anomaly detection from high dimensional data like mobility networks is a challenging task. Study of different approaches of feature engineering from such high dimensional data have been a focus of research in this field. This…

Machine Learning · Computer Science 2019-12-09 Urwa Muaz , Stanislav Sobolevsky

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras