English
Related papers

Related papers: Adaptive Memory Networks with Self-supervised Lear…

200 papers

A fundamental problem in the field of unsupervised machine learning is the detection of anomalies corresponding to rare and unusual observations of interest; reasons include for their rejection, accommodation or further investigation.…

Machine Learning · Computer Science 2022-05-16 Nassir Mohammad

Supervised contrastive representation learning has been shown to be effective in various transfer learning scenarios. However, while asymmetric non-contrastive learning (ANCL) often outperforms its contrastive learning counterpart in…

Machine Learning · Computer Science 2024-06-18 Jeongheon Oh , Kibok Lee

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

Medical imaging data suffers from the limited availability of annotation because annotating 3D medical data is a time-consuming and expensive task. Moreover, even if the annotation is available, supervised learning-based approaches suffer…

Image and Video Processing · Electrical Eng. & Systems 2020-11-12 Abinav Ravi Venkatakrishnan , Seong Tae Kim , Rami Eisawy , Franz Pfister , Nassir Navab

Recent advances in unsupervised anomaly detection (UAD) have shifted from single-class to multi-class scenarios. In such complex contexts, the increasing pattern diversity has brought two challenges to reconstruction-based approaches: (1)…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Jingyu Xing , Chenwei Tang , Tao Wang , Rong Xiao , Wei Ju , Ji-Zhe Zhou , Liangli Zhen , Jiancheng Lv

Modern software systems generate extensive heterogeneous log data with dynamic formats, fragmented event sequences, and varying temporal patterns, making anomaly detection both crucial and challenging. To address these complexities, we…

Artificial Intelligence · Computer Science 2025-12-17 Przemek Pospieszny , Wojciech Mormul , Karolina Szyndler , Sanjeev Kumar

Automating the analysis of surveillance video footage is of great interest when urban environments or industrial sites are monitored by a large number of cameras. As anomalies are often context-specific, it is hard to predefine events of…

Computer Vision and Pattern Recognition · Computer Science 2020-11-13 Bo Li , Sam Leroux , Pieter Simoens

Most classification algorithms used in high energy physics fall under the category of supervised machine learning. Such methods require a training set containing both signal and background events and are prone to classification errors…

Data Analysis, Statistics and Probability · Physics 2015-06-03 Mikael Kuusela , Tommi Vatanen , Eric Malmi , Tapani Raiko , Timo Aaltonen , Yoshikazu Nagai

Unsupervised anomaly detection in medical imaging aims to detect and localize arbitrary anomalies without requiring annotated anomalous data during training. Often, this is achieved by learning a data distribution of normal samples and…

Computer Vision and Pattern Recognition · Computer Science 2023-01-06 Carsten T. Lüth , David Zimmerer , Gregor Koehler , Paul F. Jaeger , Fabian Isensee , Jens Petersen , Klaus H. Maier-Hein

Anomaly detection - identifying deviations from Standard Model predictions - is a key challenge at the Large Hadron Collider due to the size and complexity of its datasets. This is typically addressed by transforming high-dimensional…

High Energy Physics - Experiment · Physics 2025-12-03 Kyle Metzger , Lana Xu , Mia Sodini , Thea K. Arrestad , Katya Govorkova , Gaia Grosso , Philip Harris

Anomaly detection in time series data, to identify points that deviate from normal behaviour, is a common problem in various domains such as manufacturing, medical imaging, and cybersecurity. Recently, Generative Adversarial Networks (GANs)…

Machine Learning · Computer Science 2025-05-27 Md Abul Bashar , Richi Nayak

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Unsupervised anomaly detection (UAD) aims to find anomalous images by optimising a detector using a training set that contains only normal images. UAD approaches can be based on reconstruction methods, self-supervised approaches, and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-23 Yu Tian , Guansong Pang , Yuyuan Liu , Chong Wang , Yuanhong Chen , Fengbei Liu , Rajvinder Singh , Johan W Verjans , Mengyu Wang , Gustavo Carneiro

The unsupervised anomaly localization task faces the challenge of missing anomaly sample training, detecting multiple types of anomalies, and dealing with the proportion of the area of multiple anomalies. A separate teacher-student feature…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Chao Hu , Shengxin Lai

Large language models (LLMs) have revolutionized how we interact with technology, but their personalization to individual user preferences remains a significant challenge, particularly in on-device applications. Traditional methods often…

Computation and Language · Computer Science 2024-09-26 Rafael Mendoza , Isabella Cruz , Richard Liu , Aarav Deshmukh , David Williams , Jesscia Peng , Rohan Iyer

Supervised anomaly detection methods perform well in identifying known anomalies that are well represented in the training set. However, they often struggle to generalise beyond the training distribution due to decision boundaries that lack…

Machine Learning · Computer Science 2025-11-18 Zahra Zamanzadeh Darban , Qizhou Wang , Charu C. Aggarwal , Geoffrey I. Webb , Ehsan Abbasnejad , Mahsa Salehi

This paper investigates unsupervised anomaly detection in multivariate time-series data using reinforcement learning (RL) in the latent space of an autoencoder. A significant challenge is the limited availability of anomalous data, often…

Machine Learning · Computer Science 2025-02-11 Saba Sanami , Amir G. Aghdam

Video anomaly detection is a challenging task because most anomalies are scarce and non-deterministic. Many approaches investigate the reconstruction difference between normal and abnormal patterns, but neglect that anomalies do not…

Computer Vision and Pattern Recognition · Computer Science 2022-06-28 Guodong Shen , Yuqi Ouyang , Victor Sanchez

Unsupervised anomaly detection is a challenging task in industrial applications since it is impracticable to collect sufficient anomalous samples. In this paper, a novel Self-Supervised Guided Segmentation Framework (SGSF) is proposed by…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Peng Xing , Yanpeng Sun , Zechao Li

Contrastive Self-supervised Learning (CSL) is a practical solution that learns meaningful visual representations from massive data in an unsupervised approach. The ordinary CSL embeds the features extracted from neural networks onto…

Computer Vision and Pattern Recognition · Computer Science 2022-08-19 Shentong Mo , Zhun Sun , Chao Li