English
Related papers

Related papers: Anomalies, Representations, and Self-Supervision

200 papers

Self-supervised visual representation learning aims to learn useful representations without relying on human annotations. Joint embedding approach bases on maximizing the agreement between embedding vectors from different views of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Li Jing , Pascal Vincent , Yann LeCun , Yuandong Tian

A robust and efficient anomaly detection technique is proposed, capable of dealing with crowded scenes where traditional tracking based approaches tend to fail. Initial foreground segmentation of the input frames confines the analysis to…

Computer Vision and Pattern Recognition · Computer Science 2013-04-04 Vikas Reddy , Conrad Sanderson , Brian C. Lovell

Self-supervised contrastive learning has emerged as a powerful paradigm for skeleton-based action recognition by enforcing consistency in the embedding space. However, existing methods rely on binary contrastive objectives that overlook the…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yingjie Feng , Yi Wang , Jiaze Wang , Anfeng Liu , Zhuotao Tian

Existing contrastive learning methods for anomalous sound detection refine the audio representation of each audio sample by using the contrast between the samples' augmentations (e.g., with time or frequency masking). However, they might be…

Sound · Computer Science 2023-04-11 Jian Guan , Feiyang Xiao , Youde Liu , Qiaoxi Zhu , Wenwu Wang

Ground deformation measured from Interferometric Synthetic Aperture Radar (InSAR) data is considered a sign of volcanic unrest, statistically linked to a volcanic eruption. Recent studies have shown the potential of using Sentinel-1 InSAR…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Nikolaos Ioannis Bountos , Ioannis Papoutsis , Dimitrios Michail , Nantheera Anantrasirichai

Anomaly detection under open-set scenario is a challenging task that requires learning discriminative fine-grained features to detect anomalies that were even unseen during training. As a cheap yet effective approach, data augmentation has…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Jianan Ye , Yijie Hu , Xi Yang , Qiu-Feng Wang , Chao Huang , Kaizhu Huang

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Industry 4.0 aims to optimize the manufacturing environment by leveraging new technological advances, such as new sensing capabilities and artificial intelligence. The DRAEM technique has shown state-of-the-art performance for unsupervised…

Computer Vision and Pattern Recognition · Computer Science 2022-12-20 Jože M. Rožanec , Patrik Zajec , Spyros Theodoropoulos , Erik Koehorst , Blaž Fortuna , Dunja Mladenić

For low-semantic sensor signals from human activity recognition (HAR), contrastive learning (CL) is essential to implement novel applications or generic models without manual annotation, which is a high-performance self-supervised learning…

Machine Learning · Computer Science 2026-02-04 Qingyu Wu , Jianfei Shen , Feiyi Fan , Yang Gu , Chenyang Xu , Yiqiang Chen

Due to the growing amount of data from in-situ sensors in wastewater systems, it becomes necessary to automatically identify abnormal behaviours and ensure high data quality. This paper proposes an anomaly detection method based on a deep…

Signal Processing · Electrical Eng. & Systems 2020-03-09 Stefania Russo , Andy Disch , Frank Blumensaat , Kris Villez

Time series anomaly detection is instrumental in maintaining system availability in various domains. Current work in this research line mainly focuses on learning data normality deeply and comprehensively by devising advanced neural network…

Machine Learning · Computer Science 2024-04-25 Hongzuo Xu , Yijie Wang , Songlei Jian , Qing Liao , Yongjun Wang , Guansong Pang

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

Machine Learning · Computer Science 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

The sophistication and diversity of contemporary cyberattacks have rendered the use of proxies, gateways, firewalls, and encrypted tunnels as a standalone defensive strategy inadequate. Consequently, the proactive identification of data…

Machine Learning · Computer Science 2024-09-24 Liyang Wang , Yu Cheng , Hao Gong , Jiacheng Hu , Xirui Tang , Iris Li

Neural network-based anomaly detection methods have shown to achieve high performance. However, they require a large amount of training data for each task. We propose a neural network-based meta-learning method for supervised anomaly…

Machine Learning · Statistics 2021-03-02 Tomoharu Iwata , Atsutoshi Kumagai

Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust representations from various augmented views. However,…

Machine Learning · Computer Science 2025-02-20 Ruyue Liu , Rong Yin , Yong Liu , Xiaoshuai Hao , Haichao Shi , Can Ma , Weiping Wang

Deep learning methods can classify various unstructured data such as images, language, and voice as input data. As the task of classifying anomalies becomes more important in the real world, various methods exist for classifying using deep…

Computer Vision and Pattern Recognition · Computer Science 2022-01-06 UJu Gim , YeongHyeon Park

We present a novel unsupervised deep learning approach that utilizes the encoder-decoder architecture for detecting anomalies in sequential sensor data collected during industrial manufacturing. Our approach is designed not only to detect…

Self-supervised learning has recently achieved great success in representation learning without human annotations. The dominant method -- that is contrastive learning, is generally based on instance discrimination tasks, i.e., individual…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Chen Feng , Ioannis Patras

There have been significant advancements in anomaly detection in an unsupervised manner, where only normal images are available for training. Several recent methods aim to detect anomalies based on a memory, comparing or reconstructing the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Joo Chan Lee , Taejune Kim , Eunbyung Park , Simon S. Woo , Jong Hwan Ko

Contrastive self-supervised learning has shown impressive results in learning visual representations from unlabeled images by enforcing invariance against different data augmentations. However, the learned representations are often…

Computer Vision and Pattern Recognition · Computer Science 2021-10-28 Sangwoo Mo , Hyunwoo Kang , Kihyuk Sohn , Chun-Liang Li , Jinwoo Shin