English
Related papers

Related papers: CL-Flow:Strengthening the Normalizing Flows by Con…

200 papers

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations. Invariances established during pre-training can be interpreted as strong…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Ruchika Chavhan , Henry Gouk , Jan Stuehmer , Calum Heggan , Mehrdad Yaghoobi , Timothy Hospedales

Contrastive learning has emerged as an essential approach for self-supervised learning in visual representation learning. The central objective of contrastive learning is to maximize the similarities between two augmented versions of an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Hengkui Dong , Xianzhong Long , Yun Li , Lei Chen

Visual defect assessment is a form of anomaly detection. This is very relevant in finding faults such as cracks and markings in various surface inspection tasks like pavement and automotive parts. The task involves detection of…

Computer Vision and Pattern Recognition · Computer Science 2019-05-31 Manpreet Singh Minhas , John Zelek

Anomaly detection focuses on identifying samples that deviate from the norm. Discovering informative representations of normal samples is crucial to detecting anomalies effectively. Recent self-supervised methods have successfully learned…

Machine Learning · Computer Science 2025-09-22 Alain Ryser , Thomas M. Sutter , Alexander Marx , Julia E. Vogt

Oversight in medical images is a crucial problem, and timely reporting of medical images is desired. Therefore, an all-purpose anomaly detection method that can detect virtually all types of lesions/diseases in a given image is strongly…

Image and Video Processing · Electrical Eng. & Systems 2020-10-21 H. Shibata , S. Hanaoka , Y. Nomura , T. Nakao , I. Sato , D. Sato , N. Hayashi , O. Abe

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Semi-supervised learning (SSL) has achieved great success in leveraging a large amount of unlabeled data to learn a promising classifier. A popular approach is pseudo-labeling that generates pseudo labels only for those unlabeled data with…

Computer Vision and Pattern Recognition · Computer Science 2022-12-29 Qinyi Deng , Yong Guo , Zhibang Yang , Haolin Pan , Jian Chen

Semi-supervised learning is attracting blooming attention, due to its success in combining unlabeled data. However, pseudo-labeling-based semi-supervised approaches suffer from two problems in image classification: (1) Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xuerong Zhang , Li Huang , Jing Lv , Ming Yang

Anomaly detection is an emerging approach in digital pathology for its ability to efficiently and effectively utilize data for disease diagnosis. While supervised learning approaches deliver high accuracy, they rely on extensively annotated…

Image and Video Processing · Electrical Eng. & Systems 2025-08-22 Jiamu Wang , Keunho Byeon , Jinsol Song , Anh Nguyen , Sangjeong Ahn , Sung Hak Lee , Jin Tae Kwak

Purpose: Paranasal anomalies, frequently identified in routine radiological screenings, exhibit diverse morphological characteristics. Due to the diversity of anomalies, supervised learning methods require large labelled dataset exhibiting…

Machine learning has achieved state-of-the-art results in network intrusion detection; however, its performance significantly degrades when confronted by a new attack class -- a zero-day attack. In simple terms, classical machine…

Cryptography and Security · Computer Science 2026-01-16 Jack Wilkie , Hanan Hindy , Craig Michie , Christos Tachtatzis , James Irvine , Robert Atkinson

A prominent technique for self-supervised representation learning has been to contrast semantically similar and dissimilar pairs of samples. Without access to labels, dissimilar (negative) points are typically taken to be randomly sampled…

Machine Learning · Computer Science 2020-10-22 Ching-Yao Chuang , Joshua Robinson , Lin Yen-Chen , Antonio Torralba , Stefanie Jegelka

The success of deep learning is usually accompanied by the growth in neural network depth. However, the traditional training method only supervises the neural network at its last layer and propagates the supervision layer-by-layer, which…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Linfeng Zhang , Xin Chen , Junbo Zhang , Runpei Dong , Kaisheng Ma

Clustering is essential to many tasks in pattern recognition and computer vision. With the advent of deep learning, there is an increasing interest in learning deep unsupervised representations for clustering analysis. Many works on this…

Machine Learning · Computer Science 2018-02-02 Caglar Aytekin , Xingyang Ni , Francesco Cricri , Emre Aksu

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

Universal anomaly detection still remains a challenging problem in machine learning and medical image analysis. It is possible to learn an expected distribution from a single class of normative samples, e.g., through epistemic uncertainty…

Computer Vision and Pattern Recognition · Computer Science 2023-10-03 Johanna P. Müller , Matthew Baugh , Jeremy Tan , Mischa Dombrowski , Bernhard Kainz

We present an unsupervised learning framework for simultaneously training single-view depth prediction and optical flow estimation models using unlabeled video sequences. Existing unsupervised methods often exploit brightness constancy and…

Computer Vision and Pattern Recognition · Computer Science 2018-09-06 Yuliang Zou , Zelun Luo , Jia-Bin Huang

Contrastive learning (CL) has achieved astonishing progress in computer vision, speech, and natural language processing fields recently with self-supervised learning. However, CL approach to the supervised setting is not fully explored,…

Computation and Language · Computer Science 2022-05-23 Zhenyu Zhang , Yuming Zhao , Meng Chen , Xiaodong He

Graph anomaly detection (GAD) has attracted increasing attention in machine learning and data mining. Recent works have mainly focused on how to capture richer information to improve the quality of node embeddings for GAD. Despite their…

Machine Learning · Computer Science 2023-10-03 Jingcan Duan , Pei Zhang , Siwei Wang , Jingtao Hu , Hu Jin , Jiaxin Zhang , Haifang Zhou , Xinwang Liu

One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios. Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an…

Machine Learning · Computer Science 2024-09-04 Zahra Zamanzadeh Darban , Geoffrey I. Webb , Shirui Pan , Charu C. Aggarwal , Mahsa Salehi