English
Related papers

Related papers: Self-supervised Contrastive Learning for Volcanic …

200 papers

Deep learning techniques have achieved great success in remote sensing image change detection. Most of them are supervised techniques, which usually require large amounts of training data and are limited to a particular application.…

Image and Video Processing · Electrical Eng. & Systems 2021-10-11 Yuxing Chen , Lorenzo Bruzzone

Self-supervised facial representation has recently attracted increasing attention due to its ability to perform face understanding without relying on large-scale annotated datasets heavily. However, analytically, current contrastive-based…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yuanyuan Liu , Wenbin Wang , Yibing Zhan , Shaoze Feng , Kejun Liu , Zhe Chen

Sign language recognition (SLR) is a machine learning task aiming to identify signs in videos. Due to the scarcity of annotated data, unsupervised methods like contrastive learning have become promising in this field. They learn meaningful…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ariel Basso Madjoukeng , Jérôme Fink , Pierre Poitier , Edith Belise Kenmogne , Benoit Frenay

This work aims at improving instance retrieval with self-supervision. We find that fine-tuning using the recently developed self-supervised (SSL) learning methods, such as SimCLR and MoCo, fails to improve the performance of instance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Zelu Deng , Yujie Zhong , Sheng Guo , Weilin Huang

Skeleton-based action recognition is widely used in varied areas, e.g., surveillance and human-machine interaction. Existing models are mainly learned in a supervised manner, thus heavily depending on large-scale labeled data which could be…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Peng Wang , Jun Wen , Chenyang Si , Yuntao Qian , Liang Wang

Most of the existing learning-based deraining methods are supervisedly trained on synthetic rainy-clean pairs. The domain gap between the synthetic and real rain makes them less generalized to complex real rainy scenes. Moreover, the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Yi Chang , Yun Guo , Yuntong Ye , Changfeng Yu , Lin Zhu , Xile Zhao , Luxin Yan , Yonghong Tian

In this study, we present a simple multi-channel framework for contrastive learning (MC-SimCLR) to encode 'what' and 'where' of spatial audios. MC-SimCLR learns joint spectral and spatial representations from unlabeled spatial audios,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-09-29 Xilin Jiang , Cong Han , Yinghao Aaron Li , Nima Mesgarani

Self-supervised learning attempts to learn representations from un-labeled data; it does so via a loss function that encourages the embedding of a point to be close to that of its augmentations. This simple idea performs remarkably well,…

Machine Learning · Computer Science 2026-01-30 Parikshit Bansal , Ali Kavis , Sujay Sanghavi

Self-supervised learning of graph neural networks (GNNs) aims to learn an accurate representation of the graphs in an unsupervised manner, to obtain transferable representations of them for diverse downstream tasks. Predictive learning and…

Machine Learning · Computer Science 2022-10-11 Dongki Kim , Jinheon Baek , Sung Ju Hwang

Archaeology has long faced fundamental issues of sampling and scalar representation. Traditionally, the local-to-regional-scale views of settlement patterns are produced through systematic pedestrian surveys. Recently, systematic manual…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Jiachen Xu , Junlin Guo , James Zimmer-Dauphinee , Quan Liu , Yuxuan Shi , Zuhayr Asad , D. Mitchell Wilkes , Parker VanValkenburgh , Steven A. Wernke , Yuankai Huo

Self-supervised representation learning (SSRL) methods have shown great success in computer vision. In recent studies, augmentation-based contrastive learning methods have been proposed for learning representations that are invariant or…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Xu , Jochen Triesch

Increasing deployment of photovoltaic (PV) plants requires methods for automatic detection of faulty PV modules in modalities, such as infrared (IR) images. Recently, deep learning has become popular for this. However, related works…

Computer Vision and Pattern Recognition · Computer Science 2021-12-07 Lukas Bommes , Mathis Hoffmann , Claudia Buerhop-Lutz , Tobias Pickel , Jens Hauch , Christoph Brabec , Andreas Maier , Ian Marius Peters

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

Computation and Language · Computer Science 2021-09-20 Haoxiang Shi , Cen Wang

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

Unsupervised learning algorithms are beginning to achieve accuracies comparable to their supervised counterparts on benchmark computer vision tasks, but their utility for practical applications has not yet been demonstrated. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2022-01-13 Jeremiah W. Johnson , Swathi Hari , Donald Hampton , Hyunju K. Connor , Amy Keesee

In this paper, we proposed to investigate unsupervised anomaly detection in Synthetic Aperture Radar (SAR) images. Our approach considers anomalies as abnormal patterns that deviate from their surroundings but without any prior knowledge of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Max Muzeau , Chengfang Ren , Sébastien Angelliaume , Mihai Datcu , Jean-Philippe Ovarlez

Self-Supervised Learning (SSL) surmises that inputs and pairwise positive relationships are enough to learn meaningful representations. Although SSL has recently reached a milestone: outperforming supervised methods in many modalities\dots…

Machine Learning · Computer Science 2022-06-13 Randall Balestriero , Yann LeCun

Ensuring the realism of computer-generated synthetic images is crucial to deep neural network (DNN) training. Due to different semantic distributions between synthetic and real-world captured datasets, there exists semantic mismatch between…

Computer Vision and Pattern Recognition · Computer Science 2023-04-27 Ganning Zhao , Tingwei Shen , Suya You , C. -C. Jay Kuo

Network intrusion detection, a well-explored cybersecurity field, has predominantly relied on supervised learning algorithms in the past two decades. However, their limitations in detecting only known anomalies prompt the exploration of…

Cryptography and Security · Computer Science 2025-10-06 Hamed Fard , Tobias Schalau , Gerhard Wunder

Recently, many unsupervised deep learning methods have been proposed to learn clustering with unlabelled data. By introducing data augmentation, most of the latest methods look into deep clustering from the perspective that the original…

Computer Vision and Pattern Recognition · Computer Science 2020-08-28 Huasong Zhong , Chong Chen , Zhongming Jin , Xian-Sheng Hua