English
Related papers

Related papers: CLExtract: Recovering Highly Corrupted DVB/GSE Sat…

200 papers

Self-supervised learning (SSL) has become a powerful paradigm for learning from large, unlabeled datasets, particularly in computer vision (CV). However, applying SSL to multispectral remote sensing (RS) images presents unique challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Tom Burgert , Leonard Hackel , Paolo Rota , Begüm Demir

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

Computer Vision and Pattern Recognition · Computer Science 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Recently, contrastive self-supervised learning, where the proximity of representations is determined based on the identities of samples, has made remarkable progress in unsupervised representation learning. SimSiam is a well-known example…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Kyoungmin Han , Minsik Lee

Weakly supervised semantic segmentation (WSSS) aims at learning a semantic segmentation model with only image-level tags. Despite intensive research on deep learning approaches over a decade, there is still a significant performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Qi Lai , Chi-Man Vong

Contrastive self-supervised learning (CSL) for speaker verification (SV) has drawn increasing interest recently due to its ability to exploit unlabeled data. Performing data augmentation on raw waveforms, such as adding noise or…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-12 Chong-Xin Gan , Man-Wai Mak , Weiwei Lin , Jen-Tzung Chien

Graph Contrastive Learning (GCL) has emerged as a powerful paradigm for training Graph Neural Networks (GNNs) in the absence of task-specific labels. However, its scalability on large-scale graphs is hindered by the intensive message…

Machine Learning · Computer Science 2025-11-12 Xiang Chen , Kun Yue , Wenjie Liu , Zhenyu Zhang , Liang Duan

With the recent promising results of contrastive learning in the self-supervised learning paradigm, supervised contrastive learning has successfully extended these contrastive approaches to supervised contexts, outperforming cross-entropy…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Jaewon Kim , Hyukjong Lee , Jooyoung Chang , Sang Min Park

Graph Neural Networks (GNNs) have received extensive research attention due to their powerful information aggregation capabilities. Despite the success of GNNs, most of them suffer from the popularity bias issue in a graph caused by a small…

Machine Learning · Computer Science 2024-08-02 Yuntao Shou , Haozhi Lan , Xiangyong Cao

Remotely detecting and classifying underwater acoustic targets is critical for environmental monitoring and defence. However, the complexity of ship-radiated and environmental noise poses significant challenges for accurate signal…

Machine Learning · Computer Science 2026-01-08 Lucas Cesar Ferreira Domingos , Russell Brinkworth , Paulo Eduardo Santos , Karl Sammut

Notwithstanding the prominent performance achieved in various applications, point cloud recognition models have often suffered from natural corruptions and adversarial perturbations. In this paper, we delve into boosting the general…

Computer Vision and Pattern Recognition · Computer Science 2022-09-19 Qidong Huang , Xiaoyi Dong , Dongdong Chen , Hang Zhou , Weiming Zhang , Kui Zhang , Gang Hua , Nenghai Yu

In the face of rapidly accumulating genomic data, our understanding of the RNA regulatory code remains incomplete. Recent self-supervised methods in other domains have demonstrated the ability to learn rules underlying the data-generating…

Machine Learning · Computer Science 2023-10-18 Philip Fradkin , Ruian Shi , Bo Wang , Brendan Frey , Leo J. Lee

Contrastive learning has recently established itself as a powerful self-supervised learning framework for extracting rich and versatile data representations. Broadly speaking, contrastive learning relies on a data augmentation scheme to…

Machine Learning · Computer Science 2023-05-02 Ilgee Hong , Huy Tran , Claire Donnat

Self-supervised learning (SSL) has achieved major advances in natural images and video understanding, but challenges remain in domains like echocardiography (heart ultrasound) due to subtle anatomical structures, complex temporal dynamics,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-26 Divyanshu Mishra , Mohammadreza Salehi , Pramit Saha , Olga Patey , Aris T. Papageorghiou , Yuki M. Asano , J. Alison Noble

Automatic delineation of organ-at-risk (OAR) and gross-tumor-volume (GTV) is of great significance for radiotherapy planning. However, it is a challenging task to learn powerful representations for accurate delineation under limited pixel…

Image and Video Processing · Electrical Eng. & Systems 2022-04-21 Jiacheng Wang , Xiaomeng Li , Yiming Han , Jing Qin , Liansheng Wang , Zhou Qichao

Semi-supervised learning is a sound measure to relieve the strict demand of abundant annotated datasets, especially for challenging multi-organ segmentation . However, most existing SSL methods predict pixels in a single image…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Lu Wen , Zhenghao Feng , Yun Hou , Peng Wang , Xi Wu , Jiliu Zhou , Yan Wang

Reliable tools to extract patterns from high-dimensionality spaces are becoming more necessary as astronomical datasets increase both in volume and complexity. Contrastive Learning is a self-supervised machine learning algorithm that…

Instrumentation and Methods for Astrophysics · Physics 2023-06-12 Marc Huertas-Company , Regina Sarmiento , Johan Knapen

In self-supervised representation learning, Siamese networks are a natural architecture for learning transformation-invariance by bringing representations of positive pairs closer together. But it is prone to collapse into a degenerate…

Machine Learning · Computer Science 2025-03-13 Byeongchan Lee , Sehyun Lee

Deep learning algorithms have recently achieved promising deraining performances on both the natural and synthetic rainy datasets. As an essential low-level pre-processing stage, a deraining network should clear the rain streaks and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Shen Zheng , Changjie Lu , Yuxiong Wu , Gaurav Gupta

Learnable keypoint detectors and descriptors are beginning to outperform classical hand-crafted feature extraction methods. Recent studies on self-supervised learning of visual representations have driven the increasing performance of…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Henrique Siqueira , Patrick Ruhkamp , Ibrahim Halfaoui , Markus Karmann , Onay Urfalioglu

As a self-supervised learning paradigm, contrastive learning has been widely used to pre-train a powerful encoder as an effective feature extractor for various downstream tasks. This process requires numerous unlabeled training data and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Tianxing Zhang , Hanzhou Wu , Xiaofeng Lu , Guangling Sun