English
Related papers

Related papers: A Practical Contrastive Learning Framework for Sin…

200 papers

Convolutional neural networks (CNNs) are highly successful for super-resolution (SR) but often require sophisticated architectures with heavy memory cost and computational overhead, significantly restricts their practical deployments on…

Computer Vision and Pattern Recognition · Computer Science 2021-05-26 Yanbo Wang , Shaohui Lin , Yanyun Qu , Haiyan Wu , Zhizhong Zhang , Yuan Xie , Angela Yao

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Hyperspectral image (HSI) clustering is gaining considerable attention owing to recent methods that overcome the inefficiency and misleading results from the absence of supervised information. Contrastive learning methods excel at existing…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Renxiang Guan , Zihao Li , Xianju Li , Chang Tang

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

We propose a novel contrastive learning framework to effectively address the challenges of data heterogeneity in federated learning. We first analyze the inconsistency of gradient updates across clients during local training and establish…

Machine Learning · Computer Science 2024-06-03 Seonguk Seo , Jinkyu Kim , Geeho Kim , Bohyung Han

In standard supervised machine learning, it is necessary to provide a label for every input in the data. While raw data in many application domains is easily obtainable on the Internet, manual labelling of this data is prohibitively…

Machine Learning · Computer Science 2023-09-07 Konstantinos Christopher Tsiolis

Most of the existing learning-based single image superresolution (SISR) methods are trained and evaluated on simulated datasets, where the low-resolution (LR) images are generated by applying a simple and uniform degradation (i.e., bicubic…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Jianrui Cai , Hui Zeng , Hongwei Yong , Zisheng Cao , Lei Zhang

Single image super-resolution (SR) aims to estimate a high-resolution (HR) image from a lowresolution (LR) input. Image priors are commonly learned to regularize the otherwise seriously ill-posed SR problem, either using external LR-HR…

Computer Vision and Pattern Recognition · Computer Science 2015-10-28 Zhangyang Wang , Yingzhen Yang , Zhaowen Wang , Shiyu Chang , Jianchao Yang , Thomas S. Huang

Unsupervised visual representation learning has gained much attention from the computer vision community because of the recent achievement of contrastive learning. Most of the existing contrastive learning frameworks adopt the instance…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Mingkai Zheng , Fei Wang , Shan You , Chen Qian , Changshui Zhang , Xiaogang Wang , Chang Xu

The rapid advancement of generative artificial intelligence has enabled the creation of synthetic images that are increasingly indistinguishable from authentic content, posing significant challenges for digital media integrity. This problem…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Jaime Álvarez Urueña , David Camacho , Javier Huertas Tato

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

Recently, pretext-task based methods are proposed one after another in self-supervised video feature learning. Meanwhile, contrastive learning methods also yield good performance. Usually, new methods can beat previous ones as claimed that…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Li Tao , Xueting Wang , Toshihiko Yamasaki

Contrastive learning allows us to flexibly define powerful losses by contrasting positive pairs from sets of negative samples. Recently, the principle has also been used to learn cross-modal embeddings for video and text, yet without…

Computer Vision and Pattern Recognition · Computer Science 2021-10-01 Mohammadreza Zolfaghari , Yi Zhu , Peter Gehler , Thomas Brox

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Magnetic Resonance Imaging (MRI) is an important medical imaging modality, while it requires a long acquisition time. To reduce the acquisition time, various methods have been proposed. However, these methods failed to reconstruct images…

Image and Video Processing · Electrical Eng. & Systems 2021-12-01 Qiaosi Yi , Jinhao Liu , Le Hu , Faming Fang , Guixu Zhang

In recent years, a variety of contrastive learning based unsupervised visual representation learning methods have been designed and achieved great success in many visual tasks. Generally, these methods can be roughly classified into four…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Wenbin Li , Meihao Kong , Xuesong Yang , Lei Wang , Jing Huo , Yang Gao , Jiebo Luo

Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yu Du , Miaojing Shi , Fangyun Wei , Guoqi Li

Most Neural Networks (NNs) for classification are trained using Cross-Entropy as a loss function. This approach requires the model to have an explicit classification layer. However, there exist alternative approaches, such as Contrastive…

Machine Learning · Computer Science 2026-04-27 Leonardo Arrighi , Julia Eva Belloni , Aurélie Gallet , Ivan Gentile , Matteo Lippi , Marco Zullich

Contrastive self-supervised learning has attracted significant research attention recently. It learns effective visual representations from unlabeled data by embedding augmented views of the same image close to each other while pushing away…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Yichen Zhang , Yifang Yin , Ying Zhang , Roger Zimmermann