English
Related papers

Related papers: Contrastive Learning for Image Complexity Represen…

200 papers

Deep clustering has shown its promising capability in joint representation learning and clustering via deep neural networks. Despite the significant progress, the existing deep clustering works mostly utilize some distribution-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Yuankun Xu , Dong Huang , Chang-Dong Wang , Jian-Huang Lai

The prior self-supervised learning researches mainly select image-level instance discrimination as pretext task. It achieves a fantastic classification performance that is comparable to supervised learning methods. However, with degraded…

Computer Vision and Pattern Recognition · Computer Science 2022-05-11 Bing Zhao , Jun Li , Hong Zhu

The self-supervised contrastive learning strategy has attracted considerable attention due to its exceptional ability in representation learning. However, current contrastive learning tends to learn global coarse-grained representations of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Jialu Shi , Zhiqiang Wei , Jie Nie , Lei Huang

Automatic image cropping algorithms aim to recompose images like human-being photographers by generating the cropping boxes with improved composition quality. Cropping box regression approaches learn the beauty of composition from annotated…

Computer Vision and Pattern Recognition · Computer Science 2023-02-20 Zhiyu Pan , Yinpeng Chen , Jiale Zhang , Hao Lu , Zhiguo Cao , Weicai Zhong

Collaborative learning enables distributed clients to learn a shared model for prediction while keeping the training data local on each client. However, existing collaborative learning methods require fully-labeled data for training, which…

Machine Learning · Computer Science 2022-04-26 Yawen Wu , Zhepeng Wang , Dewen Zeng , Meng Li , Yiyu Shi , Jingtong Hu

In this paper, we provide a detailed description on our approach designed for CVPR 2019 Workshop and Challenge on Learned Image Compression (CLIC). Our approach mainly consists of two proposals, i.e. deep residual learning for image…

Image and Video Processing · Electrical Eng. & Systems 2019-06-25 Zhengxue Cheng , Heming Sun , Masaru Takeuchi , Jiro Katto

Learning dense visual representations without labels is an arduous task and more so from scene-centric data. We propose to tackle this challenging problem by proposing a Cross-view consistency objective with an Online Clustering mechanism…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Thomas Stegmüller , Tim Lebailly , Behzad Bozorgtabar , Tinne Tuytelaars , Jean-Philippe Thiran

We consider the problem of obtaining image quality representations in a self-supervised manner. We use prediction of distortion type and degree as an auxiliary task to learn features from an unlabeled image dataset containing a mixture of…

Computer Vision and Pattern Recognition · Computer Science 2022-06-30 Pavan C. Madhusudana , Neil Birkbeck , Yilin Wang , Balu Adsumilli , Alan C. Bovik

Medical image understanding plays a crucial role in enabling automated diagnosis and data-driven clinical decision support. However, its progress is impeded by two primary challenges: the limited availability of high-quality annotated…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Tianchen Fang , Guiru Liu

Recently, some contrastive learning methods have been proposed to simultaneously learn representations and clustering assignments, achieving significant improvements. However, these methods do not take the category information and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Huasong Zhong , Jianlong Wu , Chong Chen , Jianqiang Huang , Minghua Deng , Liqiang Nie , Zhouchen Lin , Xian-Sheng Hua

This paper presents Prototypical Contrastive Learning (PCL), an unsupervised representation learning method that addresses the fundamental limitations of instance-wise contrastive learning. PCL not only learns low-level features for the…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Junnan Li , Pan Zhou , Caiming Xiong , Steven C. H. Hoi

We present a new framework for self-supervised representation learning by formulating it as a ranking problem in an image retrieval context on a large number of random views (augmentations) obtained from images. Our work is based on two…

Computer Vision and Pattern Recognition · Computer Science 2020-11-23 Ali Varamesh , Ali Diba , Tinne Tuytelaars , Luc Van Gool

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen

Human skeleton point clouds are commonly used to automatically classify and predict the behaviour of others. In this paper, we use a contrastive self-supervised learning method, SimCLR, to learn representations that capture the semantics of…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Nico Lingg , Miguel Sarabia , Luca Zappella , Barry-John Theobald

Self-supervised pretraining has been shown to yield powerful representations for transfer learning. These performance gains come at a large computational cost however, with state-of-the-art methods requiring an order of magnitude more…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Olivier J. Hénaff , Skanda Koppula , Jean-Baptiste Alayrac , Aaron van den Oord , Oriol Vinyals , João Carreira

Self-supervised learning has been widely used to obtain transferrable representations from unlabeled images. Especially, recent contrastive learning methods have shown impressive performances on downstream image classification tasks. While…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Byungseok Roh , Wuhyun Shin , Ildoo Kim , Sungwoong Kim

Contrastive learning is a recent promising approach in unsupervised representation learning where a feature representation of data is learned by solving a pseudo classification problem from unlabelled data. However, it is not…

Machine Learning · Computer Science 2022-08-10 Hiroaki Sasaki , Takashi Takenouchi

Precision medicine fundamentally aims to establish causality between dysregulated biochemical mechanisms and cancer subtypes. Omics-based cancer subtyping has emerged as a revolutionary approach, as different level of omics records the…

Genomics · Quantitative Biology 2023-08-25 Ziwei Yang , Zheng Chen , Yasuko Matsubara , Yasushi Sakurai

Contrastive Language-Image Pre-training (CLIP) delivers strong cross modal generalization by aligning images and texts in a shared embedding space, yet it persistently fails at compositional reasoning over objects, attributes, and relations…

Machine Learning · Computer Science 2025-10-31 Ziliang Chen , Tianang Xiao , Jusheng Zhang , Yongsen Zheng , Xipeng Chen

Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily available supervision of natural language. It improves the performance of downstream vision tasks, including but not limited to the zero-shot, long tail,…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Yi Li , Hualiang Wang , Yiqun Duan , Hang Xu , Xiaomeng Li