English
Related papers

Related papers: Colo-SCRL: Self-Supervised Contrastive Representat…

200 papers

Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive pairs: they either rely on random perturbations that corrupt…

Information Retrieval · Computer Science 2025-12-23 Ziqiang Cui , Yunpeng Weng , Xing Tang , Xiaokun Zhang , Shiwei Li , Peiyang Liu , Bowei He , Dugang Liu , Weihong Luo , Xiuqiang He , Chen Ma

Recent breakthroughs in self-supervised learning show that such algorithms learn visual representations that can be transferred better to unseen tasks than joint-training methods relying on task-specific supervision. In this paper, we found…

Machine Learning · Computer Science 2021-06-29 Hyuntak Cha , Jaeho Lee , Jinwoo Shin

Understanding surgical scenes can provide better healthcare quality for patients, especially with the vast amount of video data that is generated during MIS. Processing these videos generates valuable assets for training sophisticated…

Image and Video Processing · Electrical Eng. & Systems 2025-07-08 Fatmaelzahraa Ali Ahmed , Muhammad Arsalan , Abdulaziz Al-Ali , Khalid Al-Jalham , Shidin Balakrishnan

Purpose: Intraoperative ultrasound (US) can enhance real-time visualization in transoral robotic surgery. The surgeon creates a mental map with a pre-operative scan. Then, a surgical assistant performs freehand US scanning during the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Wanwen Chen , Adam Schmidt , Eitan Prisman , Septimiu E. Salcudean

Image super-resolution (SR) research has witnessed impressive progress thanks to the advance of convolutional neural networks (CNNs) in recent years. However, most existing SR methods are non-blind and assume that degradation has a single…

Computer Vision and Pattern Recognition · Computer Science 2021-07-05 Jiahui Zhang , Shijian Lu , Fangneng Zhan , Yingchen Yu

Self-supervised visual representation learning aims to learn useful representations without relying on human annotations. Joint embedding approach bases on maximizing the agreement between embedding vectors from different views of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Li Jing , Pascal Vincent , Yann LeCun , Yuandong Tian

Improving sample efficiency is a key research problem in reinforcement learning (RL), and CURL, which uses contrastive learning to extract high-level features from raw pixels of individual video frames, is an efficient…

Machine Learning · Computer Science 2020-10-16 Jinhua Zhu , Yingce Xia , Lijun Wu , Jiajun Deng , Wengang Zhou , Tao Qin , Houqiang Li

Deformable shape representations, parameterized by deformations relative to a given template, have proven effective for improved image analysis tasks. However, their broader applicability is hindered by two major challenges. First, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Tonmoy Hossain , Miaomiao Zhang

Detectingandsegmentingobjectswithinwholeslideimagesis essential in computational pathology workflow. Self-supervised learning (SSL) is appealing to such annotation-heavy tasks. Despite the extensive benchmarks in natural images for dense…

Computer Vision and Pattern Recognition · Computer Science 2022-07-15 Jiawei Yang , Hanbo Chen , Yuan Liang , Junzhou Huang , Lei He , Jianhua Yao

Self-supervised learning (SSL) approaches have achieved great success when the amount of labeled data is limited. Within SSL, models learn robust feature representations by solving pretext tasks. One such pretext task is contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jamshid Hassanpour , Vinkle Srivastav , Didier Mutter , Nicolas Padoy

Considering the instance-level discriminative ability, contrastive learning methods, including MoCo and SimCLR, have been adapted from the original image representation learning task to solve the self-supervised skeleton-based action…

Computer Vision and Pattern Recognition · Computer Science 2024-10-02 Mengyuan Liu , Hong Liu , Tianyu Guo

Self-supervised learning (SSL) has become prevalent for learning representations in computer vision. Notably, SSL exploits contrastive learning to encourage visual representations to be invariant under various image transformations. The…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Swati Jindal , Roberto Manduchi

Contrastive learning (CL) is a popular technique for self-supervised learning (SSL) of visual representations. It uses pairs of augmentations of unlabeled training examples to define a classification task for pretext learning of a deep…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Chih-Hui Ho , Nuno Vasconcelos

Labeling videos at scale is impractical. Consequently, self-supervised visual representation learning is key for efficient video analysis. Recent success in learning image representations suggests contrastive learning is a promising…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nishant Rai , Ehsan Adeli , Kuan-Hui Lee , Adrien Gaidon , Juan Carlos Niebles

Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuang Zeng , Lei Zhu , Xinliang Zhang , Hangzhou He , Yanye Lu

Contrastive learning (CL) has become a cornerstone of self-supervised pretraining (SSP) in foundation models, however, extending CL to pixel-wise representation, crucial for medical vision, remains an open problem. Standard CL formulates…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Yuting He , Shuo Li

Many contrastive representation learning methods learn a single global representation of an entire image. However, dense contrastive representation learning methods such as DenseCL (Wang et al., 2021) can learn better representations for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-12 Berk Iskender , Zhenlin Xu , Simon Kornblith , En-Hung Chu , Maryam Khademi

Pathologic diagnosis is a critical phase in deciding the optimal treatment procedure for dealing with colorectal cancer (CRC). Colonic polyps, precursors to CRC, can pathologically be classified into two major types: adenomatous and…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Vanshali Sharma , Debesh Jha , M. K. Bhuyan , Pradip K. Das , Ulas Bagci

Self-supervised skeleton-based action recognition with contrastive learning has attracted much attention. Recent literature shows that data augmentation and large sets of contrastive pairs are crucial in learning such representations. In…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhan Chen , Hong Liu , Tianyu Guo , Zhengyan Chen , Pinhao Song , Hao Tang

Contrastive learning (CL) has become a powerful approach for learning representations from unlabeled images. However, existing CL methods focus predominantly on visual appearance features while neglecting topological characteristics (e.g.,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guangyu Meng , Pengfei Gu , Peixian Liang , John P. Lalor , Erin Wolf Chambers , Danny Z. Chen