English
Related papers

Related papers: Vector Contrastive Learning For Pixel-Wise Pretrai…

200 papers

Semi-supervised learning (SSL) has been widely used to learn from both a few labeled images and many unlabeled images to overcome the scarcity of labeled samples in medical image segmentation. Most current SSL-based segmentation methods use…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Xinze Li , Runlin Huang , Zhenghao Wu , Bohan Yang , Wentao Fan , Chengzhang Zhu , Weifeng Su

Self-Supervised Learning (SSL) enables us to pre-train foundation models without costly labeled data. Among SSL methods, Contrastive Learning (CL) methods are better at obtaining accurate semantic representations in noise interference.…

Image and Video Processing · Electrical Eng. & Systems 2026-02-06 Hengtong Shen , Haiyan Gu , Haitao Li , Yi Yang , Agen Qiu

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Supervised learning for semantic segmentation requires a large number of labeled samples, which is difficult to obtain in the field of remote sensing. Self-supervised learning (SSL), can be used to solve such problems by pre-training a…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Haifeng Li , Yi Li , Guo Zhang , Ruoyun Liu , Haozhe Huang , Qing Zhu , Chao Tao

Whilst contrastive learning has recently brought notable benefits to deep clustering of unlabelled images by learning sample-specific discriminative visual features, its potential for explicitly inferring class decision boundaries is less…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jiabo Huang , Shaogang Gong

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

Image captioning, a popular topic in computer vision, has achieved substantial progress in recent years. However, the distinctiveness of natural descriptions is often overlooked in previous work. It is closely related to the quality of…

Computer Vision and Pattern Recognition · Computer Science 2017-10-10 Bo Dai , Dahua Lin

Unsupervised clustering aims at discovering the semantic categories of data according to some distance measured in the representation space. However, different categories often overlap with each other in the representation space at the…

Machine Learning · Computer Science 2021-06-01 Dejiao Zhang , Feng Nan , Xiaokai Wei , Shangwen Li , Henghui Zhu , Kathleen McKeown , Ramesh Nallapati , Andrew Arnold , Bing Xiang

Contrastive learning is commonly used as a method of self-supervised learning with the "anchor" and "positive" being two random augmentations of a given input image, and the "negative" is the set of all other images. However, the…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Rishab Balasubramanian , Kunal Rathore

To date, most existing self-supervised learning methods are designed and optimized for image classification. These pre-trained models can be sub-optimal for dense prediction tasks due to the discrepancy between image-level prediction and…

Computer Vision and Pattern Recognition · Computer Science 2021-04-06 Xinlong Wang , Rufeng Zhang , Chunhua Shen , Tao Kong , Lei Li

In computational pathology, we often face a scarcity of annotations and a large amount of unlabeled data. One method for dealing with this is semi-supervised learning which is commonly split into a self-supervised pretext task and a…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Manuel Tran , Sophia J. Wagner , Melanie Boxberg , Tingying Peng

Multi-label image classification presents a challenging task in many domains, including computer vision and medical imaging. Recent advancements have introduced graph-based and transformer-based methods to improve performance and capture…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Ahmad Sajedi , Samir Khaki , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

Contrastive learning (CL) aims to preserve relational structure between samples by learning representations that reflect a similarity graph. Yet, the geometry of the resulting embeddings remains poorly understood. Here we show that weighted…

Machine Learning · Computer Science 2026-05-15 Raphael Vock , Edouard Duchesnay , Benoit Dufumier

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Representation learning offers a conduit to elucidate distinctive features within the latent space and interpret the deep models. However, the randomness of lesion distribution and the complexity of low-quality factors in medical images…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Qingshan Hou , Shuai Cheng , Peng Cao , Jinzhu Yang , Xiaoli Liu , Osmar R. Zaiane , Yih Chung Tham

Previous work on action representation learning focused on global representations for short video clips. In contrast, many practical applications, such as video alignment, strongly demand learning the intensive representation of long…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Minghao Chen , Renbo Tu , Chenxi Huang , Yuqi Lin , Boxi Wu , Deng Cai

Contrastive learning has emerged as a transformative method for learning effective visual representations through the alignment of image and text embeddings. However, pairwise similarity computation in contrastive loss between image and…

Computer Vision and Pattern Recognition · Computer Science 2024-04-25 Sachin Mehta , Maxwell Horton , Fartash Faghri , Mohammad Hossein Sekhavat , Mahyar Najibi , Mehrdad Farajtabar , Oncel Tuzel , Mohammad Rastegari

Colonoscopic video retrieval, which is a critical part of polyp treatment, has great clinical significance for the prevention and treatment of colorectal cancer. However, retrieval models trained on action recognition datasets usually…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Qingzhong Chen , Shilun Cai , Crystal Cai , Zefang Yu , Dahong Qian , Suncheng Xiang

Contrastive learning has achieved remarkable success on various high-level tasks, but there are fewer contrastive learning-based methods proposed for low-level tasks. It is challenging to adopt vanilla contrastive learning technologies…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Gang Wu , Junjun Jiang , Xianming Liu