English
Related papers

Related papers: PAD: Self-Supervised Pre-Training with Patchwise-S…

200 papers

Pretraining on large labeled datasets is a prerequisite to achieve good performance in many computer vision tasks like 2D object recognition, video classification etc. However, pretraining is not widely used for 3D recognition tasks where…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Zaiwei Zhang , Rohit Girdhar , Armand Joulin , Ishan Misra

Pathological image analysis is a crucial field in computer-aided diagnosis, where deep learning is widely applied. Transfer learning using pre-trained models initialized on natural images has effectively improved the downstream pathological…

Image and Video Processing · Electrical Eng. & Systems 2023-10-30 Nan Ying , Yanli Lei , Tianyi Zhang , Shangqing Lyu , Chunhui Li , Sicheng Chen , Zeyu Liu , Yu Zhao , Guanglei Zhang

In the context of autonomous driving, the significance of effective feature learning is widely acknowledged. While conventional 3D self-supervised pre-training methods have shown widespread success, most methods follow the ideas originally…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Honghui Yang , Sha Zhang , Di Huang , Xiaoyang Wu , Haoyi Zhu , Tong He , Shixiang Tang , Hengshuang Zhao , Qibo Qiu , Binbin Lin , Xiaofei He , Wanli Ouyang

Existing CNNs-Based RGB-D salient object detection (SOD) networks are all required to be pretrained on the ImageNet to learn the hierarchy features which helps provide a good initialization. However, the collection and annotation of…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 Xiaoqi Zhao , Youwei Pang , Lihe Zhang , Huchuan Lu , Xiang Ruan

Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Weiyi Wu , Chongyang Gao , Joseph DiPalma , Soroush Vosoughi , Saeed Hassanpour

Learning visual similarity requires to learn relations, typically between triplets of images. Albeit triplet approaches being powerful, their computational complexity mostly limits training to only a subset of all possible training…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Karsten Roth , Timo Milbich , Björn Ommer

Deep models trained on large-scale RGB image datasets have shown tremendous success. It is important to apply such deep models to real-world problems. However, these models suffer from a performance bottleneck under illumination changes.…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Ibrahim Batuhan Akkaya , Fazil Altinel , Ugur Halici

This paper investigates the impact of sampling and pretraining using datasets with different image characteristics on the performance of self-supervised learning (SSL) models for object classification. To do this, we sample two apartment…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Raynor Kirkson E. Chavez , Kyle Gabriel M. Reynoso

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

Computer Vision and Pattern Recognition · Computer Science 2021-03-26 Yun-Hao Cao , Jianxin Wu

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chathura Wimalasiri

Infrared small object detection urgently requires semi-supervised paradigms due to the high cost of annotation. However, existing methods like SAM face significant challenges of domain gaps, inability of encoding physical priors, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zihan Liu , Xiangning Ren , Dezhang Kong , Yipeng Zhang , Meng Han

Weak supervision learning on classification labels has demonstrated high performance in various tasks, while a few pixel-level fine annotations are also affordable. Naturally a question comes to us that whether the combination of…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Jiahui Li , Wen Chen , Xiaodi Huang , Zhiqiang Hu , Qi Duan , Hongsheng Li , Dimitris N. Metaxas , Shaoting Zhang

Autonomous driving has attracted much attention over the years but turns out to be harder than expected, probably due to the difficulty of labeled data collection for model training. Self-supervised learning (SSL), which leverages unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Kai Chen , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

Small area change detection from synthetic aperture radar (SAR) is a highly challenging task. In this paper, a robust unsupervised approach is proposed for small area change detection from multi-temporal SAR images using deep learning.…

Computer Vision and Pattern Recognition · Computer Science 2020-11-24 Xinzheng Zhang , Hang Su , Ce Zhang , Xiaowei Gu , Xiaoheng Tan , Peter M. Atkinson

Consistency training, which exploits both supervised and unsupervised learning with different augmentations on image, is an effective method of utilizing unlabeled data in semi-supervised learning (SSL) manner. Here, we present another…

Computer Vision and Pattern Recognition · Computer Science 2021-09-01 Juyong Lee , Seunghyuk Cho

While self-supervised learning has been shown to benefit a number of vision tasks, existing techniques mainly focus on image-level manipulation, which may not generalize well to downstream tasks at patch or pixel levels. Moreover, existing…

Computer Vision and Pattern Recognition · Computer Science 2022-08-31 Cheng-Yen Hsieh , Chih-Jung Chang , Fu-En Yang , Yu-Chiang Frank Wang

Self-Supervised learning (SSL) has become the new state-of-art in several domain classification and segmentation tasks. Of these, one popular category in SSL is distillation networks such as BYOL. This work proposes RSDnet, which applies…

Computer Vision and Pattern Recognition · Computer Science 2022-09-09 Pallavi Jain , Bianca Schoen-Phelan , Robert Ross

The difficulties in both data acquisition and annotation substantially restrict the sample sizes of training datasets for 3D medical imaging applications. As a result, constructing high-performance 3D convolutional neural networks from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Shu Zhang , Zihao Li , Hong-Yu Zhou , Jiechao Ma , Yizhou Yu

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix