English
Related papers

Related papers: Generalization of Self-Supervised Vision Transform…

200 papers

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

The accuracy and robustness of image classification with supervised deep learning are dependent on the availability of large-scale, annotated training data. However, there is a paucity of annotated data available due to the complexity of…

Computer Vision and Pattern Recognition · Computer Science 2019-03-27 Euijoon Ahn , Ashnil Kumar , Dagan Feng , Michael Fulham , Jinman Kim

Deep learning models exhibit limited generalizability across different domains. Specifically, transferring knowledge from available entangled domain features(source/target domain) and categorical features to new unseen categorical features…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Qingjie Meng , Daniel Rueckert , Bernhard Kainz

Accurate localization of proteins from fluorescence microscopy images is challenging due to the inter-class similarities and intra-class disparities introducing grave concerns in addressing multi-class classification problems. Conventional…

Computer Vision and Pattern Recognition · Computer Science 2021-10-11 Muhammad Tahir , Saeed Anwar , Ajmal Mian , Abdul Wahab Muzaffar

Despite the progress in cross-domain few-shot learning, a model pre-trained with DINO combined with a prototypical classifier outperforms the latest SOTA methods. A crucial limitation that needs to be overcome is that updating too many…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Naeem Paeedeh , Mahardhika Pratama , Imam Mustafa Kamal , Wolfgang Mayer , Jimmy Cao , Ryszard Kowlczyk

Large-scale labeled training datasets have enabled deep neural networks to excel across a wide range of benchmark vision tasks. However, in many applications, it is prohibitively expensive and time-consuming to obtain large quantities of…

Computer Vision and Pattern Recognition · Computer Science 2020-09-22 Sicheng Zhao , Xiangyu Yue , Shanghang Zhang , Bo Li , Han Zhao , Bichen Wu , Ravi Krishna , Joseph E. Gonzalez , Alberto L. Sangiovanni-Vincentelli , Sanjit A. Seshia , Kurt Keutzer

This work presents a novel label-efficient selfsupervised representation learning-based approach for classifying diabetic retinopathy (DR) images in cross-domain settings. Most of the existing DR image classification methods are based on…

Image and Video Processing · Electrical Eng. & Systems 2023-04-25 Ekta Gupta , Varun Gupta , Muskaan Chopra , Prakash Chandra Chhipa , Marcus Liwicki

Small Object Detection (SOD) poses significant challenges due to limited information and the model's low class prediction score. While Transformer-based detectors have shown promising performance, their potential for SOD remains largely…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Guiping Cao , Wenjian Huang , Xiangyuan Lan , Jianguo Zhang , Dongmei Jiang , Yaowei Wang

The success of deep learning in medical imaging is mostly achieved at the cost of a large labeled data set. Semi-supervised learning (SSL) provides a promising solution by leveraging the structure of unlabeled data to improve learning from…

Machine Learning · Computer Science 2019-07-24 Prashnna Kumar Gyawali , Zhiyuan Li , Sandesh Ghimire , Linwei Wang

Domain adaptation (DA) is a representation learning methodology that transfers knowledge from a label-sufficient source domain to a label-scarce target domain. While most of early methods are focused on unsupervised DA (UDA), several…

Computer Vision and Pattern Recognition · Computer Science 2021-04-02 Yoonhyung Kim , Changick Kim

The field of self-supervised learning (SSL) for 3D medical images lacks consistency and standardization. While many methods have been developed, it is impossible to identify the current state-of-the-art, due to i) varying and small…

Computer Vision and Pattern Recognition · Computer Science 2025-04-21 Tassilo Wald , Constantin Ulrich , Jonathan Suprijadi , Sebastian Ziegler , Michal Nohel , Robin Peretzke , Gregor Köhler , Klaus H. Maier-Hein

Recent advances in whole-slide image (WSI) scanners and computational capabilities have significantly propelled the application of artificial intelligence in histopathology slide analysis. While these strides are promising, current…

Computer Vision and Pattern Recognition · Computer Science 2023-11-15 Weiyi Wu , Chongyang Gao , Joseph DiPalma , Soroush Vosoughi , Saeed Hassanpour

Continued pretraining offers a promising solution for adapting foundation models to a new target domain. However, in specialized domains, available datasets are often very small, limiting the applicability of SSL methods developed for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-10 Bryan Rodas , Natalie Montesino , Jakob Ambsdorf , David Klindt , Randall Balestriero

Generalising deep models to new data from new centres (termed here domains) remains a challenge. This is largely attributed to shifts in data statistics (domain shifts) between source and unseen domains. Recently, gradient-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-05 Xiao Liu , Spyridon Thermos , Alison O'Neil , Sotirios A. Tsaftaris

A significant issue in training deep neural networks to solve supervised learning tasks is the need for large numbers of labelled datapoints. The goal of semi-supervised learning is to leverage ubiquitous unlabelled data, together with…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Chengxu Zhuang , Xuehao Ding , Divyanshu Murli , Daniel Yamins

This paper investigates the effectiveness of self-supervised pre-trained vision transformers (ViTs) compared to supervised pre-trained ViTs and conventional neural networks (ConvNets) for detecting facial deepfake images and videos. It…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Huy H. Nguyen , Junichi Yamagishi , Isao Echizen

Transferring the weights of a pre-trained model to assist another task has become a crucial part of modern deep learning, particularly in data-scarce scenarios. Pre-training refers to the initial step of training models outside the current…

Machine Learning · Computer Science 2024-04-29 Houtan Ghaffari , Paul Devos

We propose a semi-supervised network for wide-angle portraits correction. Wide-angle images often suffer from skew and distortion affected by perspective distortion, especially noticeable at the face regions. Previous deep learning based…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Fushun Zhu , Shan Zhao , Peng Wang , Hao Wang , Hua Yan , Shuaicheng Liu

Self-supervised pretraining has been observed to be effective at improving feature representations for transfer learning, leveraging large amounts of unlabelled data. This review summarizes recent research into its usage in X-ray, computed…

Machine Learning · Computer Science 2023-09-07 Blake VanBerlo , Jesse Hoey , Alexander Wong

Although well-known large-scale datasets, such as ImageNet, have driven image understanding forward, most of these datasets require extensive manual annotation and are thus not easily scalable. This limits the advancement of image…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Jean Lahoud , Bernard Ghanem