English
Related papers

Related papers: How Transferable Are Self-supervised Features in M…

200 papers

In contrast to fully-supervised models, self-supervised representation learning only needs a fraction of data to be labeled and often achieves the same or even higher downstream performance. The goal is to pre-train deep neural networks on…

Machine Learning · Computer Science 2025-04-09 Friederike Baier , Sebastian Mair , Samuel G. Fadel

Recent self-supervised representation learning techniques have largely closed the gap between supervised and unsupervised learning on ImageNet classification. While the particulars of pretraining on ImageNet are now relatively well…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Elijah Cole , Xuan Yang , Kimberly Wilber , Oisin Mac Aodha , Serge Belongie

Recent approaches leveraging multi-modal pre-trained models like CLIP for Unsupervised Domain Adaptation (UDA) have shown significant promise in bridging domain gaps and improving generalization by utilizing rich semantic knowledge and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-16 Tung-Long Vuong , Hoang Phan , Vy Vo , Anh Bui , Thanh-Toan Do , Trung Le , Dinh Phung

Recent advances in deep learning have shown that learning robust feature representations is critical for the success of many computer vision tasks, including medical image segmentation. In particular, both transformer and…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 David Li , Anvar Kurmukov , Mikhail Goncharov , Roman Sokolov , Mikhail Belyaev

Hyperspectral imaging is a rich source of data, allowing for multitude of effective applications. However, such imaging remains challenging because of large data dimension and, typically, small pool of available training examples. While…

Neural and Evolutionary Computing · Computer Science 2020-10-23 Wojciech Masarczyk , Przemysław Głomb , Bartosz Grabowski , Mateusz Ostaszewski

Limited labeled data makes it hard to train models from scratch in medical domain, and an important paradigm is pre-training and then fine-tuning. Large pre-trained models contain rich representations, which can be adapted to downstream…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Along He , Kai Wang , Zhihong Wang , Tao Li , Huazhu Fu

In self-supervised learning, a model is trained to solve a pretext task, using a data set whose annotations are created by a machine. The objective is to transfer the trained weights to perform a downstream task in the target domain. We…

Machine Learning · Computer Science 2021-10-22 Prathamesh Sonawane , Sparsh Drolia , Saqib Shamsi , Bhargav Jain

Deep neural networks trained on a wide range of datasets demonstrate impressive transferability. Deep features appear general in that they are applicable to many datasets and tasks. Such property is in prevalent use in real-world…

Machine Learning · Computer Science 2019-09-27 Hong Liu , Mingsheng Long , Jianmin Wang , Michael I. Jordan

The development of mobile and on the edge applications that embed deep convolutional neural models has the potential to revolutionise biomedicine. However, most deep learning models require computational resources that are not available in…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Adrián Inés , Andrés Díaz-Pinto , César Domínguez , Jónathan Heras , Eloy Mata , Vico Pascual

The application of deep learning-based architecture has seen a tremendous rise in recent years. For example, medical image classification using deep learning achieved breakthrough results. Convolutional Neural Networks (CNNs) are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-23 Ganga Prasad Basyal , David Zeng , Bhaskar Pm Rimal

Deep convolutional neural networks have achieved remarkable progress on a variety of medical image computing tasks. A common problem when applying supervised deep learning methods to medical images is the lack of labeled data, which is very…

Computer Vision and Pattern Recognition · Computer Science 2020-05-12 Xiaomeng Li , Lequan Yu , Hao Chen , Chi-Wing Fu , Lei Xing , Pheng-Ann Heng

The success of self-supervised learning (SSL) has mostly been attributed to the availability of unlabeled yet large-scale datasets. However, in a specialized domain such as medical imaging which is a lot different from natural images, the…

Computer Vision and Pattern Recognition · Computer Science 2023-06-30 Soumitri Chattopadhyay , Soham Ganguly , Sreejit Chaudhury , Sayan Nag , Samiran Chattopadhyay

Risk stratification (characterization) of tumors from radiology images can be more accurate and faster with computer-aided diagnosis (CAD) tools. Tumor characterization through such tools can also enable non-invasive cancer staging,…

Computer Vision and Pattern Recognition · Computer Science 2019-01-21 Sarfaraz Hussein , Pujan Kandel , Candice W. Bolan , Michael B. Wallace , Ulas Bagci

Recently, self-supervised learning has attracted attention due to its remarkable ability to acquire meaningful representations for classification tasks without using semantic labels. This paper introduces a self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2022-02-09 Hyungtae Lee , Heesung Kwon

Tissue characterization has long been an important component of Computer Aided Diagnosis (CAD) systems for automatic lesion detection and further clinical planning. Motivated by the superior performance of deep learning methods on various…

Computer Vision and Pattern Recognition · Computer Science 2021-03-24 Xiang Li , Aoxiao Zhong , Ming Lin , Ning Guo , Mu Sun , Arkadiusz Sitek , Jieping Ye , James Thrall , Quanzheng Li

In this project, competition-winning deep neural networks with pretrained weights are used for image-based gender recognition and age estimation. Transfer learning is explored using both VGG19 and VGGFace pretrained models by testing the…

Computer Vision and Pattern Recognition · Computer Science 2018-11-20 Philip Smith , Cuixian Chen

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

Transfer learning leverages pre-trained model features from a large dataset to save time and resources when training new models for various tasks, potentially enhancing performance. Due to the lack of large datasets in the medical imaging…

Image and Video Processing · Electrical Eng. & Systems 2023-11-10 Gabriel Efrain Humpire-Mamani , Colin Jacobs , Mathias Prokop , Bram van Ginneken , Nikolas Lessmann

The pretrain-finetune paradigm is a classical pipeline in visual learning. Recent progress on unsupervised pretraining methods shows superior transfer performance to their supervised counterparts. This paper revisits this phenomenon and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yizhou Wang , Shixiang Tang , Feng Zhu , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Datasets from single-molecule experiments often reflect a large variety of molecular behaviour. The exploration of such datasets can be challenging, especially if knowledge about the data is limited and a priori assumptions about expected…

Data Analysis, Statistics and Probability · Physics 2020-04-06 Anton Vladyka , Tim Albrecht