English
Related papers

Related papers: MedMAE: A Self-Supervised Backbone for Medical Ima…

200 papers

The need for a large amount of labeled data in the supervised setting has led recent studies to utilize self-supervised learning to pre-train deep neural networks using unlabeled data. Many self-supervised training strategies have been…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Mojtaba Bahrami , Mahsa Ghorbani , Nassir Navab

Recently, self-supervised Masked Autoencoders (MAE) have attracted unprecedented attention for their impressive representation learning ability. However, the pretext task, Masked Image Modeling (MIM), reconstructs the missing local patches,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Feng Liang , Yangguang Li , Diana Marculescu

Masked Image Modeling (MIM)-based models, such as SdAE, CAE, GreenMIM, and MixAE, have explored different strategies to enhance the performance of Masked Autoencoders (MAE) by modifying prediction, loss functions, or incorporating…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Srinivasa Rao Nandam , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

The accurate segmentation of lesions in whole-body PET/CT imaging is es-sential for tumor characterization, treatment planning, and response assess-ment, yet current manual workflows are labor-intensive and prone to inter-observer…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Moona Mazher , Steven A Niederer , Abdul Qayyum

Self-supervised learning (SSL) has achieved remarkable performance in various medical imaging tasks by dint of priors from massive unlabelled data. However, regarding a specific downstream task, there is still a lack of an instruction book…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Chuyan Zhang , Yun Gu

Increasingly many real world tasks involve data in multiple modalities or views. This has motivated the development of many effective algorithms for learning a common latent space to relate multiple domains. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2017-11-17 Tanmoy Mukherjee , Makoto Yamada , Timothy M. Hospedales

Pre-training a recognition model with contrastive learning on a large dataset of unlabeled data has shown great potential to boost the performance of a downstream task, e.g., image classification. However, in domains such as medical…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Jizong Peng , Ping Wang , Chrisitian Desrosiers , Marco Pedersoli

Masked Autoencoders (MAE) based on a reconstruction task have risen to be a promising paradigm for self-supervised learning (SSL) and achieve state-of-the-art performance across different benchmark datasets. However, despite its impressive…

Machine Learning · Computer Science 2023-03-28 Qi Zhang , Yifei Wang , Yisen Wang

Background and objective: Employing deep learning models in critical domains such as medical imaging poses challenges associated with the limited availability of training data. We present a strategy for improving the performance and…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Eva Pachetti , Sotirios A. Tsaftaris , Sara Colantonio

Masked Autoencoder~(MAE) is a prevailing self-supervised learning method that achieves promising results in model pre-training. However, when the various downstream tasks have data distributions different from the pre-training data, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-09 Zhili Liu , Kai Chen , Jianhua Han , Lanqing Hong , Hang Xu , Zhenguo Li , James T. Kwok

The coronavirus pandemic has been going on since the year 2019, and the trend is still not abating. Therefore, it is particularly important to classify medical CT scans to assist in medical diagnosis. At present, Supervised Deep Learning…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Jiashu Xu , Sergii Stirenko

Generalizing learned representations across significantly different visual domains is a fundamental yet crucial ability of the human visual system. While recent self-supervised learning methods have achieved good performances with…

Computer Vision and Pattern Recognition · Computer Science 2022-06-07 Haiyang Yang , Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Lei Bai , Rui Zhao , Wanli Ouyang

Deep neural networks are powerful tools for biomedical image segmentation. These models are often trained with heavy supervision, relying on pairs of images and corresponding voxel-level labels. However, obtaining segmentations of…

Image and Video Processing · Electrical Eng. & Systems 2020-04-30 Evan M. Yu , Juan Eugenio Iglesias , Adrian V. Dalca , Mert R. Sabuncu

Deep learning models have become the dominant method for medical image segmentation. However, they often struggle to be generalisable to unknown tasks involving new anatomical structures, labels, or shapes. In these cases, the model needs…

Image and Video Processing · Electrical Eng. & Systems 2024-09-17 Jing Xu

Bioacoustic recognition requires fine-grained acoustic understanding to distinguish similar-sounding species. However, many large-scale data repositories such as iNaturalist are weakly annotated, often with only a single positive species…

Sound · Computer Science 2026-05-15 Wuao Liu , Mustafa Chasmai , Subhransu Maji , Grant Van Horn

Deep neural networks are vulnerable to backdoor attacks, where an adversary manipulates the model behavior through overlaying images with special triggers. Existing backdoor defense methods often require accessing a few validation data and…

Machine Learning · Computer Science 2025-08-20 Tao Sun , Lu Pang , Weimin Lyu , Chao Chen , Haibin Ling

Mask-based pretraining has become a cornerstone of modern large-scale models across language, vision, and recently biology. Despite its empirical success, its role and limits in learning data representations have been unclear. In this work,…

Machine Learning · Computer Science 2025-09-29 Mingze Dong , Leda Wang , Yuval Kluger

While self-supervised learning (SSL) algorithms have been widely used to pre-train deep models, few efforts [11] have been done to improve representation learning of X-ray image analysis with SSL pre-trained models. In this work, we study a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Weibin Liao , Haoyi Xiong , Qingzhong Wang , Yan Mo , Xuhong Li , Yi Liu , Zeyu Chen , Siyu Huang , Dejing Dou

Self-supervised learning methods like masked autoencoders (MAE) have shown significant promise in learning robust feature representations, particularly in image reconstruction-based pretraining task. However, their performance is often…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Sua Lee , Joonhun Lee , Myungjoo Kang