English
Related papers

Related papers: Revisiting MAE pre-training for 3D medical image s…

200 papers

Transformer architectures, including nnFormer,have demonstrated promising results in volumetric medical image segmentation by being able to capture long-range spatial interactions. Although they have high performance, these models need…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 R. M. Krishna Sureddi , T. Satyanarayana Murthy , Nomula Varsha Reddy , Adi Kanishka , Nalla Manvika Reddy

Self-supervised learning (SSL) has emerged as a promising paradigm for addressing the annotation bottleneck in medical imaging by learning representations from unlabeled data. However, its effectiveness depends heavily on the design of the…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Chathura Wimalasiri

Semi-supervised learning (SSL) is a promising machine learning paradigm to address the issue of label scarcity in medical imaging. SSL methods were originally developed in image classification. The state-of-the-art SSL methods in image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mou-Cheng Xu , Yukun Zhou , Chen Jin , Marius De Groot , Neil P. Oxtoby , Daniel C. Alexander , Joseph Jacob

Traditional supervised 3D medical image segmentation models need voxel-level annotations, which require huge human effort, time, and cost. Semi-supervised learning (SSL) addresses this limitation of supervised learning by facilitating…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Suruchi Kumari , Aryan Das , Swalpa Kumar Roy , Indu Joshi , Pravendra Singh

Vision Transformer (ViT) suffers from data scarcity in semi-supervised learning (SSL). To alleviate this issue, inspired by masked autoencoder (MAE), which is a data-efficient self-supervised learner, we propose Semi-MAE, a pure ViT-based…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Haojie Yu , Kang Zhao , Xiaoming Xu

Consensus amongst researchers and industry points to a lack of large, representative annotated datasets as the biggest obstacle to progress in the field of surgical data science. Advances in Self-Supervised Learning (SSL) represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Deepak Alapatt , Aditya Murali , Vinkle Srivastav , Pietro Mascagni , AI4SafeChole Consortium , Nicolas Padoy

Self-supervised learning (SSL) has drawn increasing attention in histopathological image analysis in recent years. Compared to contrastive learning which is troubled with the false negative problem, i.e., semantically similar images are…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Yang Luo , Zhineng Chen , Shengtian Zhou , Xieping Gao

Though self-supervised learning (SSL) has demonstrated incredible ability to learn robust representations from unlabeled data, the choice of optimal SSL strategy can lead to vastly different performance outcomes in specialized domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Vedrana Ivezić , Mara Pleasure , Ashwath Radhachandran , Saarang Panchavati , Shreeram Athreya , Vivek Sant , Benjamin Emert , Gregory Fishbein , Corey Arnold , William Speier

The coronavirus pandemic has been going on since the year 2019, and the trend is still not abating. Therefore, it is particularly important to classify medical CT scans to assist in medical diagnosis. At present, Supervised Deep Learning…

Image and Video Processing · Electrical Eng. & Systems 2022-10-12 Jiashu Xu , Sergii Stirenko

Automatic and accurate tumor segmentation on medical images is in high demand to assist physicians with diagnosis and treatment. However, it is difficult to obtain massive amounts of annotated training data required by the deep-learning…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Xiaoman Zhang , Shixiang Feng , Yuhang Zhou , Ya Zhang , Yanfeng Wang

Deep learning-based semi-supervised learning (SSL) algorithms have led to promising results in medical images segmentation and can alleviate doctors' expensive annotations by leveraging unlabeled data. However, most of the existing SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiangde Luo , Jieneng Chen , Tao Song , Yinan Chen , Guotai Wang , Shaoting Zhang

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

Machine Learning · Computer Science 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma

Automated disease diagnosis using medical image analysis relies on deep learning, often requiring large labeled datasets for supervised model training. Diseases like Acute Myeloid Leukemia (AML) pose challenges due to scarce and costly…

Computer Vision and Pattern Recognition · Computer Science 2024-08-26 Salome Kazeminia , Max Joosten , Dragan Bosnacki , Carsten Marr

Early cancer detection is crucial for prognosis, but many cancer types lack large labelled datasets required for developing deep learning models. This paper investigates self-supervised learning (SSL) as an alternative to the standard…

Image and Video Processing · Electrical Eng. & Systems 2024-11-27 Hamish Haggerty , Rohitash Chandra

The field of surgical computer vision has undergone considerable breakthroughs in recent years with the rising popularity of deep neural network-based methods. However, standard fully-supervised approaches for training such models require…

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG), where labeling can be…

Machine Learning · Statistics 2020-08-03 Hubert Banville , Omar Chehab , Aapo Hyvärinen , Denis-Alexander Engemann , Alexandre Gramfort

Constructing large-scale labeled datasets for multi-modal perception model training in autonomous driving presents significant challenges. This has motivated the development of self-supervised pretraining strategies. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Xiaohao Xu , Ye Li , Tianyi Zhang , Jinrong Yang , Matthew Johnson-Roberson , Xiaonan Huang

3D medical image segmentation methods have been successful, but their dependence on large amounts of voxel-level annotated data is a disadvantage that needs to be addressed given the high cost to obtain such annotation. Semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Yuyuan Liu , Yu Tian , Chong Wang , Yuanhong Chen , Fengbei Liu , Vasileios Belagiannis , Gustavo Carneiro

Ultrasound (US) imaging is clinically invaluable due to its noninvasive and safe nature. However, interpreting US images is challenging, requires significant expertise, and time, and is often prone to errors. Deep learning offers assistive…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Edward Ellis , Andrew Bulpitt , Nasim Parsa , Michael F Byrne , Sharib Ali