English
Related papers

Related papers: Revisiting MAE pre-training for 3D medical image s…

200 papers

Despite the impressive progress of self-supervised learning (SSL), its applicability to low-compute networks has received limited attention. Reported performance has trailed behind standard supervised pre-training by a large margin, barring…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Fuwen Tan , Fatemeh Saleh , Brais Martinez

Capsule network is a recent new deep network architecture that has been applied successfully for medical image segmentation tasks. This work extends capsule networks for volumetric medical image segmentation with self-supervised learning.…

Image and Video Processing · Electrical Eng. & Systems 2022-03-30 Minh Tran , Loi Ly , Binh-Son Hua , Ngan Le

Self-supervised learning (SSL) has recently received significant attention due to its ability to train high-performance encoders purely on unlabeled data-often scraped from the internet. This data can still be sensitive and empirical…

Machine Learning · Computer Science 2024-06-19 Wenhao Wang , Muhammad Ahmad Kaleem , Adam Dziedzic , Michael Backes , Nicolas Papernot , Franziska Boenisch

Medical imaging tasks are very challenging due to the lack of publicly available labeled datasets. Hence, it is difficult to achieve high performance with existing deep-learning models as they require a massive labeled dataset to be trained…

Image and Video Processing · Electrical Eng. & Systems 2024-07-23 Anubhav Gupta , Islam Osman , Mohamed S. Shehata , John W. Braun

This paper presents a novel unsupervised segmentation method for 3D medical images. Convolutional neural networks (CNNs) have brought significant advances in image segmentation. However, most of the recent methods rely on supervised…

Computer Vision and Pattern Recognition · Computer Science 2018-04-13 Takayasu Moriya , Holger R. Roth , Shota Nakamura , Hirohisa Oda , Kai Nagara , Masahiro Oda , Kensaku Mori

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting…

Signal Processing · Electrical Eng. & Systems 2022-10-14 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Pre-training strategies based on self-supervised learning (SSL) have proven to be effective pretext tasks for many downstream tasks in computer vision. Due to the significant disparity between medical and natural images, the application of…

The image reconstruction process in medical imaging can be treated as solving an inverse problem. The inverse problem is usually solved using time-consuming iterative algorithms with sparsity or other constraints. Recently, deep neural…

Medical Physics · Physics 2021-10-29 Jingke Zhang , Qiong He , Congzhi Wang , Hongen Liao , Jianwen Luo

Human anatomy is the foundation of medical imaging and boasts one striking characteristic: its hierarchy in nature, exhibiting two intrinsic properties: (1) locality: each anatomical structure is morphologically distinct from the others;…

Computer Vision and Pattern Recognition · Computer Science 2023-09-28 Mohammad Reza Hosseinzadeh Taher , Michael B. Gotway , Jianming Liang

Purpose. Brain Magnetic Resonance Images (MRIs) are essential for the diagnosis of neurological diseases. Recently, deep learning methods for unsupervised anomaly detection (UAD) have been proposed for the analysis of brain MRI. These…

Image and Video Processing · Electrical Eng. & Systems 2021-09-15 Marcel Bengs , Finn Behrendt , Julia Krüger , Roland Opfer , Alexander Schlaefer

Self-Supervised Learning (SSL) methods operate on unlabeled data to learn robust representations useful for downstream tasks. Most SSL methods rely on augmentations obtained by transforming the 2D image pixel map. These augmentations ignore…

Computer Vision and Pattern Recognition · Computer Science 2023-01-30 Sumukh Aithal , Anirudh Goyal , Alex Lamb , Yoshua Bengio , Michael Mozer

Semi-supervised learning (SSL) provides a powerful framework for leveraging unlabeled data when labels are limited or expensive to obtain. SSL algorithms based on deep neural networks have recently proven successful on standard benchmark…

Machine Learning · Computer Science 2019-06-18 Avital Oliver , Augustus Odena , Colin Raffel , Ekin D. Cubuk , Ian J. Goodfellow

Semi-supervised learning has attracted much attention in medical image segmentation due to challenges in acquiring pixel-wise image annotations, which is a crucial step for building high-performance deep learning methods. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2020-10-22 Shuailin Li , Chuyu Zhang , Xuming He

Semi-supervised learning (SSL) has been proven beneficial for mitigating the issue of limited labeled data especially on the task of volumetric medical image segmentation. Unlike previous SSL methods which focus on exploring highly…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Qingjie Zeng , Yutong Xie , Zilin Lu , Mengkang Lu , Yong Xia

Universal sound separation (USS) is a task of separating mixtures of arbitrary sound sources. Typically, universal separation models are trained from scratch in a supervised manner, using labeled data. Self-supervised learning (SSL) is an…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-07 Junqi Zhao , Xubo Liu , Jinzheng Zhao , Yi Yuan , Qiuqiang Kong , Mark D. Plumbley , Wenwu Wang

This paper shows that masked autoencoders (MAE) are scalable self-supervised learners for computer vision. Our MAE approach is simple: we mask random patches of the input image and reconstruct the missing pixels. It is based on two core…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Kaiming He , Xinlei Chen , Saining Xie , Yanghao Li , Piotr Dollár , Ross Girshick

In medical image analysis, the cost of acquiring high-quality data and their annotation by experts is a barrier in many medical applications. Most of the techniques used are based on supervised learning framework and need a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Siladittya Manna , Saumik Bhattacharya , Umapada Pal

Self-supervised learning (SSL) has demonstrated its effectiveness in learning representations through comparison methods that align with human intuition. However, mainstream SSL methods heavily rely on high body datasets with single label,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Jiale Chen

Semi-supervised learning relaxes the need of large pixel-wise labeled datasets for image segmentation by leveraging unlabeled data. The scarcity of high-quality labeled data remains a major challenge in medical image analysis due to the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-11 Jun Li

Acquiring and annotating large datasets in ultrasound imaging is challenging due to low contrast, high noise, and susceptibility to artefacts. This process requires significant time and clinical expertise. Self-supervised learning (SSL)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Edward Ellis , Robert Mendel , Andrew Bulpitt , Nasim Parsa , Michael F Byrne , Sharib Ali