English
Related papers

Related papers: NEMESIS: Noise-suppressed Efficient MAE with Enhan…

200 papers

This study investigates the impact of self-supervised pretraining of 3D semantic segmentation models on a large-scale, domain-specific dataset. We introduce BRAINS-45K, a dataset of 44,756 brain MRI volumes from public sources, the largest…

Image and Video Processing · Electrical Eng. & Systems 2024-08-16 Asbjørn Munk , Jakob Ambsdorf , Sebastian Llambias , Mads Nielsen

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

Transformer architectures, including nnFormer,have demonstrated promising results in volumetric medical image segmentation by being able to capture long-range spatial interactions. Although they have high performance, these models need…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 R. M. Krishna Sureddi , T. Satyanarayana Murthy , Nomula Varsha Reddy , Adi Kanishka , Nalla Manvika Reddy

Masked Autoencoders (MAEs) have emerged as a dominant strategy for self-supervised representation learning in natural images, where models are pre-trained to reconstruct masked patches with a pixel-wise mean squared error (MSE) between…

Image and Video Processing · Electrical Eng. & Systems 2025-07-16 Chetan Madan , Aarjav Satia , Soumen Basu , Pankaj Gupta , Usha Dutta , Chetan Arora

Artificial Intelligence (AI) has the potential to revolutionize diagnosis and segmentation in medical imaging. However, development and clinical implementation face multiple challenges including limited data availability, lack of…

Image and Video Processing · Electrical Eng. & Systems 2025-01-22 Zelong Liu , Andrew Tieu , Nikhil Patel , Georgios Soultanidis , Louisa Deyer , Ying Wang , Sean Huver , Alexander Zhou , Yunhao Mei , Zahi A. Fayad , Timothy Deyer , Xueyan Mei

Masked Image Modeling (MIM) methods, like Masked Autoencoders (MAE), efficiently learn a rich representation of the input. However, for adapting to downstream tasks, they require a sufficient amount of labeled data since their rich features…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Johannes Lehner , Benedikt Alkin , Andreas Fürst , Elisabeth Rumetshofer , Lukas Miklautz , Sepp Hochreiter

Medical image segmentation based on deep learning is often faced with the problems of insufficient datasets and long time-consuming labeling. In this paper, we introduce the self-supervised method MAE(Masked Autoencoders) into knee joint…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Yuhan Xie , Kexin Jiang , Zhiyong Zhang , Shaolong Chen , Xiaodong Zhang , Changzhen Qiu

Low-dose computed tomography (LDCT) offers reduced X-ray radiation exposure but at the cost of compromised image quality, characterized by increased noise and artifacts. Recently, transformer models emerged as a promising avenue to enhance…

Image and Video Processing · Electrical Eng. & Systems 2023-10-20 Dayang Wang , Yongshun Xu , Shuo Han , Zhan Wu , Li Zhou , Bahareh Morovati , Hengyong Yu

Self-supervised models allow (pre-)training on unlabeled data and therefore have the potential to overcome the need for large annotated cohorts. One leading self-supervised model is the masked autoencoder (MAE) which was developed on…

Image and Video Processing · Electrical Eng. & Systems 2023-03-13 Daniel M. Lang , Eli Schwartz , Cosmin I. Bercea , Raja Giryes , Julia A. Schnabel

Machine learning (ML) systems that guarantee security and privacy often rely on Fully Homomorphic Encryption (FHE) as a cornerstone technique, enabling computations on encrypted data without exposing sensitive information. However, a…

Cryptography and Security · Computer Science 2024-12-20 Dongfang Zhao

Supervised deep learning offers great promise to automate analysis of medical images from segmentation to diagnosis. However, their performance highly relies on the quality and quantity of the data annotation. Meanwhile, curating large…

Image and Video Processing · Electrical Eng. & Systems 2023-09-19 Yuyue Zhou , Jessica Knight , Banafshe Felfeliyan , Christopher Keen , Abhilash Rakkunedeth Hareendranathan , Jacob L. Jaremko

Automated analysis of surgical videos is crucial for improving surgical training, workflow optimization, and postoperative assessment. We introduce a CSMAE, Masked Autoencoder (MAE)-based pretraining approach, specifically developed for…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Nisarg A. Shah , Wele Gedara Chaminda Bandara , Shameema Skider , S. Swaroop Vedula , Vishal M. Patel

Accurate segmentation of anatomical structures in ultrasound (US) images, particularly small ones, is challenging due to noise and variability in imaging conditions (e.g., probe position, patient anatomy, tissue characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Danielle L. Ferreira , Ahana Gangopadhyay , Hsi-Ming Chang , Ravi Soni , Gopal Avinash

The application of self-supervised learning (SSL) and Vision Transformers (ViTs) approaches demonstrates promising results in the field of 2D medical imaging, but the use of these methods on 3D volumetric images is fraught with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-29 Evgeny Alves Limarenko , Anastasiia Studenikina

Accurate detection and localization of traumatic injuries in abdominal CT scans remains a critical challenge in emergency radiology, primarily due to severe scarcity of annotated medical data. This paper presents a label-efficient approach…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Shivam Chaudhary , Sheethal Bhat , Andreas Maier

Noisy labels, inevitably existing in pseudo segmentation labels generated from weak object-level annotations, severely hampers model optimization for semantic segmentation. Previous works often rely on massive hand-crafted losses and…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Shenwang Jiang , Jianan Li , Ying Wang , Wenxuan Wu , Jizhou Zhang , Bo Huang , Tingfa Xu

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

Self-supervised learning (SSL) opens up huge opportunities for medical image analysis that is well known for its lack of annotations. However, aggregating massive (unlabeled) 3D medical images like computerized tomography (CT) remains…

Computer Vision and Pattern Recognition · Computer Science 2022-08-17 Yutong Xie , Jianpeng Zhang , Yong Xia , Qi Wu

Despite that deep learning has achieved state-of-the-art performance for medical image segmentation, its success relies on a large set of manually annotated images for training that are expensive to acquire. In this paper, we propose an…

Image and Video Processing · Electrical Eng. & Systems 2021-01-01 Lu Wang , Dong Guo , Guotai Wang , Shaoting Zhang

Instance segmentation is a fundamental research in computer vision, especially in autonomous driving. However, manual mask annotation for instance segmentation is quite time-consuming and costly. To address this problem, some prior works…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Guangfeng Jiang , Jun Liu , Yuzhi Wu , Wenlong Liao , Tao He , Pai Peng