English
Related papers

Related papers: MedMAE: A Self-Supervised Backbone for Medical Ima…

200 papers

Like masked language modeling (MLM) in natural language processing, masked image modeling (MIM) aims to extract valuable insights from image patches to enhance the feature extraction capabilities of the underlying deep neural network (DNN).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yixuan Luo , Mengye Ren , Sai Qian Zhang

Medical image segmentation remains a formidable challenge due to the label scarcity. Pre-training Vision Transformer (ViT) through masked image modeling (MIM) on large-scale unlabeled medical datasets presents a promising solution,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Fenghe Tang , Qingsong Yao , Wenxin Ma , Chenxu Wu , Zihang Jiang , S. Kevin Zhou

Transfer learning has become a powerful tool to initialize deep learning models to achieve faster convergence and higher performance. This is especially useful in the medical imaging analysis domain, where data scarcity limits possible…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Ibrahim Almakky , Santosh Sanjeev , Anees Ur Rehman Hashmi , Mohammad Areeb Qazi , Hu Wang , Mohammad Yaqub

Inspired by the masked language modeling (MLM) in natural language processing tasks, the masked image modeling (MIM) has been recognized as a strong self-supervised pre-training method in computer vision. However, the high random mask ratio…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhaowen Li , Yousong Zhu , Zhiyang Chen , Wei Li , Chaoyang Zhao , Rui Zhao , Ming Tang , Jinqiao Wang

Deep learning has received extensive research interest in developing new medical image processing algorithms, and deep learning based models have been remarkably successful in a variety of medical imaging tasks to support disease detection…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Xuxin Chen , Ximin Wang , Ke Zhang , Kar-Ming Fung , Theresa C. Thai , Kathleen Moore , Robert S. Mannel , Hong Liu , Bin Zheng , Yuchen Qiu

Data reconstruction is a widely used pre-training task to learn the generalized features for many downstream tasks. Although reconstruction tasks have been applied to neural signal completion and denoising, neural signal reconstruction is…

Neurons and Cognition · Quantitative Biology 2024-07-02 Youzhi Qu , Junfeng Xia , Xinyao Jian , Wendu Li , Kaining Peng , Zhichao Liang , Haiyan Wu , Quanying Liu

Intracranial aneurysms are a major cause of morbidity and mortality worldwide, and detecting them manually is a complex, time-consuming task. Albeit automated solutions are desirable, the limited availability of training data makes it…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Alberto Mario Ceballos-Arroyo , Jisoo Kim , Chu-Hsuan Lin , Lei Qin , Geoffrey S. Young , Huaizu Jiang

The rapid evolution of deep learning has significantly advanced the field of medical image analysis. However, despite these achievements, the further enhancement of deep learning models for medical image analysis faces a significant…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Suruchi Kumari , Pravendra Singh

Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks via randomly masking image patches and reconstruction. However, effective data augmentation strategies for MAE still remain open questions, different…

Computer Vision and Pattern Recognition · Computer Science 2024-02-08 Kai Chen , Zhili Liu , Lanqing Hong , Hang Xu , Zhenguo Li , Dit-Yan Yeung

The development of medical science greatly depends on the increased utilization of machine learning algorithms. By incorporating machine learning, the medical imaging field can significantly improve in terms of the speed and accuracy of the…

Image and Video Processing · Electrical Eng. & Systems 2024-09-01 Angona Biswas , MD Abdullah Al Nasim , Md Shahin Ali , Ismail Hossain , Md Azim Ullah , Sajedul Talukder

Deep learning models have gained remarkable performance on a variety of image classification tasks. However, many models suffer from limited performance in clinical or medical settings when data are imbalanced. To address this challenge, we…

Image and Video Processing · Electrical Eng. & Systems 2022-04-15 Long Gao , Chang Liu , Dooman Arefan , Ashok Panigrahy , Margarita L. Zuley , Shandong Wu

Continual learning protocols are attracting increasing attention from the medical imaging community. In continual environments, datasets acquired under different conditions arrive sequentially; and each is only available for a limited…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Camila Gonzalez , Nick Lemke , Georgios Sakas , Anirban Mukhopadhyay

Deep learning-based image processing is capable of creating highly appealing results. However, it is still widely considered as a "blackbox" transformation. In medical imaging, this lack of comprehensibility of the results is a sensitive…

Image and Video Processing · Electrical Eng. & Systems 2020-05-29 Bernhard Stimpel , Christopher Syben , Franziska Schirrmacher , Philipp Hoelter , Arnd Dörfler , Andreas Maier

Deep learning has demonstrated remarkable performance across various tasks in medical imaging. However, these approaches primarily focus on supervised learning, assuming that the training and testing data are drawn from the same…

Image and Video Processing · Electrical Eng. & Systems 2023-08-03 Suruchi Kumari , Pravendra Singh

Pretraining and fine-tuning have emerged as a new paradigm in remote sensing image interpretation. Among them, Masked Autoencoder (MAE)-based pretraining stands out for its strong capability to learn general feature representations via…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Xiaokang Zhang , Bo Li , Chufeng Zhou , Weikang Yu , Lefei Zhang

This study explores the application of self-supervised learning (SSL) to the task of motion forecasting, an area that has not yet been extensively investigated despite the widespread success of SSL in computer vision and natural language…

Robotics · Computer Science 2023-08-22 Jie Cheng , Xiaodong Mei , Ming Liu

While the field of medical image analysis has undergone a transformative shift with the integration of machine learning techniques, the main challenge of these techniques is often the scarcity of large, diverse, and well-annotated datasets.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Stefano Woerner , Arthur Jaques , Christian F. Baumgartner

In the field of medical image segmentation, challenges such as indistinct lesion features, ambiguous boundaries,and multi-scale characteristics have long revailed. This paper proposes an improved method named Intensity-Spatial Dual Masked…

Image and Video Processing · Electrical Eng. & Systems 2025-02-17 Yuexing Ding , Jun Wang , Hongbing Lyu

Over the past few years, the rapid development of deep learning technologies for computer vision has significantly improved the performance of medical image segmentation (MedISeg). However, the diverse implementation strategies of various…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Dong Zhang , Yi Lin , Hao Chen , Zhuotao Tian , Xin Yang , Jinhui Tang , Kwang Ting Cheng

Anomaly detection in medical images is a challenging task, since anomalies are not typically available during training. Recent methods leverage a single pretext task coupled with a large-scale pre-trained model to reach state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Bogdan Alexandru Bercean , Florinel Alin Croitoru , Vlad Hondru , Ciprian Mihai Ceausescu , Andreea Iuliana Ionescu , Radu Tudor Ionescu