English
Related papers

Related papers: Masked Image Modeling Advances 3D Medical Image An…

200 papers

Within the domain of medical analysis, extensive research has explored the potential of mutual learning between Masked Autoencoders(MAEs) and multimodal data. However, the impact of MAEs on intermodality remains a key challenge. We…

Image and Video Processing · Electrical Eng. & Systems 2024-06-03 Lei Li , Tianfang Zhang , Xinglin Zhang , Jiaqi Liu , Bingqi Ma , Yan Luo , Tao Chen

Semi-supervised learning is of great significance in medical image segmentation by exploiting unlabeled data. Among its strategies, the co-training framework is prominent. However, previous co-training studies predominantly concentrate on…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Pengcheng Zhou , Lantian Zhang , Wei Li

Interpretation of medical images for diagnosis and treatment of complex disease from high-dimensional and heterogeneous data remains a key challenge in transforming healthcare. In the last few years, both supervised and unsupervised deep…

Image and Video Processing · Electrical Eng. & Systems 2018-12-20 Khalid Raza , Nripendra Kumar Singh

The need for a large amount of labeled data in the supervised setting has led recent studies to utilize self-supervised learning to pre-train deep neural networks using unlabeled data. Many self-supervised training strategies have been…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Mojtaba Bahrami , Mahsa Ghorbani , Nassir Navab

Masked image modeling (MIM) has emerged as a promising approach for pre-training Vision Transformers (ViTs). MIMs predict masked tokens token-wise to recover target signals that are tokenized from images or generated by pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Taekyung Kim , Byeongho Heo , Dongyoon Han

This work proposes a semantic segmentation network that produces high-quality uncertainty estimates in a single forward pass. We exploit general representations from foundation models and unlabelled datasets through a Masked Image Modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 David S. W. Williams , Matthew Gadd , Paul Newman , Daniele De Martini

It can be challenging to identify brain MRI anomalies using supervised deep-learning techniques due to anatomical heterogeneity and the requirement for pixel-level labeling. Unsupervised anomaly detection approaches provide an alternative…

Image and Video Processing · Electrical Eng. & Systems 2023-08-30 Hasan Iqbal , Umar Khalid , Jing Hua , Chen Chen

Masked Image Modeling (MIM) has achieved significant success in the realm of self-supervised learning (SSL) for visual recognition. The image encoder pre-trained through MIM, involving the masking and subsequent reconstruction of input…

Cryptography and Security · Computer Science 2024-08-14 Zheng Li , Xinlei He , Ning Yu , Yang Zhang

Humans exhibit a remarkable ability to learn quickly from a limited number of labeled samples, a capability that starkly contrasts with that of current machine learning systems. Unsupervised Few-Shot Learning (U-FSL) seeks to bridge this…

Computer Vision and Pattern Recognition · Computer Science 2024-08-27 Zhenyu Zhang , Guangyao Chen , Yixiong Zou , Zhimeng Huang , Yuhua Li , Ruixuan Li

In the realm of self-supervised learning (SSL), masked image modeling (MIM) has gained popularity alongside contrastive learning methods. MIM involves reconstructing masked regions of input images using their unmasked portions. A notable…

Machine Learning · Computer Science 2024-07-15 Tianqi Du , Yifei Wang , Yisen Wang

Self-supervised learning has become a popular approach in recent years for its ability to learn meaningful representations without the need for data annotation. This paper proposes a novel image augmentation technique, overlaying images,…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Yinheng Li , Han Ding , Shaofei Wang

Image recognition techniques heavily rely on abundant labeled data, particularly in medical contexts. Addressing the challenges associated with obtaining labeled data has led to the prominence of self-supervised learning and semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Hao Feng , Yuanzhe Jia , Ruijia Xu , Mukesh Prasad , Ali Anaissi , Ali Braytee

Masked Image Modeling (MIM) has emerged as a promising approach for Self-Supervised Learning (SSL) of visual representations. However, the out-of-the-box performance of MIMs is typically inferior to competing approaches. Most users cannot…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Marcin Przewięźlikowski , Randall Balestriero , Wojciech Jasiński , Marek Śmieja , Bartosz Zieliński

The performance of existing supervised neuron segmentation methods is highly dependent on the number of accurate annotations, especially when applied to large scale electron microscopy (EM) data. By extracting semantic information from…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Yinda Chen , Wei Huang , Shenglong Zhou , Qi Chen , Zhiwei Xiong

Multi-modal magnetic resonance imaging (MRI) provides information of lesions for computer-aided diagnosis from different views. Deep learning algorithms are suitable for identifying specific anatomical structures, segmenting lesions, and…

Image and Video Processing · Electrical Eng. & Systems 2025-01-17 Linxuan Han , Sa Xiao , Zimeng Li , Haidong Li , Xiuchao Zhao , Yeqing Han , Fumin Guo , Xin Zhou

Traditional supervised medical image segmentation models require large amounts of labeled data for training; however, obtaining such large-scale labeled datasets in the real world is extremely challenging. Recent semi-supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Yunyao Lu , Yihang Wu , Reem Kateb , Ahmad Chaddad

The difficulties in both data acquisition and annotation substantially restrict the sample sizes of training datasets for 3D medical imaging applications. As a result, constructing high-performance 3D convolutional neural networks from…

Image and Video Processing · Electrical Eng. & Systems 2022-01-06 Shu Zhang , Zihao Li , Hong-Yu Zhou , Jiechao Ma , Yizhou Yu

We investigate the effectiveness of a simple solution to the common problem of deep learning in medical image analysis with limited quantities of labeled training data. The underlying idea is to assign artificial labels to abundantly…

Computer Vision and Pattern Recognition · Computer Science 2019-01-28 Nima Tajbakhsh , Yufei Hu , Junli Cao , Xingjian Yan , Yi Xiao , Yong Lu , Jianming Liang , Demetri Terzopoulos , Xiaowei Ding

Self-supervised learning on images seeks to extract meaningful visual representations from unlabeled data. When scaled to large datasets, this paradigm has achieved state-of-the-art performance and the resulting trained models such as…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 David Nordström , Johan Edstedt , Fredrik Kahl , Georg Bökman

State-of-the-art computer vision models are mostly trained with supervised learning using human-labeled images, which limits their scalability due to the expensive annotation cost. While self-supervised representation learning has achieved…

Computer Vision and Pattern Recognition · Computer Science 2023-03-13 Junnan Li , Silvio Savarese , Steven C. H. Hoi