English
Related papers

Related papers: AMAES: Augmented Masked Autoencoder Pretraining on…

200 papers

Quantitative, volumetric analysis of Magnetic Resonance Imaging (MRI) is a fundamental way researchers study the brain in a host of neurological conditions including normal maturation and aging. Despite the availability of open-source brain…

Quantitative Methods · Quantitative Biology 2019-11-15 Aakash Kaku , Chaitra V. Hegde , Jeffrey Huang , Sohae Chung , Xiuyuan Wang , Matthew Young , Alireza Radmanesh , Yvonne W. Lui , Narges Razavian

Understanding whether self-supervised learning methods can scale with unlimited data is crucial for training large-scale models. In this work, we conduct an empirical study on the scaling capability of masked image modeling (MIM) methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Cheng-Ze Lu , Xiaojie Jin , Qibin Hou , Jun Hao Liew , Ming-Ming Cheng , Jiashi Feng

Most of the current state-of-the-art methods for tumor segmentation are based on machine learning models trained on manually segmented images. This type of training data is particularly costly, as manual delineation of tumors is not only…

Computer Vision and Pattern Recognition · Computer Science 2019-08-21 Pawel Mlynarski , Hervé Delingette , Antonio Criminisi , Nicholas Ayache

Brain tumor segmentation is important for diagnosis of the tumor, and current deep-learning methods rely on a large set of annotated images for training, with high annotation costs. Unsupervised segmentation is promising to avoid human…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Xiaochuan Ma , Jia Fu , Wenjun Liao , Shichuan Zhang , Guotai Wang

We propose an unsupervised deep learning method for atlas based registration to achieve segmentation and spatial alignment of the embryonic brain in a single framework. Our approach consists of two sequential networks with a specifically…

Image and Video Processing · Electrical Eng. & Systems 2020-05-14 Wietske A. P. Bastiaansen , Melek Rousian , Régine P. M. Steegers-Theunissen , Wiro J. Niessen , Anton Koning , Stefan Klein

In the realm of medical diagnostics, rapid advancements in Artificial Intelligence (AI) have significantly yielded remarkable improvements in brain tumor segmentation. Encoder-Decoder architectures, such as U-Net, have played a…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Eyad Gad , Seif Soliman , M. Saeed Darweesh

Masked image modeling (MIM) with transformer backbones has recently been exploited as a powerful self-supervised pre-training technique. The existing MIM methods adopt the strategy to mask random patches of the image and reconstruct the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-05 Zhaohu Xing , Lei Zhu , Lequan Yu , Zhiheng Xing , Liang Wan

Automated segmentation of anatomical sub-regions with high precision has become a necessity to enable the quantification and characterization of cells/ tissues in histology images. Currently, a machine learning model to analyze…

Image and Video Processing · Electrical Eng. & Systems 2023-06-05 Hosein Barzekar , Hai Ngu , Han Hui Lin , Mohsen Hejrati , Steven Ray Valdespino , Sarah Chu , Baris Bingol , Somaye Hashemifar , Soumitra Ghosh

Ultrasound (US) is one of the most commonly used imaging modalities in both diagnosis and surgical interventions due to its low-cost, safety, and non-invasive characteristic. US image segmentation is currently a unique challenge because of…

Image and Video Processing · Electrical Eng. & Systems 2020-01-22 Bahareh Behboodi , Mina Amiri , Rupert Brooks , Hassan Rivaz

Recently, masked image modeling (MIM), an important self-supervised learning (SSL) method, has drawn attention for its effectiveness in learning data representation from unlabeled data. Numerous studies underscore the advantages of MIM,…

Machine Learning · Computer Science 2024-04-02 Jiantao Wu , Shentong Mo , Sara Atito , Zhenhua Feng , Josef Kittler , Muhammad Awais

In the segmentation of remotely sensed images, deep learning models are typically pre-trained using large image databases like ImageNet before fine-tuned on domain-specific datasets. However, the performance of these fine-tuned models is…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Yuan Fang , Yuanzhi Cai , Jagannath Aryal , Qinfeng Zhu , Hong Huang , Cheng Zhang , Lei Fan

An important goal of self-supervised learning is to enable model pre-training to benefit from almost unlimited data. However, one method that has recently become popular, namely masked image modeling (MIM), is suspected to be unable to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhenda Xie , Zheng Zhang , Yue Cao , Yutong Lin , Yixuan Wei , Qi Dai , Han Hu

We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated…

Machine Learning · Computer Science 2025-08-29 Immanuel Roßteutscher , Klaus S. Drese , Thorsten Uphues

3D image segmentation plays an important role in biomedical image analysis. Many 2D and 3D deep learning models have achieved state-of-the-art segmentation performance on 3D biomedical image datasets. Yet, 2D and 3D models have their own…

Computer Vision and Pattern Recognition · Computer Science 2018-12-11 Hao Zheng , Yizhe Zhang , Lin Yang , Peixian Liang , Zhuo Zhao , Chaoli Wang , Danny Z. Chen

Large-scale vision models like SAM have extensive visual knowledge, yet their general nature and computational demands limit their use in specialized tasks like medical image segmentation. In contrast, task-specific models such as U-Net++…

Image and Video Processing · Electrical Eng. & Systems 2025-03-11 Yuchen Mao , Hongwei Li , Yinyi Lai , Giorgos Papanastasiou , Peng Qi , Yunjie Yang , Chengjia Wang

Brain tumors in magnetic resonance imaging (MR) are difficult, time-consuming, and prone to human error. These challenges can be resolved by developing automatic brain tumor segmentation methods from MR images. Various deep-learning models…

Image and Video Processing · Electrical Eng. & Systems 2024-08-23 Subin Sahayam , John Michael Sujay Zakkam , Yoga Sri Varshan , Umarani Jayaraman

Segmentation of brain tumors is a critical step in treatment planning, yet manual segmentation is both time-consuming and subjective, relying heavily on the expertise of radiologists. In Sub-Saharan Africa, this challenge is magnified by…

The scarcity of annotated medical images is a major bottleneck in developing learning models for medical image analysis. Hence, recent studies have focused on pretrained models with fewer annotation requirements that can be fine-tuned for…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Jonghun Kim , Mansu Kim , Hyunjin Park

Masked autoencoders (MAEs) have displayed significant potential in the classification and semantic segmentation of medical images in the last year. Due to the high similarity of human tissues, even slight changes in medical images may…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Jiawei Mao , Shujian Guo , Yuanqi Chang , Xuesong Yin , Binling Nie

Recent general-purpose audio representations show state-of-the-art performance on various audio tasks. These representations are pre-trained by self-supervised learning methods that create training signals from the input. For example,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-09 Daisuke Niizumi , Daiki Takeuchi , Yasunori Ohishi , Noboru Harada , Kunio Kashino