English
Related papers

Related papers: Learning Nuclei Representations with Masked Image …

200 papers

The performance of existing supervised neuron segmentation methods is highly dependent on the number of accurate annotations, especially when applied to large scale electron microscopy (EM) data. By extracting semantic information from…

Computer Vision and Pattern Recognition · Computer Science 2023-10-09 Yinda Chen , Wei Huang , Shenglong Zhou , Qi Chen , Zhiwei Xiong

The Vision Transformer (ViT) has demonstrated remarkable performance in Self-Supervised Learning (SSL) for 3D medical image analysis. Masked AutoEncoder (MAE) for feature pre-training can further unleash the potential of ViT on various…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Jiaxin Zhuang , Linshan Wu , Qiong Wang , Peng Fei , Varut Vardhanabhuti , Lin Luo , Hao Chen

The research community has witnessed the powerful potential of self-supervised Masked Image Modeling (MIM), which enables the models capable of learning visual representation from unlabeled data. In this paper, to incorporate both the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-01 Wenxuan Wang , Jing Wang , Chen Chen , Jianbo Jiao , Yuanxiu Cai , Shanshan Song , Jiangyun Li

Masked Image Modeling (MIM) is a technique in self-supervised learning that focuses on acquiring detailed visual representations from unlabeled images by estimating the missing pixels in randomly masked sections. It has proven to be a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Khanh-Binh Nguyen , Chae Jung Park

Masked image modeling (MIM) has been recognized as a strong self-supervised pre-training approach in the vision domain. However, the mechanism and properties of the learned representations by such a scheme, as well as how to further enhance…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Kevin Zhang , Zhiqiang Shen

Object detection in remote sensing imagery plays a vital role in various Earth observation applications. However, unlike object detection in natural scene images, this task is particularly challenging due to the abundance of small, often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Minh-Duc Vu , Zuheng Ming , Fangchen Feng , Bissmella Bahaduri , Anissa Mokraoui

Masked image modeling (MIM) has attracted much research attention due to its promising potential for learning scalable visual representations. In typical approaches, models usually focus on predicting specific contents of masked patches,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Haochen Wang , Kaiyou Song , Junsong Fan , Yuxi Wang , Jin Xie , Zhaoxiang Zhang

Deep supervision, which involves extra supervisions to the intermediate features of a neural network, was widely used in image classification in the early deep learning era since it significantly reduces the training difficulty and eases…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sucheng Ren , Fangyun Wei , Samuel Albanie , Zheng Zhang , Han Hu

Masked Image Modeling (MIM) has achieved promising progress with the advent of Masked Autoencoders (MAE) and BEiT. However, subsequent works have complicated the framework with new auxiliary tasks or extra pre-trained models, inevitably…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yuan Liu , Songyang Zhang , Jiacheng Chen , Kai Chen , Dahua Lin

Masked image modeling (MIM) has demonstrated impressive results in self-supervised representation learning by recovering corrupted image patches. However, most existing studies operate on low-level image pixels, which hinders the…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Zhiliang Peng , Li Dong , Hangbo Bao , Qixiang Ye , Furu Wei

Masked Image Modeling (MIM) has garnered significant attention in self-supervised learning, thanks to its impressive capacity to learn scalable visual representations tailored for downstream tasks. However, images inherently contain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Wenzhao Xiang , Chang Liu , Hongyang Yu , Xilin Chen

Masked image modeling, an emerging self-supervised pre-training method, has shown impressive success across numerous downstream vision tasks with Vision transformers. Its underlying idea is simple: a portion of the input image is masked out…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Siyuan Li , Di Wu , Fang Wu , Zelin Zang , Stan. Z. Li

Masked Image Modelling (MIM) has been shown to be an efficient self-supervised learning (SSL) pre-training paradigm when paired with transformer architectures and in the presence of a large amount of unlabelled natural images. The…

Computer Vision and Pattern Recognition · Computer Science 2023-01-02 Alvaro Fernandez-Quilez , Christoffer Gabrielsen Andersen , Trygve Eftestøl , Svein Reidar Kjosavik , Ketil Oppedal

Nuclear segmentation and classification within Haematoxylin & Eosin stained histology images is a fundamental prerequisite in the digital pathology work-flow. The development of automated methods for nuclear segmentation and classification…

Computer Vision and Pattern Recognition · Computer Science 2019-11-14 Simon Graham , Quoc Dang Vu , Shan E Ahmed Raza , Ayesha Azam , Yee Wah Tsang , Jin Tae Kwak , Nasir Rajpoot

Masked Autoencoders (MAE) have been prevailing paradigms for large-scale vision representation pre-training. By reconstructing masked image patches from a small portion of visible image regions, MAE forces the model to infer semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Hongwei Xue , Peng Gao , Hongyang Li , Yu Qiao , Hao Sun , Houqiang Li , Jiebo Luo

Masked Image Modeling (MIM) is a powerful self-supervised strategy for visual pre-training without the use of labels. MIM applies random crops to input images, processes them with an encoder, and then recovers the masked inputs with a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Maryam Haghighat , Peyman Moghadam , Shaheer Mohamed , Piotr Koniusz

The hematology analytics used for detection and classification of small blood components is a significant challenge. In particular, when objects exists as small pixel-sized entities in a large context of similar objects. Deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 H. Martin Gillis , Ming Hill , Paul Hollensen , Alan Fine , Thomas Trappenberg

Understanding whether self-supervised learning methods can scale with unlimited data is crucial for training large-scale models. In this work, we conduct an empirical study on the scaling capability of masked image modeling (MIM) methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-25 Cheng-Ze Lu , Xiaojie Jin , Qibin Hou , Jun Hao Liew , Ming-Ming Cheng , Jiashi Feng

In this paper, we propose Mixed and Masked AutoEncoder (MixMAE), a simple but efficient pretraining method that is applicable to various hierarchical Vision Transformers. Existing masked image modeling (MIM) methods for hierarchical Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-04-03 Jihao Liu , Xin Huang , Jinliang Zheng , Yu Liu , Hongsheng Li

We present a novel masked image modeling (MIM) approach, context autoencoder (CAE), for self-supervised representation pretraining. We pretrain an encoder by making predictions in the encoded representation space. The pretraining tasks…

Computer Vision and Pattern Recognition · Computer Science 2023-08-11 Xiaokang Chen , Mingyu Ding , Xiaodi Wang , Ying Xin , Shentong Mo , Yunhao Wang , Shumin Han , Ping Luo , Gang Zeng , Jingdong Wang