English
Related papers

Related papers: Revealing the Dark Secrets of Masked Image Modelin…

200 papers

Deep supervision, which involves extra supervisions to the intermediate features of a neural network, was widely used in image classification in the early deep learning era since it significantly reduces the training difficulty and eases…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sucheng Ren , Fangyun Wei , Samuel Albanie , Zheng Zhang , Han Hu

Masked Image Modeling (MIM) achieves outstanding success in self-supervised representation learning. Unfortunately, MIM models typically have huge computational burden and slow learning process, which is an inevitable obstacle for their…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Haoqing Wang , Yehui Tang , Yunhe Wang , Jianyuan Guo , Zhi-Hong Deng , Kai Han

Masked image modeling (MIM) pre-training for large-scale vision transformers (ViTs) has enabled promising downstream performance on top of the learned self-supervised ViT features. In this paper, we question if the \textit{extremely simple}…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Jin Gao , Shubo Lin , Shaoru Wang , Yutong Kou , Zeming Li , Liang Li , Congxuan Zhang , Xiaoqin Zhang , Yizheng Wang , Weiming Hu

Like masked language modeling (MLM) in natural language processing, masked image modeling (MIM) aims to extract valuable insights from image patches to enhance the feature extraction capabilities of the underlying deep neural network (DNN).…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Yixuan Luo , Mengye Ren , Sai Qian Zhang

To make sense of their surroundings, intelligent systems must transform complex sensory inputs to structured codes that are reduced to task-relevant information such as object category. Biological agents achieve this in a largely autonomous…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Robin Weiler , Matthias Brucklacher , Cyriel M. A. Pennartz , Sander M. Bohté

The past year has witnessed a rapid development of masked image modeling (MIM). MIM is mostly built upon the vision transformers, which suggests that self-supervised visual representations can be done by masking input image parts while…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yunjie Tian , Lingxi Xie , Jiemin Fang , Mengnan Shi , Junran Peng , Xiaopeng Zhang , Jianbin Jiao , Qi Tian , Qixiang Ye

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

This paper explores improvements to the masked image modeling (MIM) paradigm. The MIM paradigm enables the model to learn the main object features of the image by masking the input image and predicting the masked part by the unmasked part.…

Computer Vision and Pattern Recognition · Computer Science 2022-05-24 Jiawei Mao , Xuesong Yin , Yuanqi Chang , Honggu Zhou

Masked Image Modeling (MIM) has recently been established as a potent pre-training paradigm. A pretext task is constructed by masking patches in an input image, and this masked content is then predicted by a neural network using visible…

Computer Vision and Pattern Recognition · Computer Science 2023-01-16 Philippe Weinzaepfel , Vincent Leroy , Thomas Lucas , Romain Brégier , Yohann Cabon , Vaibhav Arora , Leonid Antsfeld , Boris Chidlovskii , Gabriela Csurka , Jérôme Revaud

Training visual embeddings with labeled data supervision has been the de facto setup for representation learning in computer vision. Inspired by recent success of adopting masked image modeling (MIM) in self-supervised representation…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Kaifeng Chen , Daniel Salz , Huiwen Chang , Kihyuk Sohn , Dilip Krishnan , Mojtaba Seyedhosseini

Masked image modeling, an emerging self-supervised pre-training method, has shown impressive success across numerous downstream vision tasks with Vision transformers. Its underlying idea is simple: a portion of the input image is masked out…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Siyuan Li , Di Wu , Fang Wu , Zelin Zang , Stan. Z. Li

Masked Image Modeling (MIM) is a technique in self-supervised learning that focuses on acquiring detailed visual representations from unlabeled images by estimating the missing pixels in randomly masked sections. It has proven to be a…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Khanh-Binh Nguyen , Chae Jung Park

Recently, masked image modeling (MIM) has gained considerable attention due to its capacity to learn from vast amounts of unlabeled data and has been demonstrated to be effective on a wide variety of vision tasks involving natural images.…

Computer Vision and Pattern Recognition · Computer Science 2022-08-25 Zekai Chen , Devansh Agarwal , Kshitij Aggarwal , Wiem Safta , Samit Hirawat , Venkat Sethuraman , Mariann Micsinai Balan , Kevin Brown

An important goal of self-supervised learning is to enable model pre-training to benefit from almost unlimited data. However, one method that has recently become popular, namely masked image modeling (MIM), is suspected to be unable to…

Computer Vision and Pattern Recognition · Computer Science 2022-06-10 Zhenda Xie , Zheng Zhang , Yue Cao , Yutong Lin , Yixuan Wei , Qi Dai , Han Hu

Masked Image Modeling (MIM) is a self-supervised learning technique that involves masking portions of an image, such as pixels, patches, or latent representations, and training models to predict the missing information using the visible…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Shabnam Choudhury , Akhil Vasim , Michael Schmitt , Biplab Banerjee

Masked Image Modeling (MIM) has garnered significant attention in self-supervised learning, thanks to its impressive capacity to learn scalable visual representations tailored for downstream tasks. However, images inherently contain…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Wenzhao Xiang , Chang Liu , Hongyang Yu , Xilin Chen

Since the development of self-supervised visual representation learning from contrastive learning to masked image modeling (MIM), there is no significant difference in essence, that is, how to design proper pretext tasks for vision…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Kun Yi , Yixiao Ge , Xiaotong Li , Shusheng Yang , Dian Li , Jianping Wu , Ying Shan , Xiaohu Qie

Recent masked image modeling (MIM) has received much attention in self-supervised learning (SSL), which requires the target model to recover the masked part of the input image. Although MIM-based pre-training methods achieve new…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Qiang Zhou , Chaohui Yu , Hao Luo , Zhibin Wang , Hao Li

Recently, Masked Image Modeling (MIM) achieves great success in self-supervised visual recognition. However, as a reconstruction-based framework, it is still an open question to understand how MIM works, since MIM appears very different…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Xiangwen Kong , Xiangyu Zhang

Object detection in remote sensing imagery plays a vital role in various Earth observation applications. However, unlike object detection in natural scene images, this task is particularly challenging due to the abundance of small, often…

Computer Vision and Pattern Recognition · Computer Science 2024-09-16 Minh-Duc Vu , Zuheng Ming , Fangchen Feng , Bissmella Bahaduri , Anissa Mokraoui
‹ Prev 1 2 3 10 Next ›