English
Related papers

Related papers: Interactive Masked Image Modeling for Multimodal O…

200 papers

Despite recent advancements in computer vision research, object detection in aerial images still suffers from several challenges. One primary challenge to be mitigated is the presence of multiple types of variation in aerial images, for…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sungjune Park , Hyunjun Kim , Beomchan Park , Yong Man Ro

The semantic representation of deep features is essential for image context understanding, and effective fusion of features with different semantic representations can significantly improve the model's performance on salient object…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Han Sun , Jun Cen , Ningzhong Liu , Dong Liang , Huiyu Zhou

Masked image modeling (MIM) has become a prevalent pre-training setup for vision foundation models and attains promising performance. Despite its success, existing MIM methods discard the decoder network during downstream applications,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Qi Han , Yuxuan Cai , Xiangyu Zhang

Object detection in optical remote sensing images, being a fundamental but challenging problem in the field of aerial and satellite image analysis, plays an important role for a wide range of applications and is receiving significant…

Computer Vision and Pattern Recognition · Computer Science 2016-04-05 Gong Cheng , Junwei Han

Though quite challenging, leveraging large-scale unlabeled or partially labeled images in a cost-effective way has increasingly attracted interests for its great importance to computer vision. To tackle this problem, many Active Learning…

Computer Vision and Pattern Recognition · Computer Science 2018-05-25 Keze Wang , Xiaopeng Yan , Dongyu Zhang , Lei Zhang , Liang Lin

Due to the prevalence of scale variance in nature images, we propose to use image scale as a self-supervised signal for Masked Image Modeling (MIM). Our method involves selecting random patches from the input image and downsampling them to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Zhiming Wang , Lin Gu , Feng Lu

Existing scene text removal (STR) task suffers from insufficient training data due to the expensive pixel-level labeling. In this paper, we aim to address this issue by introducing a Text-aware Masked Image Modeling algorithm (TMIM), which…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Zixiao Wang , Hongtao Xie , YuXin Wang , Yadong Qu , Fengjun Guo , Pengwei Liu

Text-to-image retrieval (TIR) aims to find relevant images based on a textual query, but existing approaches are primarily based on whole-image captions and lack interpretability. Meanwhile, referring expression segmentation (RES) enables…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Li-Cheng Shen , Jih-Kang Hsieh , Wei-Hua Li , Chu-Song Chen

TThe goal of our work is to discover dominant objects in a very general setting where only a single unlabeled image is given. This is far more challenge than typical co-localization or weakly-supervised localization tasks. To tackle this…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Runsheng Zhang , Yaping Huang , Mengyang Pu , Jian Zhang , Qingji Guan , Qi Zou , Haibin Ling

Masking strategies commonly employed in natural language processing are still underexplored in vision tasks such as concept learning, where conventional methods typically rely on full images. However, using masked images diversifies…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Yuwei Sun , Lu Mi , Ippei Fujisawa , Ruiqiao Mei , Jimin Chen , Siyu Zhu , Ryota Kanai

Masked image modeling (MIM) has gained significant traction for its remarkable prowess in representation learning. As an alternative to the traditional approach, the reconstruction from corrupted images has recently emerged as a promising…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Wenzhao Xiang , Chang Liu , Hang Su , Hongyang Yu

Single-branch object detection methods use shared features for localization and classification, yet the shared features are not fit for the two different tasks simultaneously. Multi-branch object detection methods usually use different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Shuxin Wang , Zhichao Zheng , Yanhui Gu , Junsheng Zhou , Yi Chen

Object detection in natural scenes can be a challenging task. In many real-life situations, the visible spectrum is not suitable for traditional computer vision tasks. Moving outside the visible spectrum range, such as the thermal spectrum…

Computer Vision and Pattern Recognition · Computer Science 2021-02-08 Md Osman Gani , Somenath Kuiry , Alaka Das , Mita Nasipuri , Nibaran Das

Camouflaged Object Detection (COD) aims to segment objects that blend seamlessly into complex backgrounds, with growing interest in exploiting additional visual modalities to enhance robustness through complementary information. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Hao Wang , Jiqing Zhang , Xin Yang , Baocai Yin , Lu Jiang , Zetian Mi , Huibing Wang

Multi-modal object Re-IDentification (ReID) is devoted to retrieving specific objects through the exploitation of complementary multi-modal image information. Existing methods mainly concentrate on the fusion of multi-modal features, yet…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Yangyang Liu , Yuhao Wang , Pingping Zhang

Detecting spliced images is one of the emerging challenges in computer vision. Unlike prior methods that focus on detecting low-level artifacts generated during the manipulation process, we use an image retrieval approach to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Bor-Chun Chen , Zuxuan Wu , Larry S. Davis , Ser-Nam Lim

Large multimodal models (LMMs) have garnered wide-spread attention and interest within the artificial intelligence research and industrial communities, owing to their remarkable capability in multimodal understanding, reasoning, and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jincheng Li , Chunyu Xie , Ji Ao , Dawei Leng , Yuhui Yin

Visual localization and mapping is a crucial capability to address many challenges in mobile robotics. It constitutes a robust, accurate and cost-effective approach for local and global pose estimation within prior maps. Yet, in highly…

Computer Vision and Pattern Recognition · Computer Science 2018-07-11 Guoxiang Zhou , Berta Bescos , Marcin Dymczyk , Mark Pfeiffer , José Neira , Roland Siegwart

Driven by the success of Masked Language Modeling (MLM), the realm of self-supervised learning for computer vision has been invigorated by the central role of Masked Image Modeling (MIM) in driving recent breakthroughs. Notwithstanding the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Hyesong Choi , Hunsang Lee , Seyoung Joung , Hyejin Park , Jiyeong Kim , Dongbo Min

In recent years, zero-shot and few-shot learning in visual grounding have garnered considerable attention, largely due to the success of large-scale vision-language pre-training on expansive datasets such as LAION-5B and DataComp-1B.…

Artificial Intelligence · Computer Science 2024-10-07 Sen Jia , Lei Li