English
Related papers

Related papers: Dual-Domain Masked Image Modeling: A Self-Supervis…

200 papers

Statistical shape modeling (SSM) is an enabling quantitative tool to study anatomical shapes in various medical applications. However, directly using 3D images in these applications still has a long way to go. Recent deep learning methods…

Computer Vision and Pattern Recognition · Computer Science 2023-10-04 Abu Zahid Bin Aziz , Jadie Adams , Shireen Elhabian

Masked Image Modeling (MIM) has emerged as a promising method for deriving visual representations from unlabeled image data by predicting missing pixels from masked portions of images. It excels in region-aware learning and provides strong…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yibing Wei , Abhinav Gupta , Pedro Morgado

Geospatial Foundation Models (GFMs) typically lack native support for Hyperspectral Imaging (HSI) due to the complexity and sheer size of high-dimensional spectral data. This study investigates the adaptability of TerraMind, a multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Julia Anna Leonardi , Johannes Jakubik , Paolo Fraccaro , Maria Antonia Brovelli

The blind fusion of unregistered hyperspectral images (HSIs) and multispectral images (MSIs) has attracted growing attention recently. To address the registration challenge, most existing methods employ spatial transformations on the HSI to…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Kunjing Yang , Libin Zheng , Minru Bai , Ting Lu , Leyuan Fang

Supervised deep learning methods have achieved considerable success in medical image analysis, owing to the availability of large-scale and well-annotated datasets. However, creating such datasets for whole slide images (WSIs) in…

Computer Vision and Pattern Recognition · Computer Science 2024-06-10 Hao Wang , Euijoon Ahn , Jinman Kim

Hyperspectral imaging (HSI) captures spatial and spectral data, enabling analysis of features invisible to conventional systems. The technology is vital in fields such as weather monitoring, food quality control, counterfeit detection,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 David S. Bhatti , Yougin Choi , Rahman S M Wahidur , Maleeka Bakhtawar , Sumin Kim , Surin Lee , Yongtae Lee , Heung-No Lee

Infrared and visible image fusion aims to utilize the complementary information from two modalities to generate fused images with prominent targets and rich texture details. Most existing algorithms only perform pixel-level or feature-level…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Kun Hu , Qingle Zhang , Maoxun Yuan , Yitian Zhang

Although recent masked image modeling (MIM)-based HSI-LiDAR/SAR classification methods have gradually recognized the importance of the spectral information, they have not adequately addressed the redundancy among different spectra,…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Junyan Lin , Xuepeng Jin , Feng Gao , Junyu Dong , Hui Yu

The self-supervised Masked Image Modeling (MIM) schema, following "mask-and-reconstruct" pipeline of recovering contents from masked image, has recently captured the increasing interest in the multimedia community, owing to the excellent…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Hao Liu , Xinghua Jiang , Xin Li , Antai Guo , Deqiang Jiang , Bo Ren

Hyperspectral and multispectral image (HSI-MSI) fusion involves combining a low-resolution hyperspectral image (LR-HSI) with a high-resolution multispectral image (HR-MSI) to generate a high-resolution hyperspectral image (HR-HSI). Most…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Jian Zhu , He Wang , Yang Xu , Zebin Wu , Zhihui Wei

Medical Hyperspectral Imaging (MHSI) has emerged as a promising tool for enhanced disease diagnosis, particularly in computational pathology, offering rich spectral information that aids in identifying subtle biochemical properties of…

Computer Vision and Pattern Recognition · Computer Science 2025-07-10 Qing Zhang , Guoquan Pei , Yan Wang

In text recognition, self-supervised pre-training emerges as a good solution to reduce dependence on expansive annotated real data. Previous studies primarily focus on local visual representation by leveraging mask image modeling or…

Computer Vision and Pattern Recognition · Computer Science 2024-05-14 Zuan Gao , Yuxin Wang , Yadong Qu , Boqiang Zhang , Zixiao Wang , Jianjun Xu , Hongtao Xie

Self-supervised learning (SSL) methods have become a dominant paradigm for creating general purpose models whose capabilities can be transferred to downstream supervised learning tasks. However, most such methods rely on vast amounts of…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Lakshay Sharma , Alex Marin

Semi-Supervised Instance Segmentation (SSIS) aims to leverage an amount of unlabeled data during training. Previous frameworks primarily utilized the RGB information of unlabeled images to generate pseudo-labels. However, such a mechanism…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Xin Chen , Jie Hu , Xiawu Zheng , Jianghang Lin , Liujuan Cao , Rongrong Ji

Deep supervision, which involves extra supervisions to the intermediate features of a neural network, was widely used in image classification in the early deep learning era since it significantly reduces the training difficulty and eases…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Sucheng Ren , Fangyun Wei , Samuel Albanie , Zheng Zhang , Han Hu

The development of deep learning-based models for the compression of hyperspectral images (HSIs) has recently attracted great attention in remote sensing due to the sharp growing of hyperspectral data archives. Most of the existing models…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Martin Hermann Paul Fuchs , Akshara Preethy Byju , Alisa Walda , Behnood Rasti , Begüm Demir

Hyperspectral Imaging (HSI) serves as a non-destructive spatial spectroscopy technique with a multitude of potential applications. However, a recurring challenge lies in the limited size of the target datasets, impeding exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2023-09-21 Hannah Frank , Leon Amadeus Varga , Andreas Zell

Supervised deep learning for semantic segmentation has achieved excellent results in accurately identifying anatomical and pathological structures in medical images. However, it often requires large annotated training datasets, which limits…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Luca Ciampi , Gabriele Lagani , Giuseppe Amato , Fabrizio Falchi

Classifying hyperspectral images (HSIs) is a complex task in remote sensing due to the high-dimensional nature and volume of data involved. To address these challenges, we propose the Spectral-Spatial non-Linear Model, a novel framework…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Judy X Yang , Jing Wang , Zekun Long , Chenhong Sui , Jun Zhou

Text images are unique in their dual nature, encompassing both visual and linguistic information. The visual component encompasses structural and appearance-based features, while the linguistic dimension incorporates contextual and semantic…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Yifei Zhang , Chang Liu , Jin Wei , Xiaomeng Yang , Yu Zhou , Can Ma , Xiangyang Ji