English
Related papers

Related papers: Dual-Domain Masked Image Modeling: A Self-Supervis…

200 papers

Magnetic resonance imaging (MRI) is a vital diagnostic tool, but its inherently long acquisition times reduce clinical efficiency and patient comfort. Recent advancements in deep learning, particularly diffusion models, have improved…

Image and Video Processing · Electrical Eng. & Systems 2026-04-28 Yuxuan Zhang , Jinkui Hao , Bo Zhou

The pre-trained transformer demonstrates remarkable generalization ability in natural image processing. However, directly transferring it to magnetic resonance images faces two key challenges: the inability to adapt to the specificity of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingkai Li , Xiaoze Tian , Yuhang Shen , Jia Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

Multi-exposure image fusion aims to generate a single high-dynamic image by integrating images with different exposures. Existing deep learning-based multi-exposure image fusion methods primarily focus on spatial domain fusion, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Guang Yang , Jie Li , Xinbo Gao

Hyperspectral imaging provides precise classification for land use and cover due to its exceptional spectral resolution. However, the challenges of high dimensionality and limited spatial resolution hinder its effectiveness. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shivam Pande

Self-supervised learning (SSL) has delivered superior performance on a variety of downstream vision tasks. Two main-stream SSL frameworks have been proposed, i.e., Instance Discrimination (ID) and Masked Image Modeling (MIM). ID pulls…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Chenxin Tao , Xizhou Zhu , Weijie Su , Gao Huang , Bin Li , Jie Zhou , Yu Qiao , Xiaogang Wang , Jifeng Dai

Few-shot classification of hyperspectral images (HSI) faces the challenge of scarce labeled samples. Self-Supervised learning (SSL) and Few-Shot Learning (FSL) offer promising avenues to address this issue. However, existing methods often…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wenchen Chen , Yanmei Zhang , Zhongwei Xiao , Jianping Chu , Xingbo Wang

Hyperspectral Imaging (HSI) captures rich spectral information across contiguous wavelength bands, supporting applications in precision agriculture, environmental monitoring, and autonomous driving. However, its high dimensionality poses…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yaniv Zimmer , Ofir Lindenbaum , Oren Glickman

Learning representations through self-supervision on unlabeled data has proven highly effective for understanding diverse images. However, remote sensing images often have complex and densely populated scenes with multiple land objects and…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Mingming Zhang , Qingjie Liu , Yunhong Wang

The need for a large amount of labeled data in the supervised setting has led recent studies to utilize self-supervised learning to pre-train deep neural networks using unlabeled data. Many self-supervised training strategies have been…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Mojtaba Bahrami , Mahsa Ghorbani , Nassir Navab

An unsupervised framework for hyperspectral image (HSI) clustering is proposed that incorporates masked deep representation learning with diffusion-based clustering, extending the Spatially-Regularized Superpixel-based Diffusion Learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Vutichart Buranasiri , James M. Murphy

Hyperspectral images (HSI) contain a wealth of information over hundreds of contiguous spectral bands, making it possible to classify materials through subtle spectral discrepancies. However, the classification of this rich spectral…

Machine Learning · Computer Science 2018-12-07 Ramanarayan Mohanty , SL Happy , Aurobinda Routray

This paper addresses the fusion of a pair of spatially unregistered hyperspectral image (HSI) and multispectral image (MSI) covering roughly overlapping regions. HSIs offer high spectral but low spatial resolution, while MSIs provide the…

Image and Video Processing · Electrical Eng. & Systems 2026-04-02 Jiahui Song , Sagar Shrestha , Xiao Fu

Hyperspectral imaging has the potential to improve intraoperative decision making if tissue characterisation is performed in real-time and with high-resolution. Hyperspectral snapshot mosaic sensors offer a promising approach due to their…

Image and Video Processing · Electrical Eng. & Systems 2023-03-27 Peichao Li , Muhammad Asad , Conor Horgan , Oscar MacCormac , Jonathan Shapey , Tom Vercauteren

Foundational deep learning (DL) models are general models, trained on large, diverse, and unlabelled datasets, typically using self-supervised learning techniques have led to significant advancements especially in natural language…

Signal Processing · Electrical Eng. & Systems 2024-11-18 Ahmed Aboulfotouh , Ashkan Eshaghbeigi , Dimitrios Karslidis , Hatem Abou-Zeid

Hyperspectral imaging (HSI) holds great potential for healthcare due to its rich spectral information. However, acquiring HSI data remains costly and technically demanding. Hyperspectral image reconstruction offers a practical solution by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yufei Wen , Yuting Zhang , Jingdan Kang , Hao Ren , Weibin Cheng , Jintai Chen , Kaishun Wu

Masked Image Modeling (MIM) techniques have redefined the landscape of computer vision, enabling pre-trained models to achieve exceptional performance across a broad spectrum of tasks. Despite their success, the full potential of MIM-based…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Sumin Son , Hyesong Choi , Dongbo Min

Magnetic Resonance Imaging (MRI) is widely used in clinical practice, but suffered from prolonged acquisition time. Although deep learning methods have been proposed to accelerate acquisition and demonstrate promising performance, they rely…

Image and Video Processing · Electrical Eng. & Systems 2025-12-30 Hao Zhang , Qi Wang , Jian Sun , Zhijie Wen , Jun Shi , Shihui Ying

Accurate hyperspectral image (HSI) interpretation is critical for providing valuable insights into various earth observation-related applications such as urban planning, precision agriculture, and environmental monitoring. However, existing…

This paper presents SimMIM, a simple framework for masked image modeling. We simplify recently proposed related approaches without special designs such as block-wise masking and tokenization via discrete VAE or clustering. To study what let…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Zhenda Xie , Zheng Zhang , Yue Cao , Yutong Lin , Jianmin Bao , Zhuliang Yao , Qi Dai , Han Hu

Hyperspectral images (HSI) with abundant spectral information reflected materials property usually perform low spatial resolution due to the hardware limits. Meanwhile, multispectral images (MSI), e.g., RGB images, have a high spatial…

Computer Vision and Pattern Recognition · Computer Science 2023-07-10 Shuaikai Shi , Lijun Zhang , Yoann Altmann , Jie Chen