English
Related papers

Related papers: Mask-guided Spectral-wise Transformer for Efficien…

200 papers

Current hyperspectral image (HSI) reconstruction methods primarily rely on image-level approaches, which are time-consuming to form abundant high-quality HSIs through imagers. In contrast, spectrometers offer a more efficient alternative by…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Yihong Leng , Jiaojiao Li , Haitao Xu , Rui Song

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI…

Image and Video Processing · Electrical Eng. & Systems 2026-03-10 Haley Duba-Sullivan , Emma J. Reid , Sophie Voisin , Charles A. Bouman , Gregery T. Buzzard

In this paper, we present a Hybrid Spectral Denoising Transformer (HSDT) for hyperspectral image denoising. Challenges in adapting transformer for HSI arise from the capabilities to tackle existing limitations of CNN-based methods in…

Computer Vision and Pattern Recognition · Computer Science 2023-08-09 Zeqiang Lai , Chenggang Yan , Ying Fu

Hyperspectral image (HSI) restoration is a fundamental challenge in computational imaging and computer vision. It involves ill-posed inverse problems, such as inpainting and super-resolution. Although deep learning methods have transformed…

Image and Video Processing · Electrical Eng. & Systems 2026-01-21 Jiangwei Xie , Zhang Wen , Mike Davies , Dongdong Chen

Deep unfolding methods have made impressive progress in restoring 3D hyperspectral images (HSIs) from 2D measurements through convolution neural networks or Transformers in spectral compressive imaging. However, they cannot efficiently…

Image and Video Processing · Electrical Eng. & Systems 2024-06-04 Jiahua Dong , Hui Yin , Hongliu Li , Wenbo Li , Yulun Zhang , Salman Khan , Fahad Shahbaz Khan

Masked image modeling (MIM) is a highly popular and effective self-supervised learning method for image understanding. Existing MIM-based methods mostly focus on spatial feature modeling, neglecting spectral feature modeling. Meanwhile,…

Image and Video Processing · Electrical Eng. & Systems 2023-11-09 Junyan Lin , Feng Gao , Xiaocheng Shi , Junyu Dong , Qian Du

Hyperspectral images (HSIs) capture richer spatial-spectral information beyond RGB, yet real-world HSIs often suffer from a composite mix of degradations, such as noise, blur, and missing bands. Existing generative approaches for HSI…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Xiangming Wang , Benteng Sun , Yungeng Liu , Haijin Zeng , Yongyong Chen , Jingyong Su , Jie Liu

Hyperspectral images (HSI) promise to support a range of new applications in computer vision. Recent research has explored the feasibility of generalizable Spectral Reconstruction (SR), the problem of recovering a HSI from a natural…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Christopher Thirgood , Oscar Mendez , Erin Ling , Jon Storey , Simon Hadfield

3D Swin Transformer (3D-ST) known for its hierarchical attention and window-based processing, excels in capturing intricate spatial relationships within images. Spatial-spectral Transformer (SST), meanwhile, specializes in modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Muhammad Ahmad , Manuel Mazzara , Salvatore Distifano

In coded aperture snapshot spectral compressive imaging (CASSI) systems, hyperspectral image (HSI) reconstruction methods are employed to recover the spatial-spectral signal from a compressed measurement. Among these algorithms, deep…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Yuanhao Cai , Jing Lin , Haoqian Wang , Xin Yuan , Henghui Ding , Yulun Zhang , Radu Timofte , Luc Van Gool

To capture high-speed videos using a two-dimensional detector, video snapshot compressive imaging (SCI) is a promising system, where the video frames are coded by different masks and then compressed to a snapshot measurement. Following…

Image and Video Processing · Electrical Eng. & Systems 2021-03-03 Zhengjue Wang , Hao Zhang , Ziheng Cheng , Bo Chen , Xin Yuan

Spectral compressive imaging (SCI) is able to encode the high-dimensional hyperspectral image to a 2D measurement, and then uses algorithms to reconstruct the spatio-spectral data-cube. At present, the main bottleneck of SCI is the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-04 Lishun Wang , Zongliang Wu , Yong Zhong , Xin Yuan

Coded aperture snapshot spectral imaging (CASSI) retrieves a 3D hyperspectral image (HSI) from a single 2D compressed measurement, which is a highly challenging reconstruction task. Recent deep unfolding networks (DUNs), empowered by…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Xiaodong Wang , Ping Wang , Zijun He , Mengjie Qin , Xin Yuan

Hyperspectral imaging plays a pivotal role in a wide range of applications, like remote sensing, medicine, and cytology. By acquiring 3D hyperspectral images (HSIs) via 2D sensors, the coded aperture snapshot spectral imaging (CASSI) has…

Image and Video Processing · Electrical Eng. & Systems 2023-03-20 Xuanyu Zhang , Bin Chen , Wenzhen Zou , Shuai Liu , Yongbing Zhang , Ruiqin Xiong , Jian Zhang

Single hyperspectral image super-resolution (single-HSI-SR) aims to restore a high-resolution hyperspectral image from a low-resolution observation. However, the prevailing CNN-based approaches have shown limitations in building long-range…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Mingjin Zhang , Chi Zhang , Qiming Zhang , Jie Guo , Xinbo Gao , Jing Zhang

Hyperspectral images (HSI) provide rich spectral information that contributed to the successful performance improvement of numerous computer vision tasks. However, it can only be achieved at the expense of images' spatial resolution.…

Computer Vision and Pattern Recognition · Computer Science 2021-08-03 Ying Qu , Hairong Qi , Chiman Kwan , Naoto Yokoya , Jocelyn Chanussot

Transformer has been widely used for self-supervised pre-training in Natural Language Processing (NLP) and achieved great success. However, it has not been fully explored in visual self-supervised learning. Meanwhile, previous methods only…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhaowen Li , Zhiyang Chen , Fan Yang , Wei Li , Yousong Zhu , Chaoyang Zhao , Rui Deng , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

Denoising is a crucial step for hyperspectral image (HSI) applications. Though witnessing the great power of deep learning, existing HSI denoising methods suffer from limitations in capturing the non-local self-similarity. Transformers have…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Miaoyu Li , Ji Liu , Ying Fu , Yulun Zhang , Dejing Dou

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Li Pang , Xiangyu Rui , Long Cui , Hongzhong Wang , Deyu Meng , Xiangyong Cao

Hyperspectral Images (HSIs) are crucial across numerous fields but are hindered by the long acquisition times associated with traditional spectrometers. The Coded Aperture Snapshot Spectral Imaging (CASSI) system mitigates this issue…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Jianan Li , Huan Chen , Wangcai Zhao , Rui Chen , Tingfa Xu