English
Related papers

Related papers: Spatial-Spectral Transformer for Hyperspectral Ima…

200 papers

Very recently, Window-based Transformers, which computed self-attention within non-overlapping local windows, demonstrated promising results on image classification, semantic segmentation, and object detection. However, less study has been…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Zilong Huang , Youcheng Ben , Guozhong Luo , Pei Cheng , Gang Yu , Bin Fu

Achieving 3D spatial awareness is crucial for surgical robotic manipulation, where precise and delicate operations are required. Existing methods either explicitly reconstruct the surgical scene prior to manipulation, or enhance multi-view…

Robotics · Computer Science 2026-03-05 Yu Sheng , Lidian Wang , Xiaomeng Chu , Jiajun Deng , Min Cheng , Yanyong Zhang , Bei Hua , Houqiang Li , Jianmin Ji

Self-supervised image denoising implies restoring the signal from a noisy image without access to the ground truth. State-of-the-art solutions for this task rely on predicting masked pixels with a fully-convolutional neural network. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Mikhail Papkov , Pavel Chizhov , Leopold Parts

Spatially Resolved Transcriptomics (SRT) is a cutting-edge technique that captures the spatial context of cells within tissues, enabling the study of complex biological networks. Recent graph-based methods leverage both gene expression and…

Machine Learning · Computer Science 2025-06-24 Yunhak Oh , Junseok Lee , Yeongmin Kim , Sangwoo Seo , Namkyeong Lee , Chanyoung Park

The recent advancement of spatial transcriptomics (ST) allows to characterize spatial gene expression within tissue for discovery research. However, current ST platforms suffer from low resolution, hindering in-depth understanding of…

Image and Video Processing · Electrical Eng. & Systems 2025-11-05 Xiaofei Wang , Xingxu Huang , Stephen J. Price , Chao Li

Removing noise from images is a challenging and fundamental problem in the field of computer vision. Images captured by modern cameras are inevitably degraded by noise which limits the accuracy of any quantitative measurements on those…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Nikhil Verma , Deepkamal Kaur , Lydia Chau

This paper proposes the first pure Transformer structure inversion network called SwinStyleformer, which can compensate for the shortcomings of the CNNs inversion framework by handling long-range dependencies and learning the global…

Computer Vision and Pattern Recognition · Computer Science 2024-06-21 Jiawei Mao , Guangyi Zhao , Xuesong Yin , Yuanqi Chang

In this paper, a self-supervised model that simultaneously predicts a sequence of future frames from video-input with a novel spatial-temporal attention (ST) network is proposed. The ST transformer network allows constraining both temporal…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Houssem Boulahbal , Adrian Voicila , Andrew Comport

Depth estimation has been widely studied and serves as the fundamental step of 3D perception for robotics and autonomous driving. Though significant progress has been made in monocular depth estimation in the past decades, these attempts…

Computer Vision and Pattern Recognition · Computer Science 2025-11-13 Xianda Guo , Wenjie Yuan , Yunpeng Zhang , Tian Yang , Chenming Zhang , Zheng Zhu , Qin Zou , Long Chen

The self-attention mechanism, a cornerstone of Transformer-based state-of-the-art deep learning architectures, is largely heuristic-driven and fundamentally challenging to interpret. Establishing a robust theoretical foundation to explain…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Laziz U. Abdullaev , Maksim Tkachenko , Tan M. Nguyen

Deep-learning-based hyperspectral image (HSI) restoration methods have gained great popularity for their remarkable performance but often demand expensive network retraining whenever the specifics of task changes. In this paper, we propose…

Image and Video Processing · Electrical Eng. & Systems 2022-09-20 Zeqiang Lai , Kaixuan Wei , Ying Fu

Hyperspectral image has become increasingly crucial due to its abundant spectral information. However, It has poor spatial resolution with the limitation of the current imaging mechanism. Nowadays, many convolutional neural networks have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-05 Jin-Fan Hu , Ting-Zhu Huang , Liang-Jian Deng

Prior works have proposed several strategies to reduce the computational cost of self-attention mechanism. Many of these works consider decomposing the self-attention procedure into regional and local feature extraction procedures that each…

Computer Vision and Pattern Recognition · Computer Science 2022-07-13 Ting Yao , Yehao Li , Yingwei Pan , Yu Wang , Xiao-Ping Zhang , Tao Mei

This paper proposes a novel regularization method, named Spatio-Spectral Structure Tensor Total Variation (S3TTV), for denoising and destriping of hyperspectral (HS) images. HS images are inevitably contaminated by various types of noise,…

Signal Processing · Electrical Eng. & Systems 2025-07-08 Shingo Takemoto , Kazuki Naganuma , Shunsuke Ono

Hyperspectral imaging (HSI) is a key technology for earth observation, surveillance, medical imaging and diagnostics, astronomy and space exploration. The conventional technology for HSI in remote sensing applications is based on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Shuo Li , Mike Davies , Mehrdad Yaghoobi

Hyperspectral image fusion (HIF) is critical to a wide range of applications in remote sensing and many computer vision applications. Most traditional HIF methods assume that the observation model is predefined or known. However, in real…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Wu Wang , Yue Huang , Xinhao Ding

In this paper, we propose a novel nonconvex approach to robust principal component analysis for HSI denoising, which focuses on simultaneously developing more accurate approximations to both rank and column-wise sparsity for the low-rank…

Image and Video Processing · Electrical Eng. & Systems 2022-12-07 Chong Peng , Yang Liu , Yongyong Chen , Xinxin Wu , Andrew Cheng , Zhao Kang , Chenglizhao Chen , Qiang Cheng

Due to various and complicated snow degradations, single image desnowing is a challenging image restoration task. As prior arts can not handle it ideally, we propose a novel transformer, SnowFormer, which explores efficient cross-attentions…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Sixiang Chen , Tian Ye , Yun Liu , Erkang Chen

The Image-Based Rendering (IBR) approach using Shearlet Transform (ST) is one of the most effective methods for Densely-Sampled Light Field (DSLF) reconstruction. The ST-based DSLF reconstruction typically relies on an iterative…

Multimedia · Computer Science 2020-03-20 Yuan Gao , Robert Bregovic , Reinhard Koch , Atanas Gotchev

Transformer's recent integration into style transfer leverages its proficiency in establishing long-range dependencies, albeit at the expense of attenuated local modeling. This paper introduces Strips Window Attention Transformer (S2WAT), a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-18 Chiyu Zhang , Xiaogang Xu , Lei Wang , Zaiyan Dai , Jun Yang