English
Related papers

Related papers: FactoFormer: Factorized Hyperspectral Transformers…

200 papers

Despite the proven significance of hyperspectral images (HSIs) in performing various computer vision tasks, its potential is adversely affected by the low-resolution (LR) property in the spatial domain, resulting from multiple physical…

Computer Vision and Pattern Recognition · Computer Science 2023-06-22 Chanyue Wu , Dong Wang , Hanyu Mao , Ying Li

Hyperspectral images (HSI) have become popular for analysing remotely sensed images in multiple domain like agriculture, medical. However, existing models struggle with complex relationships and characteristics of spectral-spatial data due…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Neetu Sigger , Tuan Thanh Nguyen , Gianluca Tozzi , Quoc-Tuan Vien , Sinh Van Nguyen

Despite the success of fully-supervised human skeleton sequence modeling, utilizing self-supervised pre-training for skeleton sequence representation learning has been an active field because acquiring task-specific skeleton annotations at…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuxiao Chen , Long Zhao , Jianbo Yuan , Yu Tian , Zhaoyang Xia , Shijie Geng , Ligong Han , Dimitris N. Metaxas

Diagnostic, prognostic and therapeutic decision-making of cancer in pathology clinics can now be carried out based on analysis of multi-gigapixel tissue images, also known as whole-slide images (WSIs). Recently, deep convolutional neural…

Image and Video Processing · Electrical Eng. & Systems 2022-09-08 Quoc Dang Vu , Kashif Rajpoot , Shan E Ahmed Raza , Nasir Rajpoot

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Li Pang , Xiangyu Rui , Long Cui , Hongzhong Wang , Deyu Meng , Xiangyong Cao

The use of multimodal data in assisted diagnosis and segmentation has emerged as a prominent area of interest in current research. However, one of the primary challenges is how to effectively fuse multimodal features. Most of the current…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xinxin Fan , Lin Liu , Haoran Zhang

Transformer-based pre-trained language models are vocabulary-dependent, mapping by default each token to its corresponding embedding. This one-to-one mapping results into embedding matrices that occupy a lot of memory (i.e. millions of…

Computation and Language · Computer Science 2022-11-01 Huiyin Xue , Nikolaos Aletras

We present a novel frequency-based Self-Supervised Learning (SSL) approach that significantly enhances its efficacy for pre-training. Prior work in this direction masks out pre-defined frequencies in the input image and employs a…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Amin Karimi Monsefi , Mengxi Zhou , Nastaran Karimi Monsefi , Ser-Nam Lim , Wei-Lun Chao , Rajiv Ramnath

Transformers have exhibited promising performance in computer vision tasks including image super-resolution (SR). However, popular transformer-based SR methods often employ window self-attention with quadratic computational complexity to…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Xiang Zhang , Yulun Zhang , Fisher Yu

Hyperspectral image (HSI) with high spectral resolution often suffers from low spatial resolution owing to the limitations of imaging sensors. Image fusion is an effective and economical way to enhance the spatial resolution of HSI, which…

Image and Video Processing · Electrical Eng. & Systems 2020-08-11 Renwei Dian , Shutao Li , Bin Sun , Anjing Guo

Hybrid beamforming is a promising technology for 5G millimetre-wave communications. However, its implementation is challenging in practical multiple-input multiple-output (MIMO) systems because non-convex optimization problems have to be…

Signal Processing · Electrical Eng. & Systems 2021-07-09 Hamed Hojatian , Vu Nguyen Ha , Jérémy Nadal , Jean-François Frigon , François Leduc-Primeau

Pan-sharpening aims at producing a high-resolution (HR) multi-spectral (MS) image from a low-resolution (LR) multi-spectral (MS) image and its corresponding panchromatic (PAN) image acquired by a same satellite. Inspired by a new fashion in…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Huanyu Zhou , Qingjie Liu , Yunhong Wang

Hyperspectral image (HSI) classification has become a hot topic in the field of remote sensing. In general, the complex characteristics of hyperspectral data make the accurate classification of such data challenging for traditional machine…

Image and Video Processing · Electrical Eng. & Systems 2019-10-30 Shutao Li , Weiwei Song , Leyuan Fang , Yushi Chen , Pedram Ghamisi , Jón Atli Benediktsson

The integration of hyperspectral imaging (HSI) and LiDAR data within new linear feature spaces offers a promising solution to the challenges posed by the high-dimensionality and redundancy inherent in HSIs. This study introduces a dual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Judy X Yang , Jing Wang , Chen Hong Sui , Zekun Long , Jun Zhou

Enabling image generation models to be spatially controlled is an important area of research, empowering users to better generate images according to their own fine-grained specifications via e.g. edge maps, poses. Although this task has…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Guoxuan Xia , Harleen Hanspal , Petru-Daniel Tudosiu , Shifeng Zhang , Sarah Parisot

Spectral imaging data acquired via multispectral and hyperspectral cameras can have hundreds of channels, where each channel records the reflectance at a specific wavelength and bandwidth. Time and resource constraints limit our ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 William Michael Laprade , Jesper Cairo Westergaard , Svend Christensen , Mads Nielsen , Anders Bjorholm Dahl

Algorithms for the action segmentation task typically use temporal models to predict what action is occurring at each frame for a minute-long daily activity. Recent studies have shown the potential of Transformer in modeling the relations…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Fangqiu Yi , Hongyu Wen , Tingting Jiang

Transfer learning for bio-signals has recently become an important technique to improve prediction performance on downstream tasks with small bio-signal datasets. Recent works have shown that pre-training a neural network model on a large…

Machine Learning · Computer Science 2024-12-19 Eloy Geenjaar , Lie Lu

Blind face restoration is a challenging task due to the unknown and complex degradation. Although face prior-based methods and reference-based methods have recently demonstrated high-quality results, the restored images tend to contain…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Guojing Ge , Qi Song , Guibo Zhu , Yuting Zhang , Jinglu Chen , Miao Xin , Ming Tang , Jinqiao Wang

The rapid growth of hyperspectral data archives in remote sensing (RS) necessitates effective compression methods for storage and transmission. Recent advances in learning-based hyperspectral image (HSI) compression have significantly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Martin Hermann Paul Fuchs , Behnood Rasti , Begüm Demir