English
Related papers

Related papers: PCMamba: Physics-Informed Cross-Modal State Space …

200 papers

Multispectral imaging (MSI) captures data across multiple spectral bands, offering enhanced informational depth compared to standard RGB imaging and benefiting diverse fields such as agriculture, medical diagnostics, and industrial…

Instrumentation and Detectors · Physics 2025-08-29 Muchen Zhu , Baolei Liu , Yao Wang , Linjun Zhai , Jiaqi Song , Nana Liu , Zhaohua Yang , Lei Ding , Fan Wang

In multichannel speech enhancement, effectively capturing spatial and spectral information across different microphones is crucial for noise reduction. Traditional methods, such as CNN or LSTM, attempt to model the temporal dynamics of…

Audio and Speech Processing · Electrical Eng. & Systems 2025-01-15 Wenze Ren , Haibin Wu , Yi-Cheng Lin , Xuanjun Chen , Rong Chao , Kuo-Hsuan Hung , You-Jin Li , Wen-Yuan Ting , Hsin-Min Wang , Yu Tsao

Multi-modal image fusion integrates complementary information from different modalities to produce enhanced and informative images. Although State-Space Models, such as Mamba, are proficient in long-range modeling with linear complexity,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Ke Cao , Xuanhua He , Tao Hu , Chengjun Xie , Man Zhou , Jie Zhang

3D human pose lifting is a promising research area that leverages estimated and ground-truth 2D human pose data for training. While existing approaches primarily aim to enhance the performance of estimated 2D poses, they often struggle when…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Hu Cui , Tessai Hayama

Recent years have witnessed significant advancements in light field image super-resolution (LFSR) owing to the progress of modern neural networks. However, these methods often face challenges in capturing long-range dependencies (CNN-based)…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Wang xia , Yao Lu , Shunzhou Wang , Ziqi Wang , Peiqi Xia , Tianfei Zhou

Modeling daily hand interactions often struggles with severe occlusions, such as when two hands overlap, which highlights the need for robust feature learning in 3D hand pose estimation (HPE). To handle such occluded hand images, it is…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yifan Zhou , Takehiko Ohkawa , Guwenxiao Zhou , Kanoko Goto , Takumi Hirose , Yusuke Sekikawa , Nakamasa Inoue

Multi-modal MRI offers valuable complementary information for diagnosis and treatment; however, its utility is limited by prolonged scanning times. To accelerate the acquisition process, a practical approach is to reconstruct images of the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-09 Jing Zou , Lanqing Liu , Qi Chen , Shujun Wang , Zhanli Hu , Xiaohan Xing , Jing Qin

Multi-modal medical image synthesis involves nonlinear transformation of tissue signals between source and target modalities, where tissues exhibit contextual interactions across diverse spatial distances. As such, the utility of a network…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Omer F. Atli , Bilal Kabas , Fuat Arslan , Arda C. Demirtas , Mahmut Yurt , Onat Dalmaz , Tolga Çukur

Accurate classification of hyperspectral imagery (HSI) is often frustrated by the tension between high-dimensional spectral data and the extreme scarcity of labeled training samples. While hierarchical models like LoLA-SpecViT have…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Abdellah Zakaria Sellam , Fadi Abdeladhim Zidi , Salah Eddine Bekhouche , Ihssen Houhou , Marouane Tliba , Cosimo Distante , Abdenour Hadid

Hyperspectral anomaly detection (HAD) aims to identify rare and irregular targets in high-dimensional hyperspectral images (HSIs), which are often noisy and unlabelled data. Existing deep learning methods either fail to capture long-range…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Aayushma Pant , Lakpa Tamang , Tsz-Kwan Lee , Sunil Aryal

Multi-Modal Image Fusion (MMIF) aims to integrate complementary image information from different modalities to produce informative images. Previous deep learning-based MMIF methods generally adopt Convolutional Neural Networks (CNNs) or…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Hui Sun , Long Lv , Pingping Zhang , Tongdan Tang , Feng Tian , Weibing Sun , Huchuan Lu

Underwater Image Enhancement (UIE) is critical for marine research and exploration but hindered by complex color distortions and severe blurring. Recent deep learning-based methods have achieved remarkable results, yet these methods…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Wei-Tung Lin , Yong-Xiang Lin , Jyun-Wei Chen , Kai-Lung Hua

Coded Aperture Snapshot Spectral Imaging (CASSI) system has great advantages over traditional methods in dynamically acquiring Hyper-Spectral Image (HSI), but there are the following problems. 1) Traditional mask relies on random patterns…

Image and Video Processing · Electrical Eng. & Systems 2023-10-13 Zeyu Cai , Can Zhang , Xunhao Chen , Shanghuan Liu , Chengqian Jin , Feipeng Da

Image generation models have encountered challenges related to scalability and quadratic complexity, primarily due to the reliance on Transformer-based backbones. In this study, we introduce MaskMamba, a novel hybrid model that combines…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Wenchao Chen , Liqiang Niu , Ziyao Lu , Fandong Meng , Jie Zhou

U-shaped architectures have long dominated the field of medical image segmentation, while Transformers are widely employed for modeling long-range dependencies. The former typically handles scale variations implicitly by aggregating…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yanhua Zhang , Ke Zhang , Jingyu Wang , Gabriella Balestra , Samanta Rosati , Yulin Wu , Wuwei Wang , Valentina Giannini

Over the past decade, hyperspectral image (HSI) classification has drawn considerable interest due to HSIs' ability to effectively distinguish terrestrial objects by capturing detailed, continuous spectral information. The strong…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Mohammed Q. Alkhatib , Ali Jamali

Transformers bring significantly improved performance to the light field image super-resolution task due to their long-range dependency modeling capability. However, the inherently high computational complexity of their core self-attention…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Zeqiang Wei , Kai Jin , Zeyi Hou , Kuan Song , Xiuzhuang Zhou

Mainstream approaches to spectral reconstruction (SR) primarily focus on designing Convolution- and Transformer-based architectures. However, CNN methods often face challenges in handling long-range dependencies, whereas Transformers are…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xinying Wang , Zhixiong Huang , Sifan Zhang , Jiawen Zhu , Paolo Gamba , Lin Feng

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often convert images into 1D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Chaodong Xiao , Minghan Li , Zhengqiang Zhang , Deyu Meng , Lei Zhang

Reconstructing degraded images is a critical task in image processing. Although CNN and Transformer-based models are prevalent in this field, they exhibit inherent limitations, such as inadequate long-range dependency modeling and high…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Rui Deng , Tianpei Gu