English
Related papers

Related papers: M2I2HA: Multi-modal Object Detection Based on Intr…

200 papers

Remote sensing change detection is vital for monitoring environmental and urban transformations but faces challenges like manual feature extraction and sensitivity to noise. Traditional methods and early deep learning models, such as…

Visual tracking often faces challenges such as invalid targets and decreased performance in low-light conditions when relying solely on RGB image sequences. While incorporating additional modalities like depth and infrared data has proven…

Computer Vision and Pattern Recognition · Computer Science 2023-12-25 Lei Liu , Mengya Zhang , Cheng Li , Chenglong Li , Jin Tang

Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Javed Ahmad , Alessio Del Bue

In recent years, deep learning has shown near-expert performance in segmenting complex medical tissues and tumors. However, existing models are often task-specific, with performance varying across modalities and anatomical regions.…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 T-Mai Bui , Fares Bougourzi , Fadi Dornaika , Vinh Truong Hoang

The precise detection of mild cognitive impairment (MCI) is of significant importance in preventing the deterioration of patients in a timely manner. Although hypergraphs have enhanced performance by learning and analyzing brain networks,…

Machine Learning · Computer Science 2025-01-14 Manman Yuan , Weiming Jia , Xiong Luo , Jiazhen Ye , Peican Zhu , Junlin Li

Multispectral fusion object detection is a critical task for edge-based maritime surveillance and remote sensing, demanding both high inference efficiency and robust feature representation for high-resolution inputs. However, current State…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Qianqian Zhang , Leon Tabaro , Ahmed M. Abdelmoniem , Junshe An

Point clouds and RGB images are two general perceptional sources in autonomous driving. The former can provide accurate localization of objects, and the latter is denser and richer in semantic information. Recently, AutoAlign presents a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinhong Jiang , Feng Zhao

Reliable induction motor (IM) fault diagnosis is vital for industrial safety and operational continuity, mitigating costly unplanned downtime. Conventional approaches often struggle to capture complex multimodal signal relationships, are…

Artificial Intelligence · Computer Science 2025-10-20 Usman Ali , Ali Zia , Waqas Ali , Umer Ramzan , Abdul Rehman , Muhammad Tayyab Chaudhry , Wei Xiang

Natural images are often degraded by complex, composite degradations such as rain, snow, and haze, which adversely impact downstream vision applications. While existing image restoration efforts have achieved notable success, they are still…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Yongzhen Wang , Yongjun Li , Zhuoran Zheng , Xiao-Ping Zhang , Mingqiang Wei

Multispectral object detection aims to leverage complementary information from visible (RGB) and infrared (IR) modalities to enable robust performance under diverse environmental conditions. Our key insight, derived from wavelet analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Seongmin Hwang , Daeyoung Han , Moongu Jeon

Non-coding RNAs (ncRNAs) play pivotal roles in gene expression regulation and the pathogenesis of various diseases. Accurate classification of ncRNAs is essential for functional annotation and disease diagnosis. To address existing…

Machine Learning · Computer Science 2025-09-25 Xin An , Ruijie Li , Qiao Ning , Hui Li , Qian Ma , Shikai Guo

In the field of multi-source remote sensing image classification, remarkable progress has been made by using Convolutional Neural Network (CNN) and Transformer. Recently, Mamba-based methods built upon the State Space Model (SSM) have shown…

Image and Video Processing · Electrical Eng. & Systems 2025-01-28 Feng Gao , Xuepeng Jin , Xiaowei Zhou , Junyu Dong , Qian Du

A major challenge in multimodal learning is the presence of noise within individual modalities. This noise inherently affects the resulting multimodal representations, especially when these representations are obtained through explicit…

Computer Vision and Pattern Recognition · Computer Science 2025-08-25 Mohammad Zia Ur Rehman , Devraj Raghuvanshi , Umang Jain , Shubhi Bansal , Nagendra Kumar

Remote sensing image fusion aims to generate a high-resolution multi/hyper-spectral image by combining a high-resolution image with limited spectral data and a low-resolution image rich in spectral information. Current deep learning (DL)…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Siran Peng , Xiangyu Zhu , Haoyu Deng , Liang-Jian Deng , Zhen Lei

Point clouds and images could provide complementary information when representing 3D objects. Fusing the two kinds of data usually helps to improve the detection results. However, it is challenging to fuse the two data modalities, due to…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Xun Tan , Xingyu Chen , Guowei Zhang , Jishiyu Ding , Xuguang Lan

Supervised multi-modal learning involves mapping multiple modalities to a target label. Previous studies in this field have concentrated on capturing in isolation either the inter-modality dependencies (the relationships between different…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Divyam Madaan , Taro Makino , Sumit Chopra , Kyunghyun Cho

Enterprises are facing increasing risks of insider threats, while existing detection methods are unable to effectively address these challenges due to reasons such as insufficient temporal dynamic feature modeling, computational efficiency…

Cryptography and Security · Computer Science 2025-08-11 Kaichuan Kong , Dongjie Liu , Xiaobo Jin , Zhiying Li , Guanggang Geng , Jian Weng

Multi-view 3D object detection is a crucial component of autonomous driving systems. Contemporary query-based methods primarily depend either on dataset-specific initialization of 3D anchors, introducing bias, or utilize dense attention…

Robotics · Computer Science 2024-11-12 Michelle Adeline , Junn Yong Loo , Vishnu Monn Baskaran

Multimodal medical image fusion integrates complementary information from different imaging modalities to enhance diagnostic accuracy and treatment planning. While deep learning methods have advanced performance, existing approaches face…

Image and Video Processing · Electrical Eng. & Systems 2025-08-06 Meng Zhou , Farzad Khalvati

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang