English
Related papers

Related papers: M2I2HA: Multi-modal Object Detection Based on Intr…

200 papers

Oriented object detection for multi-spectral imagery faces significant challenges due to differences both within and between modalities. Although existing methods have improved detection accuracy through complex network architectures, their…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Leiyu Wang , Biao Jin , Feng Huang , Liqiong Chen , Zhengyong Wang , Xiaohai He , Honggang Chen

Due to the rapid development of computer vision, single-modal (RGB) object tracking has made significant progress in recent years. Considering the limitation of single imaging sensor, multi-modal images (RGB, Infrared, etc.) are introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Cao , Junliang Guo , Pengfei Zhu , Qinghua Hu

Magnetic resonance (MR)-to-computed tomography (CT) translation offers significant advantages, including the elimination of radiation exposure associated with CT scans and the mitigation of imaging artifacts caused by patient motion. The…

Image and Video Processing · Electrical Eng. & Systems 2025-08-08 Chaohui Gong , Zhiying Wu , Zisheng Huang , Gaofeng Meng , Zhen Lei , Hongbin Liu

The Detection of small objects, especially traffic signs, is a critical sub-task in object detection and autonomous driving. Despite signficant progress in previous research, two main challenges remain. First, the issue of feature…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 TianYi Yu

Transformers and Mamba, initially invented for natural language processing, have inspired backbone architectures for visual recognition. Recent studies integrated Local Attention Transformers with Mamba to capture both local details and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Meng Lou , Yunxiang Fu , Yizhou Yu

Infrared small target detection faces the problem that it is difficult to effectively separate the background and the target. Existing deep learning-based methods focus on edge and shape features, but ignore the richer structural…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Jinmiao Zhao , Zelin Shi , Chuang Yu , Yunpeng Liu , Xinyi Ying , Yimian Dai

Serving the Intelligent Transport System (ITS) and Vehicle-to-Everything (V2X) tasks, roadside perception has received increasing attention in recent years, as it can extend the perception range of connected vehicles and improve traffic…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Zhang Zhang , Chao Sun , Chao Yue , Da Wen , Tianze Wang , Jianghao Leng

Remote sensing images captured from aerial perspectives often exhibit significant scale variations and complex backgrounds, posing challenges for salient object detection (SOD). Existing methods typically extract multi-level features at a…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Bin Wan , Runmin Cong , Xiaofei Zhou , Hao Fang , Chengtao Lv , Sam Kwong

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Dongyu Rao , Xiao-Jun Wu , Tianyang Xu , Guoyang Chen

In this paper, we approach an overlooked yet critical task Graph2Image: generating images from multimodal attributed graphs (MMAGs). This task poses significant challenges due to the explosion in graph size, dependencies among graph…

Artificial Intelligence · Computer Science 2024-10-10 Bowen Jin , Ziqi Pang , Bingjun Guo , Yu-Xiong Wang , Jiaxuan You , Jiawei Han

In this paper, we focus on exploring the fusion of images and point clouds for 3D object detection in view of the complementary nature of the two modalities, i.e., images possess more semantic information while point clouds specialize in…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Ming Zhu , Chao Ma , Pan Ji , Xiaokang Yang

Hyperspectral target detection (HTD) identifies objects of interest from complex backgrounds at the pixel level, playing a vital role in Earth observation. However, HTD faces challenges due to limited prior knowledge and spectral variation,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Dunbin Shen , Xuanbing Zhu , Jiacheng Tian , Jianjun Liu , Zhenrong Du , Hongyu Wang , Xiaorui Ma

Convolutional neural networks (CNN) and Transformers have made impressive progress in the field of remote sensing change detection (CD). However, both architectures have inherent shortcomings: CNN are constrained by a limited receptive…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Hongruixuan Chen , Jian Song , Chengxi Han , Junshi Xia , Naoto Yokoya

Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yang Qiao , Xiaoyu Zhong , Xiaofeng Gu , Zhiguo Yu

Multi-modal learning that combines pathological images with genomic data has significantly enhanced the accuracy of survival prediction. Nevertheless, existing methods have not fully utilized the inherent hierarchical structure within both…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Ying Chen , Jiajing Xie , Yuxiang Lin , Yuhang Song , Wenxian Yang , Rongshan Yu

Medical Hyperspectral Imaging (MHSI) offers potential for computational pathology and precision medicine. However, existing CNN and Transformer struggle to balance segmentation accuracy and speed due to high spatial-spectral dimensionality.…

Image and Video Processing · Electrical Eng. & Systems 2025-02-25 Shijie Lin , Boxiang Yun , Wei Shen , Qingli Li , Anqiang Yang , Yan Wang

Multimodal object detection has attracted significant attention in both academia and industry for its enhanced robustness. Although numerous studies have focused on improving modality fusion strategies, most neglect fusion degradation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 YiKang Shao , Tao Shi

Positron emission tomography (PET) combined with computed tomography (CT) imaging is routinely used in cancer diagnosis and prognosis by providing complementary information. Automatically segmenting tumors in PET/CT images can significantly…

Image and Video Processing · Electrical Eng. & Systems 2024-03-29 Jinpeng Lu , Jingyun Chen , Linghan Cai , Songhan Jiang , Yongbing Zhang

In computer vision tasks, features often come from diverse representations, domains (e.g., indoor and outdoor), and modalities (e.g., text, images, and videos). Effectively fusing these features is essential for robust performance,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-03 Dexuan Ding , Lei Wang , Liyun Zhu , Tom Gedeon , Piotr Koniusz

Deep image hashing aims to enable effective large-scale image retrieval by mapping the input images into simple binary hash codes through deep neural networks. More recently, Vision Mamba with linear time complexity has attracted extensive…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Chao He , Hongxi Wei