English
Related papers

Related papers: Unified Object Detector for Different Modalities b…

200 papers

In many visual systems, visual tracking often bases on RGB image sequences, in which some targets are invalid in low-light conditions, and tracking performance is thus affected significantly. Introducing other modalities such as depth and…

Computer Vision and Pattern Recognition · Computer Science 2021-11-12 Chenglong Li , Tianhao Zhu , Lei Liu , Xiaonan Si , Zilin Fan , Sulan Zhai

Learning multi-modal representations is an essential step towards real-world robotic applications, and various multi-modal fusion models have been developed for this purpose. However, we observe that existing models, whose objectives are…

Machine Learning · Computer Science 2021-06-22 Chenzhuang Du , Tingle Li , Yichen Liu , Zixin Wen , Tianyu Hua , Yue Wang , Hang Zhao

Multi-Modal Object Detection (MMOD), due to its stronger adaptability to various complex environments, has been widely applied in various applications. Extensive research is dedicated to the RGB-IR object detection, primarily focusing on…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Tianyi Zhao , Boyang Liu , Yanglei Gao , Yiming Sun , Maoxun Yuan , Xingxing Wei

Unmanned aerial vehicles (UAV)-based object detection with visible (RGB) and infrared (IR) images facilitates robust around-the-clock detection, driven by advancements in deep learning techniques and the availability of high-quality…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Chen Chen , Kangcheng Bin , Ting Hu , Jiahao Qi , Xingyue Liu , Tianpeng Liu , Zhen Liu , Yongxiang Liu , Ping Zhong

Drone-based vehicle detection aims at finding the vehicle locations and categories in an aerial image. It empowers smart city traffic management and disaster rescue. Researchers have made mount of efforts in this area and achieved…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Yiming Sun , Bing Cao , Pengfei Zhu , Qinghua Hu

Multi-sensor modal fusion has demonstrated strong advantages in 3D object detection tasks. However, existing methods that fuse multi-modal features require transforming features into the bird's eye view space and may lose certain…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Chunyong Hu , Hang Zheng , Kun Li , Jianyun Xu , Weibo Mao , Maochun Luo , Lingxuan Wang , Mingxia Chen , Qihao Peng , Kaixuan Liu , Yiru Zhao , Peihan Hao , Minzhe Liu , Kaicheng Yu

Unmanned aerial vehicle (UAV) detection and aerial object recognition are critical for modern surveillance and security, prompting a need for robust systems that overcome limitations of single-modality approaches. This research addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Mauro Larrat , Claudomiro Sales

How to effectively fuse cross-modal information is the key problem for RGB-D salient object detection. Early fusion and the result fusion schemes fuse RGB and depth information at the input and output stages, respectively, hence incur the…

Computer Vision and Pattern Recognition · Computer Science 2020-10-13 Nian Liu , Ni Zhang , Ling Shao , Junwei Han

Visual place classification from a first-person-view monocular RGB image is a fundamental problem in long-term robot navigation. A difficulty arises from the fact that RGB image classifiers are often vulnerable to spatial and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-05-12 Tomoya Iwasaki , Kanji Tanaka , Kenta Tsukahara

Multispectral object detection, utilizing both visible (RGB) and thermal infrared (T) modals, has garnered significant attention for its robust performance across diverse weather and lighting conditions. However, effectively exploiting the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Jinzhong Wang , Xuetao Tian , Shun Dai , Tao Zhuo , Haorui Zeng , Hongjuan Liu , Jiaqi Liu , Xiuwei Zhang , Yanning Zhang

Object detection has been extensively utilized in autonomous systems in recent years, encompassing both 2D and 3D object detection. Recent research in this field has primarily centered around multimodal approaches for addressing this…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Wendong Zhang

Reliable UAV object detection requires robustness to illumination changes, motion blur, and scene dynamics that suppress RGB cues. Thermal long-wave infrared (LWIR) sensing preserves contrast in low light, and event cameras retain…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Craig Iaboni , Pramod Abichandani

The goal of this work is to present a systematic solution for RGB-D salient object detection, which addresses the following three aspects with a unified framework: modal-specific representation learning, complementary cue selection and…

Computer Vision and Pattern Recognition · Computer Science 2019-09-23 Hao Chen , Youfu Li

Object detection in poor-illumination environments is a challenging task as objects are usually not clearly visible in RGB images. As infrared images provide additional clear edge information that complements RGB images, fusing RGB and…

Computer Vision and Pattern Recognition · Computer Science 2024-12-09 Yishuo Chen , Boran Wang , Xinyu Guo , Wenbin Zhu , Jiasheng He , Xiaobin Liu , Jing Yuan

Joint RGB-infrared perception is essential for achieving robustness under diverse weather and illumination conditions. Although foundation models excel within single modalities, they suffer from substantial cross-modal degradation, an issue…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Fangyuan Mao , Shuo Wang , Jilin Mei , Shun Lu , Chen Min , Fuyang Liu , Xiaokun Feng , Meiqi Wu , Yu Hu

Cross-domain few-shot object detection (CD-FSOD) aims to detect novel objects across different domains with limited class instances. Feature confusion, including object-background confusion and object-object confusion, presents significant…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Boyuan Meng , Xiaohan Zhang , Peilin Li , Zhe Wu , Yiming Li , Wenkai Zhao , Beinan Yu , Hui-Liang Shen

Multimodal sensing has proven valuable for visual tracking, as different sensor types offer unique strengths in handling one specific challenging scene where object appearance varies. While a generalist model capable of leveraging all…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Yuedong Tan , Zongwei Wu , Yuqian Fu , Zhuyun Zhou , Guolei Sun , Eduard Zamfi , Chao Ma , Danda Pani Paudel , Luc Van Gool , Radu Timofte

Current remote sensing change detection (CD) methods mainly rely on specialized models, which limits the scalability toward modality-adaptive Earth observation. For homogeneous CD, precise boundary delineation relies on fine-grained spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Qingling Shu , Sibao Chen , Wei Lu , Zhihui You , Chengzhuang Liu

Existing point cloud based 3D detectors are designed for the particular scene, either indoor or outdoor ones. Because of the substantial differences in object distribution and point density within point clouds collected from various…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Zhenyu Wang , Yali Li , Xi Chen , Hengshuang Zhao , Shengjin Wang

Due to the rapid development of computer vision, single-modal (RGB) object tracking has made significant progress in recent years. Considering the limitation of single imaging sensor, multi-modal images (RGB, Infrared, etc.) are introduced…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bing Cao , Junliang Guo , Pengfei Zhu , Qinghua Hu