English
Related papers

Related papers: Cross-Modal Object Tracking via Modality-Aware Fus…

200 papers

Multi-modal 3D object detection has received growing attention as the information from different sensors like LiDAR and cameras are complementary. Most fusion methods for 3D detection rely on an accurate alignment and calibration between 3D…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Zhe Liu , Xiaoqing Ye , Zhikang Zou , Xinwei He , Xiao Tan , Errui Ding , Jingdong Wang , Xiang Bai

Autonomous driving holds great promise in addressing traffic safety concerns by leveraging artificial intelligence and sensor technology. Multi-Object Tracking plays a critical role in ensuring safer and more efficient navigation through…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Lei Cheng , Arindam Sengupta , Siyang Cao

Modern multi-object tracking (MOT) systems usually model the trajectories by associating per-frame detections. However, when camera motion, fast motion, and occlusion challenges occur, it is difficult to ensure long-range tracking or even…

Computer Vision and Pattern Recognition · Computer Science 2020-09-21 Shoudong Han , Piao Huang , Hongwei Wang , En Yu , Donghaisheng Liu , Xiaofeng Pan , Jun Zhao

The flourishing success of Deep Neural Networks(DNNs) on RGB-input perception tasks has opened unbounded possibilities for non-RGB-input perception tasks, such as object detection from wireless signals, lidar scans, and infrared images.…

Computer Vision and Pattern Recognition · Computer Science 2023-10-17 Yutian Lei , Jun Liu , Dong Huang

Referring remote sensing image segmentation (RRSIS) is a novel visual task in remote sensing images segmentation, which aims to segment objects based on a given text description, with great significance in practical application. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Leideng Shi , Juan Zhang

Moving Object Detection (MOD) is a critical vision task for successfully achieving safe autonomous driving. Despite plausible results of deep learning methods, most existing approaches are only frame-based and may fail to reach reasonable…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Zhuyun Zhou , Zongwei Wu , Rémi Boutteau , Fan Yang , Cédric Demonceaux , Dominique Ginhac

Segmentation of drivable roads and negative obstacles is critical to the safe driving of autonomous vehicles. Currently, many multi-modal fusion methods have been proposed to improve segmentation accuracy, such as fusing RGB and depth…

Computer Vision and Pattern Recognition · Computer Science 2023-04-28 Zhen Feng , Yuchao Feng , Yanning Guo , Yuxiang Sun

The main challenge of Multiple Object Tracking (MOT) is the efficiency in associating indefinite number of objects between video frames. Standard motion estimators used in tracking, e.g., Long Short Term Memory (LSTM), only deal with single…

Computer Vision and Pattern Recognition · Computer Science 2019-05-08 Jimuyang Zhang , Sanping Zhou , Jinjun Wang , Dong Huang

With the development of depth sensors in recent years, RGBD object tracking has received significant attention. Compared with the traditional RGB object tracking, the addition of the depth modality can effectively solve the target and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Shang Gao , Jinyu Yang , Zhe Li , Feng Zheng , Aleš Leonardis , Jingkuan Song

Semantic segmentation relying solely on RGB data often struggles in challenging conditions such as low illumination and obscured views, limiting its reliability in critical applications like autonomous driving. To address this, integrating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ce Zhang , Zifu Wan , Simon Stepputtis , Katia Sycara , Yaqi Xie

Multispectral object detection aims to leverage complementary information from visible (RGB) and infrared (IR) modalities to enable robust performance under diverse environmental conditions. Our key insight, derived from wavelet analysis…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Seongmin Hwang , Daeyoung Han , Moongu Jeon

Traditional systems typically require different models for processing different modalities, such as one model for RGB images and another for depth images. Recent research has demonstrated that a single model for one modality can be adapted…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiaoke Shen , Ioannis Stamos

Multiple object tracking (MOT) is a significant task in achieving autonomous driving. Traditional works attempt to complete this task, either based on point clouds (PC) collected by LiDAR, or based on images captured from cameras. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Guangming Wang , Chensheng Peng , Jinpeng Zhang , Hesheng Wang

The dynamic range limitation of conventional RGB cameras reduces global contrast and causes loss of high-frequency details such as textures and edges in complex traffic environments (e.g., nighttime driving, tunnels), hindering…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Zhanwen Liu , Yujing Sun , Yang Wang , Nan Yang , Shengbo Eben Li , Xiangmo Zhao

Navigating the complexities of person re-identification (ReID) in varied surveillance scenarios, particularly when occlusions occur, poses significant challenges. We introduce an innovative Motion-Aware Fusion (MOTAR-FUSE) network that…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Fuxi Ling , Hongye Liu , Guoqiang Huang , Jing Li , Hong Wu , Zhihao Tang

Multispectral pedestrian detection has shown great advantages under poor illumination conditions, since the thermal modality provides complementary information for the color image. However, real multispectral data suffers from the position…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Lu Zhang , Xiangyu Zhu , Xiangyu Chen , Xu Yang , Zhen Lei , Zhiyong Liu

Multi-modal data provides abundant and diverse object information, crucial for effective modal interactions in Re-Identification (ReID) tasks. However, existing approaches often overlook the quality variations in local features and fail to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Xixi Wan , Aihua Zheng , Zi Wang , Bo Jiang , Jin Tang , Jixin Ma

The goal of multi-modal learning is to use complimentary information on the relevant task provided by the multiple modalities to achieve reliable and robust performance. Recently, deep learning has led significant improvement in multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2018-11-05 Jaekyum Kim , Junho Koh , Yecheol Kim , Jaehyung Choi , Youngbae Hwang , Jun Won Choi

We address the problem of multi-modal object tracking in video and explore various options of fusing the complementary information conveyed by the visible (RGB) and thermal infrared (TIR) modalities including pixel-level, feature-level and…

Computer Vision and Pattern Recognition · Computer Science 2022-01-24 Zhangyong Tang , Tianyang Xu , Hui Li , Xiao-Jun Wu , Xuefeng Zhu , Josef Kittler

Object detection in Remote Sensing Images (RSI) is a critical task for numerous applications in Earth Observation (EO). Differing from object detection in natural images, object detection in remote sensing images faces challenges of…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Bissmella Bahaduri , Zuheng Ming , Fangchen Feng , Anissa Mokraou