English
Related papers

Related papers: Robust Multimodal 3D Object Detection via Modality…

200 papers

Existing LiDAR-based 3D object detectors typically rely on manually annotated labels for training to achieve good performance. However, obtaining high-quality 3D labels is time-consuming and labor-intensive. To address this issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Mingqian Ji , Jian Yang , Shanshan Zhang

Multi-object tracking (MOT) enables mobile robots to perform well-informed motion planning and navigation by localizing surrounding objects in 3D space and time. Existing methods rely on depth sensors (e.g., LiDAR) to detect and track…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Aleksandr Kim , Aljoša Ošep , Laura Leal-Taixé

This paper presents a compact and accurate representation of 3D scenes that are observed by a LiDAR sensor and a monocular camera. The proposed method is based on the well-established Stixel model originally developed for stereo vision…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Florian Piewak , Peter Pinggera , Markus Enzweiler , David Pfeiffer , Marius Zöllner

Lack of audio-video synchronization is a common problem during television broadcasts and video conferencing, leading to an unsatisfactory viewing experience. A widely accepted paradigm is to create an error detection mechanism that…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Akash Gupta , Rohun Tripathi , Wondong Jang

Multi-modal methods based on camera and LiDAR sensors have garnered significant attention in the field of 3D detection. However, many prevalent works focus on single or partial stage fusion, leading to insufficient feature extraction and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Zhiwei Ning , Zhaojiang Liu , Xuanang Gao , Yifan Zuo , Jie Yang , Yuming Fang , Wei Liu

Monocular 3D object detection (M3OD) is a significant yet inherently challenging task in autonomous driving due to absence of explicit depth cues in a single RGB image. In this paper, we strive to boost currently underperforming monocular…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Weijia Zhang , Dongnan Liu , Chao Ma , Weidong Cai

Detecting deception by human behaviors is vital in many fields such as custom security and multimedia anti-fraud. Recently, audio-visual deception detection attracts more attention due to its better performance than using only a single…

Computer Vision and Pattern Recognition · Computer Science 2023-02-14 Zhaoxu Li , Zitong Yu , Nithish Muthuchamy Selvaraj , Xiaobao Guo , Bingquan Shen , Adams Wai-Kin Kong , Alex Kot

Although most existing multi-modal salient object detection (SOD) methods demonstrate effectiveness through training models from scratch, the limited multi-modal data hinders these methods from reaching optimality. In this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Kunpeng Wang , Danying Lin , Chenglong Li , Zhengzheng Tu , Bin Luo

Change detection in remote sensing imagery is essential for a variety of applications such as urban planning, disaster management, and climate research. However, existing methods for identifying semantically changed areas overlook the…

Computer Vision and Pattern Recognition · Computer Science 2023-12-08 Maximilian Bernhard , Niklas Strauß , Matthias Schubert

Geometric navigation is nowadays a well-established field of robotics and the research focus is shifting towards higher-level scene understanding, such as Semantic Mapping. When a robot needs to interact with its environment, it must be…

Robotics · Computer Science 2023-11-23 Federico Rollo , Gennaro Raiola , Andrea Zunino , Nikolaos Tsagarakis , Arash Ajoudani

3D object reconstruction is important for semantic scene understanding. It is challenging to reconstruct detailed 3D shapes from monocular images directly due to a lack of depth information, occlusion and noise. Most current methods…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Ziwei Liao , Steven L. Waslander

Unmanned aerial vehicle (UAV) detection and aerial object recognition are critical for modern surveillance and security, prompting a need for robust systems that overcome limitations of single-modality approaches. This research addresses…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Mauro Larrat , Claudomiro Sales

In this paper, we propose a robust 3D detector, named Cross Modal Transformer (CMT), for end-to-end 3D multi-modal detection. Without explicit view transformation, CMT takes the image and point clouds tokens as inputs and directly outputs…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Junjie Yan , Yingfei Liu , Jianjian Sun , Fan Jia , Shuailin Li , Tiancai Wang , Xiangyu Zhang

3D object detection with surrounding cameras has been a promising direction for autonomous driving. In this paper, we present SimMOD, a Simple baseline for Multi-camera Object Detection, to solve the problem. To incorporate multi-view…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Yunpeng Zhang , Wenzhao Zheng , Zheng Zhu , Guan Huang , Jie Zhou , Jiwen Lu

In this work, we present a unified framework for multi-modality 3D object detection, named UVTR. The proposed method aims to unify multi-modality representations in the voxel space for accurate and robust single- or cross-modality 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Yanwei Li , Yilun Chen , Xiaojuan Qi , Zeming Li , Jian Sun , Jiaya Jia

In the field of autonomous driving, 3D object detection is a very important perception module. Although the current SOTA algorithm combines Camera and Lidar sensors, limited by the high price of Lidar, the current mainstream landing schemes…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Kai Lei , Zhan Chen , Shuman Jia , Xiaoteng Zhang

Multimodal object detection leverages diverse modal information to enhance the accuracy and robustness of detectors. By learning long-term dependencies, Transformer can effectively integrate multimodal features in the feature extraction…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Shuhan Dong , Yunsong Li , Weiying Xie , Jiaqing Zhang , Jiayuan Tian , Danian Yang , Jie Lei

Multi-modal fusion has emerged as a promising paradigm for accurate 3D object detection. However, performance degrades substantially when deployed in target domains different from training. In this work, focusing on dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuchen Wu , Kun Wang , Yining Pan , Na Zhao

Accurate semantic segmentation of urban remote sensing images (URSIs) is essential for urban planning and environmental monitoring. However, it remains challenging due to the subtle texture differences and similar spatial structures among…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Guoyu Zhou , Jing Zhang , Yi Yan , Hui Zhang , Li Zhuo

In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot…

Robotics · Computer Science 2022-12-27 Thanh Nguyen Canh , Truong Son Nguyen , Cong Hoang Quach , Xiem HoangVan , Manh Duong Phung