English
Related papers

Related papers: MSF3DDETR: Multi-Sensor Fusion 3D Detection Transf…

200 papers

Multi-sensor fusion is essential for accurate 3D object detection in self-driving systems. Camera and LiDAR are the most commonly used sensors, and usually, their fusion happens at the early or late stages of 3D detectors with the help of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Javed Ahmad , Alessio Del Bue

Visual-based 3D semantic occupancy perception is a key technology for robotics, including autonomous vehicles, offering an enhanced understanding of the environment by 3D. This approach, however, typically requires more computational…

Robotics · Computer Science 2024-05-21 Yupeng Jia , Jie He , Runze Chen , Fang Zhao , Haiyong Luo

3D object detection based on LiDAR-camera fusion is becoming an emerging research theme for autonomous driving. However, it has been surprisingly difficult to effectively fuse both modalities without information loss and interference. To…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Guojun Wang , Bin Tian , Yachen Zhang , Long Chen , Dongpu Cao , Jian Wu

In this paper we propose to exploit multiple related tasks for accurate multi-sensor 3D object detection. Towards this goal we present an end-to-end learnable architecture that reasons about 2D and 3D object detection as well as ground…

Computer Vision and Pattern Recognition · Computer Science 2020-12-24 Ming Liang , Bin Yang , Yun Chen , Rui Hu , Raquel Urtasun

3D object detection from multiple image views is a fundamental and challenging task for visual scene understanding. Due to its low cost and high efficiency, multi-view 3D object detection has demonstrated promising application prospects.…

Computer Vision and Pattern Recognition · Computer Science 2022-07-01 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinhong Jiang , Feng Zhao

3D vehicle detection based on multi-modal fusion is an important task of many applications such as autonomous driving. Although significant progress has been made, we still observe two aspects that need to be further improvement: First, the…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Zehan Zhang , Ming Zhang , Zhidong Liang , Xian Zhao , Ming Yang , Wenming Tan , ShiLiang Pu

Sensor fusion is an essential topic in many perception systems, such as autonomous driving and robotics. Transformers-based detection head and CNN-based feature encoder to extract features from raw sensor-data has emerged as one of the best…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Apoorv Singh

Autonomous robotic systems and self driving cars rely on accurate perception of their surroundings as the safety of the passengers and pedestrians is the top priority. Semantic segmentation is one the essential components of environmental…

Computer Vision and Pattern Recognition · Computer Science 2021-02-10 Ran Cheng , Ryan Razani , Ehsan Taghavi , Enxu Li , Bingbing Liu

Autonomous driving, in recent years, has been receiving increasing attention for its potential to relieve drivers' burdens and improve the safety of driving. In modern autonomous driving pipelines, the perception system is an indispensable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Jiageng Mao , Shaoshuai Shi , Xiaogang Wang , Hongsheng Li

In recent years, 3D object perception has become a crucial component in the development of autonomous driving systems, providing essential environmental awareness. However, as perception tasks in autonomous driving evolve, their variants…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Yu Wang , Shaohua Wang , Yicheng Li , Mingchun Liu

Multi-modal reasoning systems rely on a pre-trained object detector to extract regions of interest from the image. However, this crucial module is typically used as a black box, trained independently of the downstream task and on a fixed…

Computer Vision and Pattern Recognition · Computer Science 2021-10-13 Aishwarya Kamath , Mannat Singh , Yann LeCun , Gabriel Synnaeve , Ishan Misra , Nicolas Carion

Service mobile robots are often required to avoid dynamic objects while performing their tasks, but they usually have only limited computational resources. To further advance the practical application of service robots in complex dynamic…

Robotics · Computer Science 2026-02-25 Yushen He , Lei Zhao , Tianchen Deng , Zipeng Fang , Weidong Chen

Three-dimensional object detection from a single view is a challenging task which, if performed with good accuracy, is an important enabler of low-cost mobile robot perception. Previous approaches to this problem suffer either from an…

Computer Vision and Pattern Recognition · Computer Science 2019-06-21 Eskil Jörgensen , Christopher Zach , Fredrik Kahl

Object Detection with Transformers (DETR) and related works reach or even surpass the highly-optimized Faster-RCNN baseline with self-attention network architectures. Inspired by the evidence that pure self-attention possesses a strong…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Wenchi Ma , Tianxiao Zhang , Guanghui Wang

Fully autonomous driving systems require fast detection and recognition of sensitive objects in the environment. In this context, intelligent vehicles should share their sensor data with computing platforms and/or other vehicles, to detect…

Networking and Internet Architecture · Computer Science 2021-04-27 Valentina Rossi , Paolo Testolina , Marco Giordani , Michele Zorzi

Automatic Vehicle Detection (AVD) in diverse driving environments presents unique challenges due to varying lighting conditions, road types, and vehicle types. Traditional methods, such as YOLO and Faster R-CNN, often struggle to cope with…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Istiaq Ahmed Fahad , Abdullah Ibne Hanif Arean , Nazmus Sakib Ahmed , Mahmudul Hasan

We propose a 3D object detection system with multi-sensor refinement in the context of autonomous driving. In our framework, the monocular camera serves as the fundamental sensor for 2D object proposal and initial 3D bounding box…

Computer Vision and Pattern Recognition · Computer Science 2019-11-20 Peiliang Li , Siqi Liu , Shaojie Shen

With the rapid advancement of remote sensing technology, high-resolution multi-modal imagery is now more widely accessible. Conventional Object detection models are trained on a single dataset, often restricted to a specific imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Yuxuan Li , Xiang Li , Yunheng Li , Yicheng Zhang , Yimian Dai , Qibin Hou , Ming-Ming Cheng , Jian Yang

Monocular image-based 3D perception has become an active research area in recent years owing to its applications in autonomous driving. Approaches to monocular 3D perception including detection and tracking, however, often yield inferior…

Computer Vision and Pattern Recognition · Computer Science 2022-06-09 Longlong Jing , Ruichi Yu , Henrik Kretzschmar , Kang Li , Charles R. Qi , Hang Zhao , Alper Ayvaci , Xu Chen , Dillon Cower , Yingwei Li , Yurong You , Han Deng , Congcong Li , Dragomir Anguelov

DETR accomplishes end-to-end object detection through iteratively generating multiple object candidates based on image features and promoting one candidate for each ground-truth object. The traditional training procedure using one-to-one…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Chuyang Zhao , Yifan Sun , Wenhao Wang , Qiang Chen , Errui Ding , Yi Yang , Jingdong Wang