English
Related papers

Related papers: BM2CP: Efficient Collaborative Perception with LiD…

200 papers

Temporal perception, defined as the capability to detect and track objects across temporal sequences, serves as a fundamental component in autonomous driving systems. While single-vehicle perception systems encounter limitations, stemming…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zhenwei Yang , Jilei Mao , Wenxian Yang , Yibo Ai , Yu Kong , Haibao Yu , Weidong Zhang

This paper presents a novel multimodal perception system for a real open environment. The proposed system includes an embedded computation platform, cameras, ultrasonic sensors, GPS, and IMU devices. Unlike the traditional frameworks, our…

Robotics · Computer Science 2024-12-03 Yuyang Sha

In cooperative perception studies, there is often a trade-off between communication bandwidth and perception performance. While current feature fusion solutions are known for their excellent object detection performance, transmitting the…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Deyuan Qu , Qi Chen , Yongqi Zhu , Yihao Zhu , Sergei S. Avedisov , Song Fu , Qing Yang

This paper presents a compact and accurate representation of 3D scenes that are observed by a LiDAR sensor and a monocular camera. The proposed method is based on the well-established Stixel model originally developed for stereo vision…

Computer Vision and Pattern Recognition · Computer Science 2018-09-28 Florian Piewak , Peter Pinggera , Markus Enzweiler , David Pfeiffer , Marius Zöllner

Accurate perception of dynamic obstacles is essential for autonomous robot navigation in indoor environments. Although sophisticated 3D object detection and tracking methods have been investigated and developed thoroughly in the fields of…

Robotics · Computer Science 2025-03-03 Zhefan Xu , Haoyu Shen , Xinming Han , Hanyu Jin , Kanlong Ye , Kenji Shimada

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

Leveraging multiple sensors is crucial for robust semantic perception in autonomous driving, as each sensor type has complementary strengths and weaknesses. However, existing sensor fusion methods often treat sensors uniformly across all…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tim Broedermann , Christos Sakaridis , Yuqian Fu , Luc Van Gool

In this paper, we propose an accurate and robust perception module for Autonomous Vehicles (AVs) for drivable space extraction. Perception is crucial in autonomous driving, where many deep learning-based methods, while accurate on benchmark…

Collaborative perception allows each agent to enhance its perceptual abilities by exchanging messages with others. It inherently results in a trade-off between perception ability and communication costs. Previous works transmit complete…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Yue Hu , Xianghe Pang , Xiaoqi Qin , Yonina C. Eldar , Siheng Chen , Ping Zhang , Wenjun Zhang

Collaborative perception is dedicated to tackling the constraints of single-agent perception, such as occlusions, based on the multiple agents' multi-view sensor inputs. However, most existing works assume an ideal condition that all…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Tianhang Wang , Fan Lu , Zehan Zheng , Zhijun Li , Guang Chen , Changjun Jiang

Stand-alone perception systems in autonomous driving suffer from limited sensing ranges and occlusions at extended distances, potentially resulting in catastrophic outcomes. To address this issue, collaborative perception is envisioned to…

Machine Learning · Computer Science 2025-02-18 Yandi Liu , Guowei Liu , Le Liang , Hao Ye , Chongtao Guo , Shi Jin

Sensor-based perception on vehicles are becoming prevalent and important to enhance the road safety. Autonomous driving systems use cameras, LiDAR, and radar to detect surrounding objects, while human-driven vehicles use them to assist the…

Artificial Intelligence · Computer Science 2020-04-24 Shunsuke Aoki , Takamasa Higuchi , Onur Altintas

Autonomous driving has attracted significant attention from both academia and industries, which is expected to offer a safer and more efficient driving system. However, current autonomous driving systems are mostly based on a single…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Senkang Hu , Zhengru Fang , Yiqin Deng , Xianhao Chen , Yuguang Fang

Cooperative perception plays a vital role in extending a vehicle's sensing range beyond its line-of-sight. However, exchanging raw sensory data under limited communication resources is infeasible. Towards enabling an efficient cooperative…

Machine Learning · Computer Science 2021-11-19 Mohamed K. Abdel-Aziz , Cristina Perfecto , Sumudu Samarakoon , Mehdi Bennis , Walid Saad

In this paper, we propose the problem of collaborative perception, where robots can combine their local observations with those of neighboring agents in a learnable way to improve accuracy on a perception task. Unlike existing work in…

Computer Vision and Pattern Recognition · Computer Science 2020-03-24 Yen-Cheng Liu , Junjiao Tian , Chih-Yao Ma , Nathan Glaser , Chia-Wen Kuo , Zsolt Kira

Cooperative perception via communication among intelligent traffic agents has great potential to improve the safety of autonomous driving. However, limited communication bandwidth, localization errors and asynchronized capturing time of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-23 Yunshuang Yuan , Monika Sester

In autonomous driving, cooperative perception makes use of multi-view cameras from both vehicles and infrastructure, providing a global vantage point with rich semantic context of road conditions beyond a single vehicle viewpoint.…

Computer Vision and Pattern Recognition · Computer Science 2024-02-26 Zhe Wang , Siqi Fan , Xiaoliang Huo , Tongda Xu , Yan Wang , Jingjing Liu , Yilun Chen , Ya-Qin Zhang

Collaborative driving systems leverage vehicle-to-everything (V2X) communication for multi-agent collaborative perception to enhance driving safety, yet they remain constrained by scarce annotated real-world V2X driving datasets and limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihang Tao , Yu Guo , Senkang Hu , Yanan Ma , Zihan Fang , Sam Kwong , Yuguang Fang

Gait recognition is a biometric technology that identifies individuals by using walking patterns. Due to the significant achievements of multimodal fusion in gait recognition, we consider employing LiDAR-camera fusion to obtain robust gait…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Yunze Deng , Haijun Xiong , Bin Feng

Single RGB or LiDAR is the mainstream sensor for the challenging scene flow, which relies heavily on visual features to match motion features. Compared with single modality, existing methods adopt a fusion strategy to directly fuse the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Hanyu Zhou , Yi Chang , Zhiwei Shi , Luxin Yan