English
Related papers

Related papers: 123D: Unifying Multi-Modal Autonomous Driving Data…

200 papers

This paper presents a novel approach for learning self-awareness models for autonomous vehicles. The proposed technique is based on the availability of synchronized multi-sensor dynamic data related to different maneuvering tasks performed…

Computer Vision and Pattern Recognition · Computer Science 2018-06-08 Mahdyar Ravanbakhsh , Mohamad Baydoun , Damian Campo , Pablo Marin , David Martin , Lucio Marcenaro , Carlo S. Regazzoni

Semantic segmentation of large-scale 3D point clouds is crucial for applications such as autonomous driving and urban digital twins. However, the sparse sampling pattern of LiDAR and the view-dependent geometric distortion in image…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Shuai Zhang , Zhecheng Shi , Zhuxiao Li , Jing Ou , Tengxi Wang , Yuan Liu , Wufan Zhao

Humans are well-adept at navigating public spaces shared with others, where current autonomous mobile robots still struggle: while safely and efficiently reaching their goals, humans communicate their intentions and conform to unwritten…

Robotics · Computer Science 2023-08-10 Duc M. Nguyen , Mohammad Nazeri , Amirreza Payandeh , Aniket Datar , Xuesu Xiao

This work studies the semantic segmentation of 3D LiDAR data in dynamic scenes for autonomous driving applications. A system of semantic segmentation using 3D LiDAR data, including range image segmentation, sample generation, inter-frame…

Robotics · Computer Science 2018-09-05 Jilin Mei , Biao Gao , Donghao Xu , Wen Yao , Xijun Zhao , Huijing Zhao

End-to-end autonomous driving (E2E-AD) has emerged as a trend in the field of autonomous driving, promising a data-driven, scalable approach to system design. However, existing E2E-AD methods usually adopt the sequential paradigm of…

Machine Learning · Computer Science 2025-07-14 Xiaosong Jia , Junqi You , Zhiyuan Zhang , Junchi Yan

Urban traffic optimization using traffic cameras as sensors is driving the need to advance state-of-the-art multi-target multi-camera (MTMC) tracking. This work introduces CityFlow, a city-scale traffic camera dataset consisting of more…

Computer Vision and Pattern Recognition · Computer Science 2019-04-09 Zheng Tang , Milind Naphade , Ming-Yu Liu , Xiaodong Yang , Stan Birchfield , Shuo Wang , Ratnesh Kumar , David Anastasiu , Jenq-Neng Hwang

This paper describes the first open dataset for full-scale and high-speed autonomous racing. Multi-modal sensor data has been collected from fully autonomous Indy race cars operating at speeds of up to 170 mph (273 kph). Six teams who raced…

Driving scene generation is a critical domain for autonomous driving, enabling downstream applications, including perception and planning evaluation. Occupancy-centric methods have recently achieved state-of-the-art results by offering…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Bohan Li , Xin Jin , Hu Zhu , Hongsi Liu , Ruikai Li , Jiazhe Guo , Kaiwen Cai , Chao Ma , Yueming Jin , Hao Zhao , Xiaokang Yang , Wenjun Zeng

Autonomous vehicles demand detailed maps to maneuver reliably through traffic, which need to be kept up-to-date to ensure a safe operation. A promising way to adapt the maps to the ever-changing road-network is to use crowd-sourced data…

Robotics · Computer Science 2024-10-11 Markus Herb , Nassir Navab , Federico Tombari

We introduce DriveIndia, a large-scale object detection dataset purpose-built to capture the complexity and unpredictability of Indian traffic environments. The dataset contains 66,986 high-resolution images annotated in YOLO format across…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Rishav Kumar , D. Santhosh Reddy , P. Rajalakshmi

Perception systems of autonomous vehicles are susceptible to occlusion, especially when examined from a vehicle-centric perspective. Such occlusion can lead to overlooked object detections, e.g., larger vehicles such as trucks or buses may…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xiaofei Zhang , Yining Li , Jinping Wang , Xiangyi Qin , Ying Shen , Zhengping Fan , Xiaojun Tan

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

Advanced driver assistance systems require a comprehensive understanding of the driver's mental/physical state and traffic context but existing works often neglect the potential benefits of joint learning between these tasks. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Wenzhuo Liu , Wenshuo Wang , Yicheng Qiao , Qiannan Guo , Jiayin Zhu , Pengfei Li , Zilong Chen , Huiming Yang , Zhiwei Li , Lening Wang , Tiao Tan , Huaping Liu

Adapting to a continuously evolving environment is a safety-critical challenge inevitably faced by all autonomous driving systems. Existing image and video driving datasets, however, fall short of capturing the mutable nature of the real…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Tao Sun , Mattia Segu , Janis Postels , Yuxuan Wang , Luc Van Gool , Bernt Schiele , Federico Tombari , Fisher Yu

Autonomous driving systems require a comprehensive understanding of the environment, achieved by extracting visual features essential for perception, planning, and control. However, models trained solely on single-task objectives or generic…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Huy-Dung Nguyen , Anass Bairouk , Mirjana Maras , Wei Xiao , Tsun-Hsuan Wang , Patrick Chareyre , Ramin Hasani , Marc Blanchon , Daniela Rus

Multi-modality fusion is the guarantee of the stability of autonomous driving systems. In this paper, we propose a general multi-modality cascaded fusion framework, exploiting the advantages of decision-level and feature-level fusion,…

Computer Vision and Pattern Recognition · Computer Science 2020-02-11 Hongwu Kuang , Xiaodong Liu , Jingwei Zhang , Zicheng Fang

Smart cities rely on dynamic and real-time data to enable smart urban applications such as intelligent transport and epidemics detection. However, the streaming of big data from IoT devices, especially from mobile platforms like pedestrians…

Cryptography and Security · Computer Science 2016-07-12 Joshua Joy , Ciaran McGoldrick , Mario Gerla

3D multi-object tracking and trajectory prediction are two crucial modules in autonomous driving systems. Generally, the two tasks are handled separately in traditional paradigms and a few methods have started to explore modeling these two…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jiaheng Zhuang , Guoan Wang , Siyu Zhang , Xiyang Wang , Hangning Zhou , Ziyao Xu , Chi Zhang , Zhiheng Li

In this survey, we first introduce the background of popular sensors used for self-driving, their data properties, and the corresponding object detection algorithms. Next, we discuss existing datasets that can be used for evaluating…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Yingjie Wang , Qiuyu Mao , Hanqi Zhu , Jiajun Deng , Yu Zhang , Jianmin Ji , Houqiang Li , Yanyong Zhang

While separately leveraging monocular 3D object detection and 2D multi-object tracking can be straightforwardly applied to sequence images in a frame-by-frame fashion, stand-alone tracker cuts off the transmission of the uncertainty from…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Peixuan Li , Jieyu Jin