English
Related papers

Related papers: 123D: Unifying Multi-Modal Autonomous Driving Data…

200 papers

Multiple-object tracking and behavior analysis have been the essential parts of surveillance video analysis for public security and urban management. With billions of surveillance video captured all over the world, multiple-object tracking…

Computer Vision and Pattern Recognition · Computer Science 2020-07-29 Guojun Yin , Bin Liu , Huihui Zhu , Tao Gong , Nenghai Yu

Accurate perception of UAVs in complex low-altitude environments is critical for airspace security and related intelligent systems. Developing reliable solutions requires large-scale, accurately annotated, and multimodal data. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Longkun Zou , Jiale Wang , Rongqin Liang , Hai Wu , Ke Chen , Yaowei Wang

Datasets drive vision progress, yet existing driving datasets are impoverished in terms of visual content and supported tasks to study multitask learning for autonomous driving. Researchers are usually constrained to study a small set of…

Computer Vision and Pattern Recognition · Computer Science 2020-04-09 Fisher Yu , Haofeng Chen , Xin Wang , Wenqi Xian , Yingying Chen , Fangchen Liu , Vashisht Madhavan , Trevor Darrell

Structured 3D representations such as keypoints and meshes offer compact, expressive descriptions of deformable objects, jointly capturing geometric and topological information useful for downstream tasks such as dynamics modeling and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Yeheng Zong , Yizhou Chen , Alexander Bowler , Chia-Tung Yang , Ram Vasudevan

We present 4DLidarOpen, a large-scale open multi-modal dataset for autonomous driving, centered on 4D frequency-modulated continuous-wave (FMCW) Lidar sensing. Unlike conventional time-of-flight Lidar datasets that mainly provide geometric…

Robotics · Computer Science 2026-05-19 Kane Qian , Xin Zhao , Yining Shi , Rujun Yan , Zhengqing Pan , Kaojin Zhu , Mengmeng Yang , Kai Sun , Diange Yang , Kun Jiang

As autonomous driving systems mature, motion forecasting has received increasing attention as a critical requirement for planning. Of particular importance are interactive situations such as merges, unprotected turns, etc., where predicting…

We present a novel dataset covering seasonal and challenging perceptual conditions for autonomous driving. Among others, it enables research on visual odometry, global place recognition, and map-based re-localization tracking. The data was…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Patrick Wenzel , Rui Wang , Nan Yang , Qing Cheng , Qadeer Khan , Lukas von Stumberg , Niclas Zeller , Daniel Cremers

Modern autonomous driving system is characterized as modular tasks in sequential order, i.e., perception, prediction, and planning. In order to perform a wide diversity of tasks and achieve advanced-level intelligence, contemporary…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Yihan Hu , Jiazhi Yang , Li Chen , Keyu Li , Chonghao Sima , Xizhou Zhu , Siqi Chai , Senyao Du , Tianwei Lin , Wenhai Wang , Lewei Lu , Xiaosong Jia , Qiang Liu , Jifeng Dai , Yu Qiao , Hongyang Li

Automated Vehicles (AVs) promise significant advances in transportation. Critical to these improvements is understanding AVs' longitudinal behavior, relying heavily on real-world trajectory data. Existing open-source trajectory datasets of…

Robotics · Computer Science 2025-04-29 Hang Zhou , Ke Ma , Shixiao Liang , Xiaopeng Li , Xiaobo Qu

Even though a significant amount of work has been done to increase the safety of transportation networks, accidents still occur regularly. They must be understood as unavoidable and sporadic outcomes of traffic networks. No public dataset…

Computer Vision and Pattern Recognition · Computer Science 2025-08-20 Walter Zimmer , Ross Greer , Daniel Lehmberg , Marc Pavel , Holger Caesar , Xingcheng Zhou , Ahmed Ghita , Mohan Trivedi , Rui Song , Hu Cao , Akshay Gopalkrishnan , Alois C. Knoll

The creation of large, diverse, high-quality robot manipulation datasets is an important stepping stone on the path toward more capable and robust robotic manipulation policies. However, creating such datasets is challenging: collecting…

Robotics · Computer Science 2025-04-23 Alexander Khazatsky , Karl Pertsch , Suraj Nair , Ashwin Balakrishna , Sudeep Dasari , Siddharth Karamcheti , Soroush Nasiriany , Mohan Kumar Srirama , Lawrence Yunliang Chen , Kirsty Ellis , Peter David Fagan , Joey Hejna , Masha Itkina , Marion Lepert , Yecheng Jason Ma , Patrick Tree Miller , Jimmy Wu , Suneel Belkhale , Shivin Dass , Huy Ha , Arhan Jain , Abraham Lee , Youngwoon Lee , Marius Memmel , Sungjae Park , Ilija Radosavovic , Kaiyuan Wang , Albert Zhan , Kevin Black , Cheng Chi , Kyle Beltran Hatch , Shan Lin , Jingpei Lu , Jean Mercat , Abdul Rehman , Pannag R Sanketi , Archit Sharma , Cody Simpson , Quan Vuong , Homer Rich Walke , Blake Wulfe , Ted Xiao , Jonathan Heewon Yang , Arefeh Yavary , Tony Z. Zhao , Christopher Agia , Rohan Baijal , Mateo Guaman Castro , Daphne Chen , Qiuyu Chen , Trinity Chung , Jaimyn Drake , Ethan Paul Foster , Jensen Gao , Vitor Guizilini , David Antonio Herrera , Minho Heo , Kyle Hsu , Jiaheng Hu , Muhammad Zubair Irshad , Donovon Jackson , Charlotte Le , Yunshuang Li , Kevin Lin , Roy Lin , Zehan Ma , Abhiram Maddukuri , Suvir Mirchandani , Daniel Morton , Tony Nguyen , Abigail O'Neill , Rosario Scalise , Derick Seale , Victor Son , Stephen Tian , Emi Tran , Andrew E. Wang , Yilin Wu , Annie Xie , Jingyun Yang , Patrick Yin , Yunchu Zhang , Osbert Bastani , Glen Berseth , Jeannette Bohg , Ken Goldberg , Abhinav Gupta , Abhishek Gupta , Dinesh Jayaraman , Joseph J Lim , Jitendra Malik , Roberto Martín-Martín , Subramanian Ramamoorthy , Dorsa Sadigh , Shuran Song , Jiajun Wu , Michael C. Yip , Yuke Zhu , Thomas Kollar , Sergey Levine , Chelsea Finn

Autonomous driving has attracted remarkable attention from both industry and academia. An important task is to estimate 3D properties(e.g.translation, rotation and shape) of a moving or parked vehicle on the road. This task, while critical,…

Computer Vision and Pattern Recognition · Computer Science 2018-12-03 Xibin Song , Peng Wang , Dingfu Zhou , Rui Zhu , Chenye Guan , Yuchao Dai , Hao Su , Hongdong Li , Ruigang Yang

Motivated by the impact of large-scale datasets on ML systems we present the largest self-driving dataset for motion prediction to date, containing over 1,000 hours of data. This was collected by a fleet of 20 autonomous vehicles along a…

Computer Vision and Pattern Recognition · Computer Science 2020-11-18 John Houston , Guido Zuidhof , Luca Bergamini , Yawei Ye , Long Chen , Ashesh Jain , Sammy Omari , Vladimir Iglovikov , Peter Ondruska

The increasing applications of autonomous driving systems necessitates large-scale, high-quality datasets to ensure robust performance across diverse scenarios. Synthetic data has emerged as a viable solution to augment real-world datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Enes Özeren , Arka Bhowmick

Automated vehicles rely heavily on data-driven methods, especially for complex urban environments. Large datasets of real world measurement data in the form of road user trajectories are crucial for several tasks like road user prediction…

Computer Vision and Pattern Recognition · Computer Science 2019-11-19 Julian Bock , Robert Krajewski , Tobias Moers , Steffen Runde , Lennart Vater , Lutz Eckstein

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Chiho Choi , Joon Hee Choi , Jiachen Li , Srikanth Malla

Predicting future trajectories of traffic agents in highly interactive environments is an essential and challenging problem for the safe operation of autonomous driving systems. On the basis of the fact that self-driving vehicles are…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Chiho Choi , Joon Hee Choi , Srikanth Malla , Jiachen Li

We introduce M$^3$CAD, a comprehensive benchmark designed to advance research in generic cooperative autonomous driving. M$^3$CAD comprises 204 sequences with 30,000 frames. Each sequence includes data from multiple vehicles and different…

Robotics · Computer Science 2026-03-10 Morui Zhu , Yongqi Zhu , Yihao Zhu , Qi Chen , Deyuan Qu , Song Fu , Qing Yang

Autonomous vehicle (AV) stacks have traditionally relied on decomposed approaches, with separate modules handling perception, prediction, and planning. However, this design introduces information loss during inter-module communication,…

Semantic scene understanding is crucial for robotics and computer vision applications. In autonomous driving, 3D semantic segmentation plays an important role for enabling safe navigation. Despite significant advances in the field, the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Lucas Nunes , Rodrigo Marcuzzi , Jens Behley , Cyrill Stachniss