English
Related papers

Related papers: VISTA 2.0: An Open, Data-driven Simulator for Mult…

200 papers

Pedestrian Intention prediction is one of the key technologies in the transition from level 3 to level 4 autonomous driving. To understand pedestrian crossing behaviour, several elements and features should be taken into consideration to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Aly R. Elkammar , Karim M. Gamaleldin , Catherine M. Elias

It is essential to help drivers have appropriate understandings of level 2 automated driving systems for keeping driving safety. A human machine interface (HMI) was proposed to present real time results of image recognition by the automated…

Human-Computer Interaction · Computer Science 2021-06-28 Bo Yang , Koichiro Inoue , Satoshi Kitazaki , Kimihiko Nakano

Realistic simulators are critical for training and verifying robotics systems. While most of the contemporary simulators are hand-crafted, a scaleable way to build simulators is to use machine learning to learn how the environment behaves…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Seung Wook Kim , Jonah Philion , Antonio Torralba , Sanja Fidler

The field of autonomous driving has grown tremendously over the past few years, along with the rapid progress in sensor technology. One of the major purposes of using sensors is to provide environment perception for vehicle understanding,…

Robotics · Computer Science 2020-08-07 Zhi Yan , Li Sun , Tomas Krajnik , Yassine Ruichek

We introduce VisTA, a new reinforcement learning framework that empowers visual agents to dynamically explore, select, and combine tools from a diverse library based on empirical performance. Existing methods for tool-augmented reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Zeyi Huang , Yuyang Ji , Anirudh Sundara Rajan , Zefan Cai , Wen Xiao , Haohan Wang , Junjie Hu , Yong Jae Lee

Simulation-based testing is a promising approach to significantly reduce the validation effort of automated driving functions. Realistic models of environment perception sensors such as camera, radar and lidar play a key role in this…

Signal Processing · Electrical Eng. & Systems 2020-10-13 Anthony Ngo , Max Paul Bauer , Michael Resch

Machines are a long way from robustly solving open-world perception-control tasks, such as first-person view (FPV) aerial navigation. While recent advances in end-to-end Machine Learning, especially Imitation and Reinforcement Learning…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Rogerio Bonatti , Ratnesh Madaan , Vibhav Vineet , Sebastian Scherer , Ashish Kapoor

An increasing number of studies employ virtual reality (VR) to evaluate interactions between autonomous vehicles (AVs) and pedestrians. VR simulators are valued for their cost-effectiveness, flexibility in developing various traffic…

Human-Computer Interaction · Computer Science 2024-03-19 Tram Thi Minh Tran , Callum Parker , Martin Tomitsch

Augmenting automated vehicles to wirelessly detect and respond to external events before they are detectable by onboard sensors is crucial for developing context-aware driving strategies. To this end, we present an automated vehicle…

Endowed with automation and connectivity, Connected and Automated Vehicles are meant to be a revolutionary promoter for Cooperative Driving Automation. Nevertheless, CAVs need high-fidelity perception information on their surroundings,…

Software Engineering · Computer Science 2023-02-08 Zhengwei Bai , Guoyuan Wu , Xuewei Qi , Yongkang Liu , Kentaro Oguchi , Matthew J. Barth

Autonomous vehicles rely heavily upon their perception subsystems to see the environment in which they operate. Unfortunately, the effect of variable weather conditions presents a significant challenge to object detection algorithms, and…

Vision-based robotic policies often struggle with even minor viewpoint changes, underscoring the need for view-invariant visual representations. This challenge becomes more pronounced in real-world settings, where viewpoint variability is…

Robotics · Computer Science 2026-01-07 Youngjoon Jeong , Junha Chun , Taesup Kim

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

End-to-end visual-based imitation learning has been widely applied in autonomous driving. When deploying the trained visual-based driving policy, a deterministic command is usually directly applied without considering the uncertainty of the…

Robotics · Computer Science 2019-07-19 Lei Tai , Peng Yun , Yuying Chen , Congcong Liu , Haoyang Ye , Ming Liu

Simulating realistic sensors is a challenging part in data generation for autonomous systems, often involving carefully handcrafted sensor design, scene properties, and physics modeling. To alleviate this, we introduce a pipeline for…

Simulation is a crucial step in ensuring accurate, efficient, and realistic Connected and Autonomous Vehicles (CAVs) testing and validation. As the adoption of CAV accelerates, the integration of real-world data into simulation environments…

Robotics · Computer Science 2024-09-27 Junwei You , Pei Li , Yang Cheng , Keshu Wu , Rui Gan , Steven T. Parker , Bin Ran

Due to the lack of enough real multi-agent data and time-consuming of labeling, existing multi-agent cooperative perception algorithms usually select the simulated sensor data for training and validating. However, the perception performance…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Jinlong Li , Runsheng Xu , Xinyu Liu , Baolu Li , Qin Zou , Jiaqi Ma , Hongkai Yu

The design and analysis of systems that combine computational behaviour with physical processes' continuous dynamics - such as movement, velocity, and voltage - is a famous, challenging task. Several theoretical results from programming…

Systems and Control · Electrical Eng. & Systems 2024-11-22 Pedro Mendes , Ricardo Correia , Renato Neves , José Proença

Autonomous vehicles rely on perception systems to understand their surroundings for further navigation missions. Cameras are essential for perception systems due to the advantages of object detection and recognition provided by modern…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 You Li , Julien Moreau , Javier Ibanez-Guzman

Autonomous driving systems rely heavily on robust sensor fusion to perceive complex envi- ronments. Traditional setups using RGB cameras and LiDAR often struggle in high-dynamic- range scenes or high-speed scenarios due to motion blur and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Mustafa Sakhaia , Kaung Sithua , Min Khant Soe Okea , Maciej Wielgosza