English
Related papers

Related papers: UniSim: A Neural Closed-Loop Sensor Simulator

200 papers

The development of software components for autonomous driving functions should always include an extensive and rigorous evaluation. Since real-world testing is expensive and safety-critical -- especially when facing dynamic racing scenarios…

Robotics · Computer Science 2020-06-18 Tim Stahl , Johannes Betz

Simulation plays a crucial role in assessing autonomous driving systems, where the generation of realistic multi-agent behaviors is a key aspect. In multi-agent simulation, the primary challenges include behavioral multimodality and…

Artificial Intelligence · Computer Science 2025-01-29 Longzhong Lin , Xuewu Lin , Kechun Xu , Haojian Lu , Lichao Huang , Rong Xiong , Yue Wang

Autonomous vehicles (AVs) are being rapidly introduced into our lives. However, public misunderstanding and mistrust have become prominent issues hindering the acceptance of these driverless technologies. The primary objective of this study…

Human-Computer Interaction · Computer Science 2023-02-20 Zhijie Qiao , Helen Loeb , Venkata Gurrla , Matt Lebermann , Johannes Betz , Rahul Mangharam

Simulation is an indispensable tool in the development and testing of autonomous vehicles (AVs), offering an efficient and safe alternative to road testing. An outstanding challenge with simulation-based testing is the generation of…

Robotics · Computer Science 2024-12-13 Peide Huang , Wenhao Ding , Benjamin Stoler , Jonathan Francis , Bingqing Chen , Ding Zhao

We identify the need for a gamified self-driving simulator where game mechanics encourage high-quality data capture, and design and apply such a simulator to collecting lane-following training data. The resulting synthetic data enables a…

Robotics · Computer Science 2019-11-19 Joshua E. Siegel , Georgios Pappas , Konstantinos Politopoulos , Yongbin Sun

Significant challenges are posed by simulation and testing in the field of low-altitude unmanned aerial vehicle (UAV) traffic due to the high costs associated with large-scale UAV testing and the complexity of establishing low-altitude…

Robotics · Computer Science 2026-01-01 Zonghan Li , Tianwen Tao , Rao Fu , Liang Wang , Dongyuan Zhang , Quan Quan

Developing tools in the context of autonomous systems [22, 24 ], such as self-driving cars (SDCs), is time-consuming and costly since researchers and practitioners rely on expensive computing hardware and simulation software. We propose…

Software Engineering · Computer Science 2024-01-19 Christian Birchler , Cyrill Rohrbach , Timo Kehrer , Sebastiano Panichella

Safety is one of the main challenges that prohibit autonomous vehicles (AV), requiring them to be well tested ahead of being allowed on the road. In comparison with road tests, simulators allow us to validate the AV conveniently and…

Robotics · Computer Science 2021-10-28 John Seymour , Dac-Thanh-Chuong Ho , Quang-Hung Luu

We consider the problem of estimating an object's physical properties such as mass, friction, and elasticity directly from video sequences. Such a system identification problem is fundamentally ill-posed due to the loss of information…

Autonomous robots in endovascular operations have the potential to navigate circulatory systems safely and reliably while decreasing the susceptibility to human errors. However, there are numerous challenges involved with the process of…

Generative models trained on internet data have revolutionized how text, image, and video content can be created. Perhaps the next milestone for generative models is to simulate realistic experience in response to actions taken by humans,…

Artificial Intelligence · Computer Science 2024-09-27 Sherry Yang , Yilun Du , Kamyar Ghasemipour , Jonathan Tompson , Leslie Kaelbling , Dale Schuurmans , Pieter Abbeel

Autonomous driving presents one of the largest problems that the robotics and artificial intelligence communities are facing at the moment, both in terms of difficulty and potential societal impact. Self-driving vehicles (SDVs) are expected…

Simulation agents are essential for designing and testing systems that interact with humans, such as autonomous vehicles (AVs). These agents serve various purposes, from benchmarking AV performance to stress-testing system limits, but all…

Artificial Intelligence · Computer Science 2025-05-21 Daphne Cornelisse , Aarav Pandya , Kevin Joseph , Joseph Suárez , Eugene Vinitsky

Comprehensive testing of autonomous systems through simulation is essential to ensure the safety of autonomous driving vehicles. This requires the generation of safety-critical scenarios that extend beyond the limitations of real-world data…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Hao Li , Chenming Wu , Ming Yuan , Yan Zhang , Chen Zhao , Chunyu Song , Haocheng Feng , Errui Ding , Dingwen Zhang , Jingdong Wang

Conducting real road testing for autonomous driving algorithms can be expensive and sometimes impractical, particularly for small startups and research institutes. Thus, simulation becomes an important method for evaluating these…

The generation of testing and training scenarios for autonomous vehicles has drawn significant attention. While Large Language Models (LLMs) have enabled new scenario generation methods, current methods struggle to balance command adherence…

Artificial Intelligence · Computer Science 2025-10-10 Qingyuan Shi , Qingwen Meng , Hao Cheng , Qing Xu , Jianqiang Wang

With the growing popularity of digital twin and autonomous driving in transportation, the demand for simulation systems capable of generating high-fidelity and reliable scenarios is increasing. Existing simulation systems suffer from a lack…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Licheng Wen , Daocheng Fu , Song Mao , Pinlong Cai , Min Dou , Yikang Li , Yu Qiao

Molecular Dynamics (MD) simulations are essential for understanding the atomic-level behavior of molecular systems, giving insights into their transitions and interactions. However, classical MD techniques are limited by the trade-off…

Biomolecules · Quantitative Biology 2026-04-21 Ziyang Yu , Wenbing Huang , Yang Liu

As perception models continue to develop, the need for large-scale datasets increases. However, data annotation remains far too expensive to effectively scale and meet the demand. Synthetic datasets provide a solution to boost model…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Arpit Jadon , Haoran Wang , Phillip Thomas , Michael Stanley , S. Nathaniel Cibik , Rachel Laurat , Omar Maher , Lukas Hoyer , Ozan Unal , Dengxin Dai

Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Aqeel Anwar , Tae Eun Choe , Zian Wang , Sanja Fidler , Minwoo Park