English
Related papers

Related papers: ACT-Bench: Towards Action Controllable World Model…

200 papers

Understanding adaptive human driving behavior, in particular how drivers manage uncertainty, is of key importance for developing simulated human driver models that can be used in the evaluation and development of autonomous vehicles.…

Robotics · Computer Science 2023-11-14 Johan Engström , Ran Wei , Anthony McDonald , Alfredo Garcia , Matt O'Kelly , Leif Johnson

Traffic microsimulators are widely used to evaluate road network performance under various ``what-if" conditions. However, the behavior models controlling the actions of the actors are overly simplistic and fails to capture realistic…

Machine Learning · Computer Science 2026-03-20 Yash Ranjan , Rahul Sengupta , Anand Rangarajan , Sanjay Ranka

A trust-aware safe control system for autonomous navigation in the presence of humans, specifically pedestrians, is presented. The system combines model predictive control (MPC) with control barrier functions (CBFs) and trust estimation to…

Systems and Control · Electrical Eng. & Systems 2024-11-01 Saad Ejaz , Masaki Inoue

Generalist robot policies can now perform a wide range of manipulation skills, but evaluating and improving their ability with unfamiliar objects and instructions remains a significant challenge. Rigorous evaluation requires a large number…

Robotics · Computer Science 2026-03-03 Yanjiang Guo , Lucy Xiaoyang Shi , Jianyu Chen , Chelsea Finn

Safety-critical scenarios are essential for training and evaluating autonomous driving (AD) systems, yet remain extremely rare in real-world driving datasets. To address this, we propose Real-world Crash Grounding (RCG), a scenario…

Robotics · Computer Science 2025-07-16 Benjamin Stoler , Juliet Yang , Jonathan Francis , Jean Oh

Human motion trajectory prediction, an essential task for autonomous systems in many domains, has been on the rise in recent years. With a multitude of new methods proposed by different communities, the lack of standardized benchmarks and…

Robotics · Computer Science 2022-07-21 Andrey Rudenko , Luigi Palmieri , Wanting Huang , Achim J. Lilienthal , Kai O. Arras

Closed-loop simulation is essential for advancing end-to-end autonomous driving systems. Contemporary sensor simulation methods, such as NeRF and 3DGS, rely predominantly on conditions closely aligned with training data distributions, which…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Guosheng Zhao , Chaojun Ni , Xiaofeng Wang , Zheng Zhu , Xueyang Zhang , Yida Wang , Guan Huang , Xinze Chen , Boyuan Wang , Youyi Zhang , Wenjun Mei , Xingang Wang

Closed-loop evaluation of autonomous-driving policies requires interactive simulation beyond log replay. However, existing generative world models often degrade in closed loop due to (i) history-free initialization that mismatches policy…

Robotics · Computer Science 2026-03-19 Chaokang Jiang , Desen Zhou , Jiuming Liu , Kevin Li Sun

The adoption of self-driving cars will certainly revolutionize our lives, even though they may take more time to become fully autonomous than initially predicted. The first vehicles are already present in certain cities of the world, as…

Human-Computer Interaction · Computer Science 2023-06-07 Carlos Crispim-Junior , Romain Guesdon , Christophe Jallais , Florent Laroche , Stephanie Souche-Le Corvec , Laure Tougne Rodet

Closed-loop evaluation is increasingly critical for end-to-end autonomous driving. Current closed-loop benchmarks using the CARLA simulator rely on manually configured traffic scenarios, which can diverge from real-world conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Haibao Yu , Wenxian Yang , Ruiyang Hao , Chuanye Wang , Jiaru Zhong , Ping Luo , Zaiqing Nie

Safety is a long-standing and the final pursuit in the development of autonomous driving systems, with a significant portion of safety challenge arising from perception. How to effectively evaluate the safety as well as the reliability of…

As autonomous agents become increasingly sophisticated, validating their sequential behavior presents a significant challenge. Traditional testing approaches require manual specification, exact sequence matching, or thousands of training…

Artificial Intelligence · Computer Science 2026-05-06 Reshabh K Sharma , Gaurav Mittal , Yu Hu

To further improve the learning efficiency and performance of reinforcement learning (RL), in this paper we propose a novel uncertainty-aware model-based RL (UA-MBRL) framework, and then implement and validate it in autonomous driving under…

Robotics · Computer Science 2021-07-06 Jingda Wu , Zhiyu Huang , Chen Lv

With an increasing use of data-driven models to control robotic systems, it has become important to develop a methodology for validating such models before they can be deployed to design a controller for the actual system. Specifically, it…

Systems and Control · Computer Science 2018-03-28 Somil Bansal , Shromona Ghosh , Alberto Sangiovanni-Vincentelli , Sanjit A. Seshia , Claire J. Tomlin

Automated Driving Systems (ADSs) have seen rapid progress in recent years. To ensure the safety and reliability of these systems, extensive testings are being conducted before their future mass deployment. Testing the system on the road is…

Software Engineering · Computer Science 2021-12-03 Ziyuan Zhong , Yun Tang , Yuan Zhou , Vania de Oliveira Neves , Yang Liu , Baishakhi Ray

General-purpose world models promise scalable policy evaluation, optimization, and planning, yet achieving the required level of robustness remains challenging. Unlike policy learning, which primarily focuses on optimal actions, a world…

Machine Learning · Computer Science 2026-04-03 Yuejiang Liu , Fan Feng , Lingjing Kong , Weifeng Lu , Jinzhou Tang , Kun Zhang , Kevin Murphy , Chelsea Finn , Yilun Du

Existing visual trackers mainly operate in a non-interactive, fire-and-forget manner, making them impractical for real-world scenarios that require human-in-the-loop adaptation. To overcome this limitation, we introduce Interactive…

Computer Vision and Pattern Recognition · Computer Science 2026-04-03 Yuqing Huang , Guotian Zeng , Zhenqiao Yuan , Zhenyu He , Xin Li , Yaowei Wang , Ming-Hsuan Yang

Current autonomous driving (AD) simulations are critically limited by their inadequate representation of realistic and diverse human behavior, which is essential for ensuring safety and reliability. Existing benchmarks often simplify…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Mohan Ramesh , Mark Azer , Fabian B. Flohr

Training generalist policies for robotic manipulation has shown great promise, as they enable language-conditioned, multi-task behaviors across diverse scenarios. However, evaluating these policies remains difficult because real-world…

Robotics · Computer Science 2025-12-05 Wei-Cheng Tseng , Jinwei Gu , Qinsheng Zhang , Hanzi Mao , Ming-Yu Liu , Florian Shkurti , Lin Yen-Chen

Autoscaling has become a baseline expectation for cloud-native big data processing, and the design space has expanded beyond rule-based heuristics to include learned controllers and, most recently, large language model (LLM) agents. Yet…

Information Retrieval · Computer Science 2026-05-13 Venkata Krishna Prasanth Budigi , Siri Chandana Sirigiri