English
Related papers

Related papers: ScenicNL: Generating Probabilistic Scenario Progra…

200 papers

The ability to develop a high-level understanding of a scene, such as perceiving danger levels, can prove valuable in planning multi-robot search and rescue (SaR) missions. In this work, we propose to uniquely leverage natural language…

Robotics · Computer Science 2021-04-09 Vikram Shree , Beatriz Asfora , Rachel Zheng , Samantha Hong , Jacopo Banfi , Mark Campbell

Current social navigation methods and benchmarks primarily focus on proxemics and task efficiency. While these factors are important, qualitative aspects such as perceptions of a robot's social competence are equally crucial for successful…

Robotics · Computer Science 2024-12-30 Shashank Rao Marpally , Pranav Goyal , Harold Soh

Safety is a critical aspect of the air transport system given even slight operational anomalies can result in serious consequences. To reduce the chances of aviation safety occurrences, accidents and incidents are reported to establish the…

Computation and Language · Computer Science 2025-01-23 Aziida Nanyonga , Hassan Wasswa , Ugur Turhan , Oleksandra Molloy , Graham Wild

Autonomous vehicles (AVs) require extensive testing in simulation, but test case generation for driving scenarios is laborious. The desired scenarios are often out-of-distribution and have precise requirements on interactions with the AV…

Robotics · Computer Science 2026-05-11 Frieda Rong , Chris Zhang , Kelvin Wong , Raquel Urtasun

This study explores integrating large language models (LLMs) with situational awareness-based planning (SAP) to enhance the decision-making capabilities of AI agents in dynamic and uncertain environments. We employ a multi-agent reasoning…

Artificial Intelligence · Computer Science 2024-06-18 Liman Wang , Hanyang Zhong

Motion planning is a crucial component in autonomous driving. State-of-the-art motion planners are trained on meticulously curated datasets, which are not only expensive to annotate but also insufficient in capturing rarely seen critical…

Robotics · Computer Science 2025-05-02 Aizierjiang Aiersilan

In recent years, autonomous driving systems have made significant progress, yet ensuring their safety remains a key challenge. To this end, scenario-based testing offers a practical solution, and simulation-based methods have gained…

Software Engineering · Computer Science 2025-11-07 Jiahui Wu , Chengjie Lu , Aitor Arrieta , Shaukat Ali

Past work has studied event prediction and event language modeling, sometimes mediated through structured representations of knowledge in the form of event schemas. Such schemas can lead to explainable predictions and forecasting of unseen…

Computation and Language · Computer Science 2023-05-25 Anisha Gunjal , Greg Durrett

Two-stage stochastic programs (2SPs) are important tools for making decisions under uncertainty. Decision-makers use contextual information to generate a set of scenarios to represent the true conditional distribution. However, the number…

Optimization and Control · Mathematics 2025-02-11 David Islip , Roy H. Kwon , Sanghyeon Bae , Woo Chang Kim

Complex cyber-physical systems interact in real-time and must consider both timing and uncertainty. Developing software for such systems is expensive and difficult, especially when modeling, inference, and real-time behavior must be…

Programming Languages · Computer Science 2024-07-09 Lars Hummelgren , Matthias Becker , David Broman

Ensuring and improving the safety of autonomous driving systems (ADS) is crucial for the deployment of highly automated vehicles, especially in safety-critical events. To address the rarity issue, adversarial scenario generation methods are…

Machine Learning · Computer Science 2025-06-10 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

This paper summarizes our formal approach to testing autonomous vehicles (AVs) in simulation for the IEEE AV Test Challenge. We demonstrate a systematic testing framework leveraging our previous work on formally-driven simulation for…

Software Engineering · Computer Science 2021-09-01 Kesav Viswanadha , Francis Indaheng , Justin Wong , Edward Kim , Ellen Kalvan , Yash Pant , Daniel J. Fremont , Sanjit A. Seshia

The generation of corner cases has become increasingly crucial for efficiently testing autonomous vehicles prior to road deployment. However, existing methods struggle to accommodate diverse testing requirements and often lack the ability…

Robotics · Computer Science 2024-09-11 Qiujing Lu , Xuanhan Wang , Yiwei Jiang , Guangming Zhao , Mingyue Ma , Shuo Feng

Safety-critical scenarios are central to evaluating autonomous driving systems, yet their rarity in naturalistic logs makes simulation-based stress testing indispensable. Most scenario generation methods treat surrounding agents as…

Artificial Intelligence · Computer Science 2026-05-27 Qiyu Ruan , Yuxuan Wang , He Li , Zhenning Li , Cheng-zhong Xu

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang

Laboratories are prone to severe injuries from minor unsafe actions, yet continuous safety monitoring -- beyond mandatory pre-lab safety training -- is limited by human availability. Vision language models (VLMs) offer promise for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Trishna Chakraborty , Udita Ghosh , Aldair Ernesto Gongora , Ruben Glatt , Yue Dong , Jiachen Li , Amit K. Roy-Chowdhury , Chengyu Song

Large Language Models (LLMs), deep learning architectures with typically over 10 billion parameters, have recently begun to be integrated into various cyber-physical systems (CPS) such as robotics, industrial automation, and autopilot…

Robotics · Computer Science 2026-03-24 Weizhe Xu , Mengyu Liu , Fanxin Kong

Vision-language models (VLMs) have recently emerged as powerful representation learning systems that align visual observations with natural language concepts, offering new opportunities for semantic reasoning in safety-critical autonomous…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Ross Greer , Maitrayee Keskar , Angel Martinez-Sanchez , Parthib Roy , Shashank Shriram , Mohan Trivedi

Scenario-Based Programming is a methodology for modeling and constructing complex reactive systems from simple, stand-alone building blocks, called scenarios. These scenarios are designed to model different traits of the system, and can be…

Software Engineering · Computer Science 2020-10-13 Guy Katz , Assaf Marron , Aviran Sadon , Gera Weiss

The news coverage of events often contains not one but multiple incompatible accounts of what happened. We develop a query-based system that extracts compatible sets of events (scenarios) from such data, formulated as one-class clustering.…

Computation and Language · Computer Science 2019-09-17 Su Wang , Greg Durrett , Katrin Erk