English
Related papers

Related papers: Who is Responsible? Explaining Safety Violations i…

200 papers

Many modern software systems are built as a set of autonomous software components (also called agents) that collaborate with each other and are situated in an environment. To keep these multiagent systems operational under abnormal…

Software Engineering · Computer Science 2024-04-19 João Faccin , Ingrid Nunes , Abdelwahab Hamou-Lhadj

Traffic scenarios are inherently interactive. Multiple decision-makers predict the actions of others and choose strategies that maximize their rewards. We view these interactions from the perspective of game theory which introduces various…

Machine Learning · Computer Science 2020-04-28 Christian Muench , Frans A. Oliehoek , Dariu M. Gavrila

Autonomous vehicles are suited for continuous area patrolling problems. However, finding an optimal patrolling strategy can be challenging for many reasons. Firstly, patrolling environments are often complex and can include unknown…

Artificial Intelligence · Computer Science 2023-06-12 Chenhao Tong , Aaron Harwood , Maria A. Rodriguez , Richard O. Sinnott

Reinforcement learning (RL) is used in many domains, including autonomous driving, robotics, stock trading, and video games. Unfortunately, the black box nature of RL agents, combined with legal and ethical considerations, makes it…

Human-Computer Interaction · Computer Science 2021-11-02 Aditi Mishra , Utkarsh Soni , Jinbin Huang , Chris Bryan

Autonomous systems such as self-driving cars and general-purpose robots are safety-critical systems that operate in highly uncertain and dynamic environments. We propose an interactive multi-agent framework where the system-under-design is…

Machine Learning · Computer Science 2021-07-07 Xin Qin , Nikos Aréchiga , Andrew Best , Jyotirmoy Deshmukh

We examine the problem of adversarial reinforcement learning for multi-agent domains including a rule-based agent. Rule-based algorithms are required in safety-critical applications for them to work properly in a wide range of situations.…

Machine Learning · Computer Science 2019-05-28 Akifumi Wachi

Human drivers naturally balance the risks of different concerns while driving, including traffic rule violations, minor accidents, and fatalities. However, achieving the same behavior in autonomous driving systems remains an open problem.…

Systems and Control · Electrical Eng. & Systems 2026-03-06 Shuhao Qi , Zengjie Zhang , Zhiyong Sun , Sofie Haesaert

Risk management resulting from the actions and states of the different elements making up a operating room is a major concern during a surgical procedure. Agent-based simulation shows an interest through its interaction concepts,…

Artificial Intelligence · Computer Science 2020-07-23 Bruno Perez , Julien Henriet , Christophe Lang , Laurent Philippe

Autonomous vehicles are suited for continuous area patrolling problems. Finding an optimal patrolling strategy can be challenging due to unknown environmental factors, such as wind or landscape; or autonomous vehicles' constraints, such as…

Robotics · Computer Science 2024-02-19 Chenhao Tong , Maria A. Rodriguez , Richard O. Sinnott

Lane change is a very demanding driving task and number of traffic accidents are induced by mistaken maneuvers. An automated lane change system has the potential to reduce driver workload and to improve driving safety. One challenge is how…

Robotics · Computer Science 2021-01-01 Zheng Wang , Muhua Guan , Jin Lan , Bo Yang , Tsutomu Kaizuka , Junichi Taki , Kimihiko Nakano

We investigate methods to provide safety assurances for autonomous agents that incorporate predictions of other, uncontrolled agents' behavior into their own trajectory planning. Given a learning-based forecasting model that predicts…

Systems and Control · Electrical Eng. & Systems 2023-12-14 Anish Muthali , Haotian Shen , Sampada Deglurkar , Michael H. Lim , Rebecca Roelofs , Aleksandra Faust , Claire Tomlin

Organisations are starting to adopt LLM-based AI agents, with their deployments naturally evolving from single agents towards interconnected, multi-agent networks. Yet a collection of safe agents does not guarantee a safe collection of…

Multiagent Systems · Computer Science 2025-08-11 Alistair Reid , Simon O'Callaghan , Liam Carroll , Tiberio Caetano

Driving in a dynamic environment that consists of other actors is inherently a risky task as each actor influences the driving decision and may significantly limit the number of choices in terms of navigation and safety plan. The risk…

Artificial Intelligence · Computer Science 2021-10-20 Saurabh Jha , Yan Miao , Zbigniew Kalbarczyk , Ravishankar K. Iyer

Safe navigation is essential for autonomous systems operating in hazardous environments. Traditional planning methods excel at long-horizon tasks but rely on a predefined graph with fixed distance metrics. In contrast, safe Reinforcement…

Robotics · Computer Science 2025-09-12 Meng Feng , Viraj Parimi , Brian Williams

Automated vehicles have received much attention recently, particularly the DARPA Urban Challenge vehicles, Google's self-driving cars, and various others from auto manufacturers. These vehicles have the potential to significantly reduce…

Computers and Society · Computer Science 2020-11-02 Noah Goodall

Establishing trustworthy safety assurance for autonomous driving systems (ADSs) requires evidence that failures arise from avoidable system deficiencies rather than unavoidable traffic conflicts. Current adversarial simulation methods can…

Robotics · Computer Science 2026-05-14 Yizhuo Xiao , Haotian Yan , Ying Wang , Zhongpan Zhu , Yuxin Zhang , Xintao Yan , Mustafa Suphi Erden , Cheng Wang

We study a human-robot collaborative transportation task in presence of obstacles. The task for each agent is to carry a rigid object to a common target position, while safely avoiding obstacles and satisfying the compliance and actuation…

Robotics · Computer Science 2022-07-14 Tony Zheng , Monimoy Bujarbaruah , Yvonne R. Stürz , Francesco Borrelli

Driving on roads is restricted by various traffic rules, aiming to ensure safety for all traffic participants. However, human road users usually do not adhere to these rules strictly, resulting in varying degrees of rule conformity. Such…

Robotics · Computer Science 2022-07-25 Daniel Bogdoll , Moritz Nekolla , Tim Joseph , J. Marius Zöllner

Reinforcement learning (RL) has recently been used for solving challenging decision-making problems in the context of automated driving. However, one of the main drawbacks of the presented RL-based policies is the lack of safety guarantees,…

Robotics · Computer Science 2021-07-16 Danial Kamran , Yu Ren , Martin Lauer

System safety refers to a diverse engineering discipline assessing and improving various aspects of safety in socio-technical systems and their software-intensive sub-systems. While system safety has been a vital area of applied research…

Software Engineering · Computer Science 2018-12-21 Mario Gleirscher , Anne Nyokabi