English
Related papers

Related papers: Who is Responsible? Explaining Safety Violations i…

200 papers

A particular challenge for both autonomous and human driving is dealing with risk associated with dynamic occlusion, i.e., occlusion caused by other vehicles in traffic. Based on the theory of hypergames, we develop a novel multi-agent…

Robotics · Computer Science 2026-02-02 Maximilian Kahn , Atrisha Sarkar , Krzysztof Czarnecki

Vehicular traffic is a classical example of a multi-agent system in which autonomous drivers operate in a shared environment. The article provides an overview of the state-of-the-art in microscopic traffic modeling and the implications for…

Physics and Society · Physics 2009-10-26 Arne Kesting , Martin Treiber , Dirk Helbing

Predicting the outcomes of cyber-physical systems with multiple human interactions is a challenging problem. This article reviews a game theoretical approach to address this issue, where reinforcement learning is employed to predict the…

Multiagent Systems · Computer Science 2019-10-14 Mert Albaba , Yildiray Yildiz

Letting robots emulate human behavior has always posed a challenge, particularly in scenarios involving multiple robots. In this paper, we presented a framework aimed at achieving multi-agent reinforcement learning for robot control in…

Robotics · Computer Science 2023-05-25 Kangkang Duan , Christine Wun Ki Suen , Zhengbo Zou

It is widely acknowledged that we need to establish where responsibility lies for the outputs and impacts of AI-enabled systems. This is important to achieve justice and compensation for victims of AI harms, and to inform policy and…

Artificial Intelligence · Computer Science 2025-08-19 Zoe Porter , Philippa Ryan , Phillip Morgan , Joanna Al-Qaddoumi , Bernard Twomey , Paul Noordhof , John McDermid , Ibrahim Habli

Industry practitioners and academic researchers regularly use multi-agent systems to accelerate their work, but the applications through which users operate these systems do not provide a simple, unified mechanism for scalably managing…

Multiagent Systems · Computer Science 2026-05-19 Christopher J. Agostino , Nayan D'Souza

In safety-critical applications, autonomous agents may need to learn in an environment where mistakes can be very costly. In such settings, the agent needs to behave safely not only after but also while learning. To achieve this, existing…

Machine Learning · Computer Science 2021-01-22 Matteo Turchetta , Andrey Kolobov , Shital Shah , Andreas Krause , Alekh Agarwal

Blame attribution is one of the key aspects of accountable decision making, as it provides means to quantify the responsibility of an agent for a decision making outcome. In this paper, we study blame attribution in the context of…

Artificial Intelligence · Computer Science 2022-01-26 Stelios Triantafyllou , Adish Singla , Goran Radanovic

Generative multiagent systems are rapidly emerging as transformative tools for scalable automation and adaptive decisionmaking in telecommunications. Despite their promise, these systems introduce novel risks that remain underexplored,…

Systems and Control · Electrical Eng. & Systems 2025-11-25 Zeinab Nezami , Shehr Bano , Abdelaziz Salama , Maryam Hafeez , Syed Ali Raza Zaidi

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

How to attribute responsibility for autonomous artificial intelligence (AI) systems' actions has been widely debated across the humanities and social science disciplines. This work presents two experiments ($N$=200 each) that measure…

Computers and Society · Computer Science 2021-02-02 Gabriel Lima , Nina Grgić-Hlača , Meeyoung Cha

We introduce a family of quantitative measures of responsibility in multi-agent planning, building upon the concepts of causal responsibility proposed by Parker et al.~[ParkerGL23]. These concepts are formalised within a variant of…

Multiagent Systems · Computer Science 2024-11-05 Chunyan Mu , Nir Oren

The ethics of automated vehicles (AV) has received a great amount of attention in recent years, specifically in regard to their decisional policies in accident situations in which human harm is a likely consequence. After a discussion about…

Artificial Intelligence · Computer Science 2023-08-10 Katherine Evans , Nelson de Moura , Raja Chatila , Stéphane Chauvier

Large Language Model (LLM)-based agents are widely used in real-world applications such as customer service, web navigation, and software engineering. As these systems become more autonomous and are deployed at scale, understanding why an…

Artificial Intelligence · Computer Science 2026-02-06 Chen Qian , Peng Wang , Dongrui Liu , Junyao Yang , Dadi Guo , Ling Tang , Jilin Mei , Qihan Ren , Shuai Shao , Yong Liu , Jie Fu , Jing Shao , Xia Hu

Ensuring the safety of embodied AI agents during task planning is critical for real-world deployment, especially in household environments where dangerous instructions pose significant risks. Existing methods often suffer from either high…

Artificial Intelligence · Computer Science 2025-11-27 Junjian Wang , Lidan Zhao , Xi Sheryl Zhang

Law codes and regulations help organise societies for centuries, and as AI systems gain more autonomy, we question how human-agent systems can operate as peers under the same norms, especially when resources are contended. We posit that…

Multiagent Systems · Computer Science 2022-02-24 Alex Raymond , Hatice Gunes , Amanda Prorok

Large language model (LLM)-based agents are increasingly used to perform complex, multi-step workflows in regulated settings such as compliance and due diligence. However, many agentic architectures rely primarily on prompt engineering of a…

Artificial Intelligence · Computer Science 2026-02-03 Ananya Joshi , Michael Rudow

We study a novel graph path planning problem for multiple agents that may crash at runtime, and block part of the workspace. In our setting, agents can detect neighboring crashed agents, and change followed paths at runtime. The objective…

Robotics · Computer Science 2022-11-28 Keisuke Okumura , Sébastien Tixeuil

LLM-powered Multi-Agent Systems (LLM-MAS) unlock new potentials in distributed reasoning, collaboration, and task generalization but also introduce additional risks due to unguaranteed agreement, cascading uncertainty, and adversarial…

Multiagent Systems · Computer Science 2025-10-22 Jinwei Hu , Yi Dong , Shuang Ao , Zhuoyun Li , Boxuan Wang , Lokesh Singh , Guangliang Cheng , Sarvapali D. Ramchurn , Xiaowei Huang

We study the multi-agent safe control problem where agents should avoid collisions to static obstacles and collisions with each other while reaching their goals. Our core idea is to learn the multi-agent control policy jointly with learning…

Multiagent Systems · Computer Science 2021-04-20 Zengyi Qin , Kaiqing Zhang , Yuxiao Chen , Jingkai Chen , Chuchu Fan