English
Related papers

Related papers: Emergence in Multi-Agent Systems: A Safety Perspec…

200 papers

Multi-agent systems (MAS) are widely prevalent and crucially important in numerous real-world applications, where multiple agents must make decisions to achieve their objectives in a shared environment. Despite their ubiquity, the…

Multiagent Systems · Computer Science 2024-07-04 Dom Huh , Prasant Mohapatra

Oft-cited causes of mini-flash crashes include human errors, endogenous feedback loops, the nature of modern liquidity provision, fundamental value shocks, and market fragmentation. We develop a mathematical model which captures aspects of…

Trading and Market Microstructure · Quantitative Finance 2018-08-14 Erhan Bayraktar , Alexander Munk

Autonomous multi-agent systems (MAS) are useful for automating complex tasks but raise trust concerns due to risks such as miscoordination or goal misalignment. Explainability is vital for users' trust calibration, but explainable MAS face…

Artificial Intelligence · Computer Science 2025-10-30 Bálint Gyevnár , Christopher G. Lucas , Stefano V. Albrecht , Shay B. Cohen

In this paper we study the verification of parameterised multi-agent systems (MASs), and in particular the task of verifying whether unwanted states, characterised as a given state formula, are reachable in a given MAS, i.e., whether the…

Artificial Intelligence · Computer Science 2020-08-17 Paolo Felli , Alessandro Gianola , Marco Montali

Analysing learning in Multi-Agent Reinforcement Learning (MARL) environments is challenging, in particular with respect to \textit{individual} decision-making. Practitioners frequently struggle to compare training runs due to the inherent…

Multiagent Systems · Computer Science 2026-05-29 James Rudd-Jones , María Pérez-Ortiz , Mirco Musolesi

In this technical note we consider a class of multi-agent network systems that we refer to as Open Multi-Agent Systems (OMAS): in these multi-agent systems, an indefinite number of agents may join or leave the network at any time. Focusing…

Systems and Control · Electrical Eng. & Systems 2024-09-23 Mauro Franceschelli , Paolo Frasca

Recent work in AI safety has highlighted that in sequential decision making, objectives are often underspecified or incomplete. This gives discretion to the acting agent to realize the stated objective in ways that may result in undesirable…

Artificial Intelligence · Computer Science 2021-06-07 Parand Alizadeh Alamdari , Toryn Q. Klassen , Rodrigo Toro Icarte , Sheila A. McIlraith

Formal modelling of Multi-Agent Systems (MAS) is a challenging task due to high complexity, interaction, parallelism and continuous change of roles and organisation between agents. In this paper we record our research experience on formal…

Multiagent Systems · Computer Science 2010-08-20 Petros Kefalas , Ioanna Stamatopoulou

With the advent of the computational technologies (Graphics Processing Units - GPUs) and Machine Learning, the research domain of crowd simulation for crisis management has flourished. Along with the new techniques and methodologies that…

Multiagent Systems · Computer Science 2020-09-10 George Sidiropoulos , Chairi Kiourt , Lefteris Moussiades

Understanding agent behaviour in Multi-Agent Systems (MAS) is an important problem in domains such as autonomous driving, disaster response, and sports analytics. Existing MAS problems typically use uniform timesteps with observations for…

Machine Learning · Computer Science 2023-02-14 Gregory Everett , Ryan J. Beal , Tim Matthews , Joseph Early , Timothy J. Norman , Sarvapali D. Ramchurn

When independently trained or designed robots are deployed in a shared environment, their combined actions can lead to unintended negative side effects (NSEs). To ensure safe and efficient operation, robots must optimize task performance…

Multiagent Systems · Computer Science 2024-12-20 Pulkit Rustagi , Sandhya Saisubramanian

Measuring the contribution of a bank or an insurance company to overall systemic risk is a key concern, particularly in the aftermath of the 2007--2009 financial crisis and the 2020 downturn. In this paper, we derive worst-case and…

Risk Management · Quantitative Finance 2025-11-18 Jinghui Chen , Edward Furman , X. Sheldon Lin

The engineering and design of self-organizing systems with emergent properties is a long-standing problem in the field of complex and distributed systems, for example in the engineering of self-organizing Multi-Agent Systems. The problem of…

Adaptation and Self-Organizing Systems · Physics 2007-05-23 Jochen Fromm

LLM-empowered agent simulations are increasingly used to study social emergence, yet the micro-to-macro causal mechanisms behind macro outcomes often remain unclear. This is challenging because emergence arises from intertwined agent…

Artificial Intelligence · Computer Science 2026-04-21 Xiangning Yu , Yuwei Guo , Yuqi Hou , Xiao Xue , Qun Ma

We consider the problem of using logged data to make predictions about what would happen if we changed the `rules of the game' in a multi-agent system. This task is difficult because in many cases we observe actions individuals take but not…

Computer Science and Game Theory · Computer Science 2019-04-05 Alexander Peysakhovich , Christian Kroer , Adam Lerer

A hallmark of life on Earth is the ability of agents to exert causal power and be drivers of subsequent events. This is key to cognition at all scales. Causal emergence, measuring the degree to which an agent exerts unique predictive power…

Neural and Evolutionary Computing · Computer Science 2026-05-11 Federico Pigozzi , Michael Levin

Multi-Agent Reinforcement Learning (MARL) is a challenging subarea of Reinforcement Learning due to the non-stationarity of the environments and the large dimensionality of the combined action space. Deep MARL algorithms have been applied…

Machine Learning · Computer Science 2021-07-27 Yuanchao Xu , Amal Feriani , Ekram Hossain

Principled accountability for autonomous decision-making in uncertain environments requires distinguishing intentional outcomes from negligent designs from actual accidents. We propose analyzing the behavior of autonomous agents through a…

Computational models of collaboration without prior coordination often overlook how heterogeneous agent traits and complex task structures jointly produce systemic bottlenecks, inefficiencies, and contribution inequalities. We address this…

Multiagent Systems · Computer Science 2026-05-12 Benjamin Panny , Shashank Mehrotra , Zahra Zahedi , Teruhisa Misu , Kumar Akash

A central challenge in the study of complex systems is the quantification of emergence -- understood as the ability of the system to exhibit collective behaviours that cannot be traced down to the individual components. While recent work…