English
Related papers

Related papers: Safe Bilevel Delegation (SBD): A Formal Framework …

200 papers

The multi-Agent Pickup and Delivery (MAPD) problem is crucial in the realm of Intelligent Storage Systems (ISSs), where multiple robots are assigned with time-varying, heterogeneous, and potentially uncertain tasks. When it comes to…

Multiagent Systems · Computer Science 2022-03-09 Xin Gong , Tieniu Wang , Yukang Cui , Tingwen Huang

Safe deployment of autonomous robots in diverse scenarios requires agents that are capable of efficiently adapting to new environments while satisfying constraints. In this work, we propose a practical and theoretically-justified approach…

Robotics · Computer Science 2022-02-17 Thomas Lew , Apoorva Sharma , James Harrison , Andrew Bylard , Marco Pavone

In the rapidly evolving landscape of Large Language Models (LLMs), ensuring robust safety measures is paramount. To meet this crucial need, we propose \emph{SALAD-Bench}, a safety benchmark specifically designed for evaluating LLMs, attack,…

Computation and Language · Computer Science 2024-06-10 Lijun Li , Bowen Dong , Ruohui Wang , Xuhao Hu , Wangmeng Zuo , Dahua Lin , Yu Qiao , Jing Shao

This paper proposes a distributed controller synthesis framework for safe navigation of multi-agent systems. We leverage control barrier functions to formulate collision avoidance with obstacles and teammates as constraints on the control…

Systems and Control · Electrical Eng. & Systems 2024-05-03 Pol Mestres , Carlos Nieto-Granda , Jorge Cortés

Large Language Models (LLMs) are increasingly deployed as agents that operate in real-world environments, introducing safety risks beyond linguistic harm. Existing agent safety evaluations rely on risk-oriented tasks tailored to specific…

Artificial Intelligence · Computer Science 2026-02-04 Jingnan Zheng , Yanzhen Luo , Jingjun Xu , Bingnan Liu , Yuxin Chen , Chenhang Cui , Gelei Deng , Chaochao Lu , Xiang Wang , An Zhang , Tat-Seng Chua

This paper develops a stochastic programming framework for multi-agent systems where task decomposition, assignment, and scheduling problems are simultaneously optimized. The framework can be applied to heterogeneous mobile robot teams with…

Robotics · Computer Science 2022-11-15 Bo Fu , William Smith , Denise Rizzo , Matthew Castanier , Maani Ghaffari , Kira Barton

We consider safety-critical multi-agent systems with distributed control architectures and potentially varying network topologies. While learning-based distributed control enables scalability and high performance, a lack of formal safety…

Systems and Control · Electrical Eng. & Systems 2026-04-01 Jonas Ohnemus , Alexandre Didier , Ahmed Aboudonia , Andrea Carron , Melanie N. Zeilinger

Embodied AI systems, including AI-powered robots that autonomously interact with the physical world, stand to be significantly advanced by Large Language Models (LLMs), which enable robots to better understand complex language commands and…

Robotics · Computer Science 2024-09-04 Wenxiao Zhang , Xiangrui Kong , Thomas Braunl , Jin B. Hong

Multi-agent techniques such as role playing or multi-turn debates have been shown to be effective in improving the performance of large language models (LLMs) in downstream tasks. Despite their differences in workflows, existing multi-agent…

Computation and Language · Computer Science 2025-09-25 Yichen Tang , Weihang Su , Yujia Zhou , Yiqun Liu , Min Zhang , Shaoping Ma , Qingyao Ai

The emergence of autonomous Large Language Model (LLM) agents capable of tool usage has introduced new safety risks that go beyond traditional conversational misuse. These agents, empowered to execute external functions, are vulnerable to…

Artificial Intelligence · Computer Science 2025-07-14 Zeyang Sha , Hanling Tian , Zhuoer Xu , Shiwen Cui , Changhua Meng , Weiqiang Wang

Safe navigation is essential for autonomous systems operating in hazardous environments, especially when multiple agents must coordinate using only high-dimensional visual observations. While recent approaches successfully combine…

Robotics · Computer Science 2026-03-24 Viraj Parimi , Brian C. Williams

Generalizing from a single labeled source domain to unseen target domains, without access to any target data during training, remains a fundamental challenge in robust machine learning. We address this underexplored setting, known as Single…

Machine Learning · Computer Science 2026-04-09 Marzi Heidari , Hanping Zhang , Hao Yan , Yuhong Guo

Motivated by emerging applications in wireless sensor networks and large-scale data processing, we consider distributed optimization over directed networks where the agents communicate their information locally to their neighbors to…

Optimization and Control · Mathematics 2021-03-22 Farzad Yousefian

Large language models (LLMs) hold promise in clinical decision support but face major challenges in safety evaluation and effectiveness validation. We developed the Clinical Safety-Effectiveness Dual-Track Benchmark (CSEDB), a…

Scaffolding Large Language Models (LLMs) into multi-agent systems often improves performance on complex tasks, but the safety impact of such scaffolds has not been thoroughly explored. We introduce AgentBreeder, a framework for…

Cryptography and Security · Computer Science 2025-10-15 J Rosser , Jakob Foerster

Safe reinforcement learning has traditionally relied on predefined constraint functions to ensure safety in complex real-world tasks, such as autonomous driving. However, defining these functions accurately for varied tasks is a persistent…

Machine Learning · Computer Science 2025-01-31 Se-Wook Yoo , Seung-Woo Seo

Production LLM agents combine stochastic model outputs with deterministic software systems, yet the boundary between the two is rarely treated as a first-class architectural object. This paper names that boundary the…

Artificial Intelligence · Computer Science 2026-05-20 Vasundra Srinivasan

Large Language Models (LLMs) show growing promise in autonomous driving by reasoning over complex traffic scenarios to generate path plans. However, their tendencies toward overconfidence, and hallucinations raise critical safety concerns.…

Machine Learning · Computer Science 2025-05-16 Achref Doula , Max Mühlhäuser , Alejandro Sanchez Guinea

The emergence of Self-Driving Laboratories (SDLs) transforms scientific discovery methodology by integrating AI with robotic automation to create closed-loop experimental systems capable of autonomous hypothesis generation, experimentation,…

Robotics · Computer Science 2026-02-18 Zihan Zhang , Haohui Que , Junhan Chang , Xin Zhang , Hao Wei , Tong Zhu

This search introduces the Multimodal Socialized Learning Framework (M-S2L), designed to foster emergent social intelligence in AI agents by integrating Multimodal Large Language Models (M-LLMs) with social learning mechanisms. The…

Multiagent Systems · Computer Science 2025-11-12 Sureyya Akin , Shruti T. Tiwari , Ram Bhattacharya , Sagar A. Raman , Kiran Mohanty , Sita Krishnan