English
Related papers

Related papers: Auditing Agent Harness Safety

200 papers

Interactive agent benchmarks map an agent run to a binary outcome through outcome checks. When these checks rely on surface level signals or fail to capture the agent's actual action path, they cannot reliably determine whether the run…

Artificial Intelligence · Computer Science 2026-05-12 Shanshan Gao , Liyi Zhou

With the growing prevalence of large language models (LLMs), the safety of LLMs has raised significant concerns. However, there is still a lack of definitive standards for evaluating their safety due to the subjective nature of current…

Computation and Language · Computer Science 2025-06-10 Chuxue Cao , Han Zhu , Jiaming Ji , Qichao Sun , Zhenghao Zhu , Yinyu Wu , Juntao Dai , Yaodong Yang , Sirui Han , Yike Guo

Organisations are starting to adopt LLM-based AI agents, with their deployments naturally evolving from single agents towards interconnected, multi-agent networks. Yet a collection of safe agents does not guarantee a safe collection of…

Multiagent Systems · Computer Science 2025-08-11 Alistair Reid , Simon O'Callaghan , Liam Carroll , Tiberio Caetano

AI agents are increasingly deployed to execute important tasks. While rising accuracy scores on standard benchmarks suggest rapid progress, many agents still continue to fail in practice. This discrepancy highlights a fundamental limitation…

Artificial Intelligence · Computer Science 2026-02-24 Stephan Rabanser , Sayash Kapoor , Peter Kirgis , Kangheng Liu , Saiteja Utpala , Arvind Narayanan

Large Language Models (LLMs) are increasingly deployed as autonomous agents that reason, use tools, and act over multiple steps. Yet most hallucination benchmarks still evaluate only the final output, missing failures that originate in…

Artificial Intelligence · Computer Science 2026-05-27 Harshada Badave , Santosh Borse , Andrea Gomez , Harshitha Narahari , Sara Carter , Vishwa Bhatt , Aishani Rachakonda , Shuxin Lin , Dhaval Patel

Multi-agent artificial intelligence systems or MAS are systems of autonomous agents that exercise delegated tool authority, share persistent memory, and coordinate via inter-agent communication. MAS introduces qualitatively distinct…

Cryptography and Security · Computer Science 2026-04-28 Tam Nguyen , Moses Ndebugre , Dheeraj Arremsetty

Security incident analysis (SIA) poses a major challenge for security operations centers, which must manage overwhelming alert volumes, large and diverse data sources, complex toolchains, and limited analyst expertise. These difficulties…

Cryptography and Security · Computer Science 2026-03-09 Sourov Jajodia , Madeena Sultana , Suryadipta Majumdar , Adrian Taylor , Grant Vandenberghe

Recent advances in agentic AI have shifted the focus from standalone Large Language Models (LLMs) to integrated systems that combine LLMs with tools, memory, and other agents to perform complex tasks. These multi-agent architectures enable…

Multiagent Systems · Computer Science 2025-12-17 Sreemaee Akshathala , Bassam Adnan , Mahisha Ramesh , Karthik Vaidhyanathan , Basil Muhammed , Kannan Parthasarathy

As language models evolve into autonomous agents that act and communicate on behalf of users, ensuring safety in multi-agent ecosystems becomes a central challenge. Interactions between personal assistants and external service providers…

Cryptography and Security · Computer Science 2025-11-10 Amr Gomaa , Ahmed Salem , Sahar Abdelnabi

Agentic AI systems, which build on Large Language Models (LLMs) and interact with tools and memory, have rapidly advanced in capability and scope. Yet, since LLMs have been shown to struggle in multilingual settings, typically resulting in…

As autonomous agents (e.g., OpenClaw) increasingly operate with deep system-level privileges to execute complex tasks, they introduce severe, unmitigated security risks. Current vulnerability analyses overwhelmingly focus on single-turn,…

Cryptography and Security · Computer Science 2026-05-22 Jianan Ma , Xiaohu Du , Ruixiao Lin , Yaoxiang Bian , Jialuo Chen , Jingyi Wang , Xiaofang Yang , Shiwen Cui , Changhua Meng , Xinhao Deng , Zhen Wang

Artificial Intelligence (AI) has transformed robotics, healthcare, industry, and scientific discovery, yet a major frontier may lie beyond Earth. Space exploration and settlement offer vast environments and resources, but impose constraints…

Multiagent Systems · Computer Science 2026-02-17 Ziyang Wang

Existing Agent benchmarks suffer from two critical limitations: high environment interaction overhead (up to 41\% of total evaluation time) and imbalanced task horizon and difficulty distributions that make aggregate scores unreliable. To…

Artificial Intelligence · Computer Science 2026-04-13 Wang Yang , Chaoda Song , Xinpeng Li , Debargha Ganguly , Chuang Ma , Shouren Wang , Zhihao Dou , Yuli Zhou , Vipin Chaudhary , Xiaotian Han

Large language models are increasingly used for medical guidance, but women's health remains under-evaluated in benchmark design. We present the Women's Health Benchmark (WHBench), a targeted evaluation suite of 47 expert-crafted scenarios…

Computation and Language · Computer Science 2026-04-02 Sneha Maurya , Pragya Saboo , Girish Kumar

LLM agents are increasingly deployed in long-horizon, complex environments to solve challenging problems, but this expansion exposes them to long-horizon attacks that exploit multi-turn user-agent-environment interactions to achieve…

Artificial Intelligence · Computer Science 2026-02-20 Tanqiu Jiang , Yuhui Wang , Jiacheng Liang , Ting Wang

Autonomous unmanned aerial vehicle (UAV) systems are increasingly deployed in safety-critical, networked environments where they must operate reliably in the presence of malicious adversaries. While recent benchmarks have evaluated large…

Cryptography and Security · Computer Science 2026-01-27 Mohamed Amine Ferrag , Abderrahmane Lakas , Merouane Debbah

LLM-based agents execute real-world workflows via tools and memory. These affordances enable ill-intended adversaries to also use these agents to carry out complex misuse scenarios. Existing agent misuse benchmarks largely test…

Computation and Language · Computer Science 2026-05-19 Nivya Talokar , Ayush K Tarun , Murari Mandal , Maksym Andriushchenko , Antoine Bosselut

Computer use agents are LLM-based agents that can directly interact with a graphical user interface, by processing screenshots or accessibility trees. While these systems are gaining popularity, their safety has been largely overlooked,…

Software Engineering · Computer Science 2025-10-30 Thomas Kuntz , Agatha Duzan , Hao Zhao , Francesco Croce , Zico Kolter , Nicolas Flammarion , Maksym Andriushchenko

AI agent systems increasingly rely on reusable non-LLM engineering infrastructure that packages tool mediation, context handling, delegation, safety control, and orchestration. Yet the architectural design decisions in this surrounding…

Artificial Intelligence · Computer Science 2026-04-21 Hu Wei

Multi-agent systems (MAS) may encounter uncertainties in the form of unexpected environmental conditions, sub-optimal system configurations, and unplanned interactions between autonomous agents. The number of combinations of such…

Software Engineering · Computer Science 2022-05-12 Abigail C. Diller , Erik M. Fredericks
‹ Prev 1 8 9 10 Next ›