English
Related papers

Related papers: Beyond Benchmark Islands: Toward Representative Tr…

200 papers

The rise of agentic AI systems, where agents collaborate to perform diverse tasks, poses new challenges with observing, analyzing and optimizing their behavior. Traditional evaluation and benchmarking approaches struggle to handle the…

Artificial Intelligence · Computer Science 2025-03-11 Dany Moshkovich , Hadar Mulian , Sergey Zeltyn , Natti Eder , Inna Skarbovsky , Roy Abitbol

Multi-agent systems powered by large language models (LLMs) are transforming enterprise automation, yet systematic evaluation methodologies for assessing tool-use reliability remain underdeveloped. We introduce a comprehensive diagnostic…

Artificial Intelligence · Computer Science 2026-01-26 Donghao Huang , Gauri Malwe , Zhaoxia Wang

As AI agents proliferate across industries and applications, evaluating their performance based solely on infrastructural metrics such as latency, time-to-first-token, or token throughput is proving insufficient. These metrics fail to…

Artificial Intelligence · Computer Science 2025-11-12 Waseem AlShikh , Muayad Sayed Ali , Brian Kennedy , Dmytro Mozolevskyi

Multi-agent systems achieve state-of-the-art outcomes through peer collaboration. However, when an agent in the pipeline silently drops a constraint, the system's final output may look correct even though the reasoning chain was quietly…

Modern Artificial Intelligence (AI) increasingly relies on multi-agent architectures that blend visual and language understanding. Yet, a pressing challenge remains: How can we trust these agents especially in zero-shot settings with no…

Artificial Intelligence · Computer Science 2025-09-23 Konstantinos I. Roumeliotis , Ranjan Sapkota , Manoj Karkee , Nikolaos D. Tselikas

AI is moving from domain-specific autonomy in closed, predictable settings to large-language-model-driven agents that plan and act in open, cross-organizational environments. As a result, the cybersecurity risk landscape is changing in…

Cryptography and Security · Computer Science 2026-02-03 Alsharif Abuadbba , Nazatul Sultan , Surya Nepal , Sanjay Jha

Advancements in generative models have enabled multi-agent systems (MAS) to perform complex virtual tasks such as writing and code generation, which do not generalize well to physical multi-agent robotic teams. Current frameworks often…

Robotics · Computer Science 2025-06-05 Yuanchen Bai , Zijian Ding , Angelique Taylor

This chapter bridges technical analysis and organizational preparedness by tracing the path from layered failure modes to reliability awareness in generative and agentic AI systems. We first introduce an 11-layer failure stack, a structured…

Systems and Control · Electrical Eng. & Systems 2025-11-11 Janet , Lin , Liangwei Zhang

Across healthcare, agentic artificial intelligence (AI) systems are increasingly promoted as capable of autonomous action, yet in practice they currently operate under near-total human oversight due to safety, regulatory, and liability…

As AI agents transition from research prototypes to enterprise production systems, the tool interfaces they consume remain rooted in human-oriented CRUD paradigms. This paper identifies five fundamental architectural mismatches between…

Artificial Intelligence · Computer Science 2026-05-12 Kai Pan

Agentic AI prototypes are being deployed across domains with increasing speed, yet no methodology for their structured design, governance, and prospective evaluation has been established. Existing AI documentation practices and guidelines…

Software Engineering · Computer Science 2026-03-02 Sebastian Lobentanzer

As humans delegate more tasks and decisions to artificial intelligence (AI), we risk losing control of our individual and collective futures. Relatively simple algorithmic systems already steer human decision-making, such as social media…

Computers and Society · Computer Science 2025-09-11 Benjamin Sturgeon , Daniel Samuelson , Jacob Haimes , Jacy Reese Anthis

This paper presents a conceptual and operational framework for developing and operating safe and trustworthy AI agents based on a Three-Pillar Model grounded in transparency, accountability, and trustworthiness. Building on prior work in…

Computers and Society · Computer Science 2026-01-13 Edward C. Cheng , Jeshua Cheng , Alice Siu

The rapid deployment of large language model (LLM)-based agents introduces a new class of risks, driven by their capacity for autonomous planning, multi-step tool integration, and emergent interactions. It raises some risk factors for…

Multiagent Systems · Computer Science 2025-12-04 Rafflesia Khan , Declan Joyce , Mansura Habiba

Evaluation is no longer a final checkpoint in the machine learning lifecycle. As AI systems evolve from static models to compound, tool-using agents, evaluation becomes a core control function. The question is no longer "How good is the…

Computation and Language · Computer Science 2026-02-23 Ali El Filali , Inès Bedar

Artificial intelligence (AI) systems are evolving beyond passive tools into autonomous agents capable of reasoning, adapting, and acting with minimal human intervention. Despite their growing presence, a structured framework is lacking to…

Artificial Intelligence · Computer Science 2025-08-05 Christopher Wissuchek , Patrick Zschech

Warning: This paper contains content that may be inappropriate or offensive. AI agents have gained significant recent attention due to their autonomous tool usage capabilities and their integration in various real-world applications. This…

Artificial Intelligence · Computer Science 2025-06-24 Ninareh Mehrabi , Tharindu Kumarage , Kai-Wei Chang , Aram Galstyan , Rahul Gupta

The AI trustworthiness crisis threatens to derail the artificial intelligence revolution, with regulatory barriers, security vulnerabilities, and accountability gaps preventing deployment in critical domains. Current AI systems operate on…

Cryptography and Security · Computer Science 2025-11-26 Vineeth Sai Narajala , Manish Bhatt , Idan Habler , Ronald F. Del Rosario , Ads Dawson

Agentic AI systems plan, use tools, maintain state, and act across multi-step workflows with external effects, meaning trustworthy deployment can no longer be judged by task completion alone. The current literature remains fragmented across…

Software Engineering · Computer Science 2026-04-23 Christopher Koch , Joshua Andreas Wellbrock

Existing accountability frameworks for AI systems, legal, ethical, and regulatory, rest on a shared assumption: for any consequential outcome, at least one identifiable person had enough involvement and foresight to bear meaningful…

Artificial Intelligence · Computer Science 2026-04-10 Haileleol Tibebu