English
Related papers

Related papers: Beyond single-channel agentic benchmarking

200 papers

As autonomous agentic AI systems see increasing adoption across organisations, persistent challenges in alignment, governance, and risk management threaten to impede deployment at scale. We present AURA (Agent aUtonomy Risk Assessment), a…

Artificial Intelligence · Computer Science 2025-10-20 Lorenzo Satta Chiris , Ayush Mishra

Rapidly evolving AI exhibits increasingly strong autonomy and goal-directed capabilities, accompanied by derivative systemic risks that are more unpredictable, difficult to control, and potentially irreversible. However, current AI safety…

AI agents, specifically powered by large language models, have demonstrated exceptional capabilities in various applications where precision and efficacy are necessary. However, these agents come with inherent risks, including the potential…

Cryptography and Security · Computer Science 2025-03-04 Ishaan Domkundwar , Mukunda N S , Ishaan Bhola , Riddhik Kochhar

As AI models scale to billions of parameters and operate with increasing autonomy, ensuring their safe, reliable operation demands engineering-grade security and assurance frameworks. This paper presents an enterprise-level, risk-aware,…

Cryptography and Security · Computer Science 2025-05-13 Krti Tallam

As AI agents proliferate across industries and applications, evaluating their performance based solely on infrastructural metrics such as latency, time-to-first-token, or token throughput is proving insufficient. These metrics fail to…

Artificial Intelligence · Computer Science 2025-11-12 Waseem AlShikh , Muayad Sayed Ali , Brian Kennedy , Dmytro Mozolevskyi

AI scientists powered by large language models have demonstrated substantial promise in autonomously conducting experiments and facilitating scientific discoveries across various disciplines. While their capabilities are promising, these…

Cybersecurity decision-making increasingly occurs in environments characterized by uncertainty, partial observability, and adversarial manipulation, where heterogeneous signals from multiple sources are often incomplete, ambiguous, or…

Cryptography and Security · Computer Science 2026-05-01 Andrei Kojukhov , Arkady Bovshover

An Artificial Intelligence (AI) agent is a software entity that autonomously performs tasks or makes decisions based on pre-defined objectives and data inputs. AI agents, capable of perceiving user inputs, reasoning and planning tasks, and…

Cryptography and Security · Computer Science 2025-11-26 Zehang Deng , Yongjian Guo , Changzhou Han , Wanlun Ma , Junwu Xiong , Sheng Wen , Yang Xiang

The rapid integration of Large Language Models (LLMs) into high-stakes domains necessitates reliable safety and compliance evaluation. However, existing static benchmarks are ill-equipped to address the dynamic nature of AI risks and…

Artificial Intelligence · Computer Science 2026-05-15 Yixu Wang , Xin Wang , Yang Yao , Xinyuan Li , Xibang Yang , Yan Teng , Xingjun Ma , Yingchun Wang

Agentic AI systems increasingly act through tool-augmented, multi-step workflows whose failures (unsafe tool use, unauthorised actions, social harm) carry deployment-level consequences. Evaluation practice remains fragmented across isolated…

Computation and Language · Computer Science 2026-05-22 Jinhu Qi , Yifan Li , Minghao Zhao , Wentao Zhang , Zijian Zhang , Yaoman Li , Irwin King

AI agents are AI systems that can achieve complex goals autonomously. Assessing the level of agent autonomy is crucial for understanding both their potential benefits and risks. Current assessments of autonomy often focus on specific risks…

Artificial Intelligence · Computer Science 2025-02-24 Peter Cihon , Merlin Stein , Gagan Bansal , Sam Manning , Kevin Xu

The rapid evolution to autonomous, agentic AI systems introduces significant risks due to their inherent unpredictability and emergent behaviors; this also renders traditional verification methods inadequate and necessitates a shift towards…

Artificial Intelligence · Computer Science 2025-09-30 Roham Koohestani

Artificial intelligence systems are now deployed at scale across sectors, accompanied by a growing number of real-world incidents ranging from misinformation and cybercrime to autonomous-system failures. Databases of AI incidents index…

Computers and Society · Computer Science 2026-04-23 Sophia Abraham , Taiye Chen , Cyril Chhun , Giovanna Jaramillo-Gutierrez , Simon Mylius , Sayash Raaj , Peter Slattery , Sean McGregor

We analyze the challenges of benchmarking scientific (multi)-agentic systems, including the difficulty of distinguishing reasoning from retrieval, the risks of data/model contamination, the lack of reliable ground truth for novel research…

Computers and Society · Computer Science 2026-04-07 Marcin Abram

Securing Agentic Artificial Intelligence (AI) systems requires addressing the complex cyber risks introduced by autonomous, decision-making, and adaptive behaviors. Agentic AI systems are increasingly deployed across industries,…

Cryptography and Security · Computer Science 2025-12-23 Sunil Arora , John Hastings

Autonomous Artificial Intelligence (AI) agents, powered by Large Language Models (LLMs), advance rapidly toward interconnected systems -- an Internet of Agents (IoA). This vision enables complex problem-solving while introducing systemic…

Multiagent Systems · Computer Science 2026-04-28 Juan A. Wibowo , George C. Polyzos

Frontier AI systems are rapidly advancing in their capabilities to persuade, deceive, and influence human behaviour, with current models already demonstrating human-level persuasion and strategic deception in specific contexts. Humans are…

Artificial Intelligence · Computer Science 2025-07-18 Rishane Dassanayake , Mario Demetroudi , James Walpole , Lindley Lentati , Jason R. Brown , Edward James Young

Decentralized, agentic AI marketplaces are rapidly emerging to support software engineering tasks such as debugging, patch generation, and security auditing, often operating without centralized oversight. However, existing reputation…

Artificial Intelligence · Computer Science 2026-05-04 Mohd Sameen Chishti , Damilare Peter Oyinloye , Jingyue Li

Recent advances in agentic AI have shifted the focus from standalone Large Language Models (LLMs) to integrated systems that combine LLMs with tools, memory, and other agents to perform complex tasks. These multi-agent architectures enable…

Multiagent Systems · Computer Science 2025-12-17 Sreemaee Akshathala , Bassam Adnan , Mahisha Ramesh , Karthik Vaidhyanathan , Basil Muhammed , Kannan Parthasarathy

When AI agents don't align their actions with human values they may cause serious harm. One way to solve the value alignment problem is by including a human operator who monitors all of the agent's actions. Despite the fact, that this…

Human-Computer Interaction · Computer Science 2023-06-13 Yitzhak Spielberg , Amos Azaria