English
Related papers

Related papers: The Controllability Trap: A Governance Framework f…

200 papers

Automated control monitors could play an important role in overseeing highly capable AI agents that we do not fully trust. Prior work has explored control monitoring in simplified settings, but scaling monitoring to real-world deployments…

Cryptography and Security · Computer Science 2025-12-30 David Lindner , Charlie Griffin , Tomek Korbak , Roland S. Zimmermann , Geoffrey Irving , Sebastian Farquhar , Alan Cooney

With the rise of generative AI, industry interest in software agents is growing. Given the stochastic nature of generative AI-based agents, their effective and safe deployment in organizations requires robust governance, which can be…

Software Engineering · Computer Science 2025-07-04 Hoang Vu , Nataliia Klievtsova , Henrik Leopold , Stefanie Rinderle-Ma , Timotheus Kampik

Autonomous Artificial Intelligence (AI) agents, powered by Large Language Models (LLMs), advance rapidly toward interconnected systems -- an Internet of Agents (IoA). This vision enables complex problem-solving while introducing systemic…

Multiagent Systems · Computer Science 2026-04-28 Juan A. Wibowo , George C. Polyzos

Contemporary AI governance frameworks rely heavily on post hoc oversight, policy guidance, and behavioral alignment techniques, yet these mechanisms become fragile as systems gain autonomy, speed, and operational opacity. This paper…

Cryptography and Security · Computer Science 2026-03-19 Adam Massimo Mazzocchetti

Existing network paradigms have achieved lower downtime as well as a higher Quality of Experience (QoE) through the use of Artificial Intelligence (AI)-based network management tools. These AI management systems, allow for automatic…

Artificial Intelligence · Computer Science 2025-02-11 Emanuel Figetakis , Ahmed Refaey Hussein

The advancement of large language model (LLM) based agents has shifted AI evaluation from single-turn response assessment to multi-step task completion in interactive environments. We present an empirical study evaluating frontier AI models…

Artificial Intelligence · Computer Science 2026-01-15 Logan Ritchie , Sushant Mehta , Nick Heiner , Mason Yu , Edwin Chen

While individual components of agentic architectures have been studied in isolation, there remains limited empirical understanding of how different design dimensions interact within complex multi-agent systems. This study aims to address…

Artificial Intelligence · Computer Science 2026-01-07 Tara Bogavelli , Roshnee Sharma , Hari Subramani

Machine learning systems deployed in medical devices require governance frameworks that ensure safety while enabling continuous improvement. Regulatory bodies including the FDA and European Union have introduced mechanisms such as the…

Machine Learning · Computer Science 2026-03-25 Fardin Afdideh , Mehdi Astaraki , Fernando Seoane , Farhad Abtahi

Autonomous AI systems generate responsibility gaps: consequential actions that cannot be satisfactorily attributed to developers, operators, or users under existing legal frameworks. The prevailing subject-object dichotomy fails to…

Computers and Society · Computer Science 2026-05-14 Karsten Brensing

Frontier AI systems are rapidly advancing in their capabilities to persuade, deceive, and influence human behaviour, with current models already demonstrating human-level persuasion and strategic deception in specific contexts. Humans are…

Artificial Intelligence · Computer Science 2025-07-18 Rishane Dassanayake , Mario Demetroudi , James Walpole , Lindley Lentati , Jason R. Brown , Edward James Young

Modern engineered systems increasingly involve complex sociotechnical environments where multiple agents, including humans and the emerging paradigm of agentic AI powered by large language models, must navigate social dilemmas that pit…

Artificial Intelligence · Computer Science 2025-10-28 Qiliang Chen , Sepehr Ilami , Nunzio Lore , Babak Heydari

As a transformative general-purpose technology, AI has empowered various industries and will continue to shape our lives through ubiquitous applications. Despite the enormous benefits from wide-spread AI deployment, it is crucial to address…

Computer Science and Game Theory · Computer Science 2023-05-25 Na Zhang , Kun Yue , Chao Fang

Software testing has progressed toward intelligent automation, yet current AI-based test generators still suffer from static, single-shot outputs that frequently produce invalid, redundant, or non-executable tests due to the lack of…

Software Engineering · Computer Science 2026-01-07 Saba Naqvi , Mohammad Baqar , Nawaz Ali Mohammad

The organizational use of artificial intelligence (AI) has rapidly spread across various sectors. Alongside the awareness of the benefits brought by AI, there is a growing consensus on the necessity of tackling the risks and potential…

Artificial Intelligence · Computer Science 2023-02-01 Matti Mäntymäki , Matti Minkkinen , Teemu Birkstedt , Mika Viljanen

As frontier AI models are deployed in high-stakes decision pipelines, their ability to maintain metacognitive stability (knowing what they do not know, detecting errors, seeking clarification) under adversarial pressure is a critical safety…

Artificial Intelligence · Computer Science 2026-05-15 Rahul Kumar

Powerful autonomous systems, which reason, plan, and converse using and between numerous tools and agents, are made possible by Large Language Models (LLMs), Vision-Language Models (VLMs), and new agentic AI systems, like LangChain and…

Cryptography and Security · Computer Science 2025-12-30 Toqeer Ali Syed , Mishal Ateeq Almutairi , Mahmoud Abdel Moaty

Agentic AI systems are entering software engineering workflows, yet empirical evidence on how industrial organizations actually adopt them remains sparse. We present a qualitative interview study with sixteen practitioners across twelve…

Software Engineering · Computer Science 2026-05-15 Spyridon Alvanakis Apostolou , Jan Bosch , Helena Holmström Olsson

AI agent protocols -- including MCP, A2A, ANP, and ACP -- enable autonomous agents to discover capabilities, delegate tasks, and compose services across trust boundaries. Despite massive deployment (MCP alone has 97M+ monthly SDK…

Cryptography and Security · Computer Science 2026-03-26 Shenghan Zheng , Qifan Zhang

Agentic AI systems represent a new frontier in artificial intelligence, where agents often based on large language models(LLMs) interact with tools, environments, and other agents to accomplish tasks with a degree of autonomy. These systems…

Artificial Intelligence · Computer Science 2025-05-13 Sivasathivel Kandasamy

Across healthcare, agentic artificial intelligence (AI) systems are increasingly promoted as capable of autonomous action, yet in practice they currently operate under near-total human oversight due to safety, regulatory, and liability…