English
Related papers

Related papers: Alignment Contracts for Agentic Security Systems

200 papers

As foundation models are increasingly deployed as interacting agents in multi-agent systems, their collective behavior raises new challenges for trustworthiness, transparency, and accountability. Traditional coordination mechanisms, such as…

Multiagent Systems · Computer Science 2026-02-24 Brendan Gho , Suman Muppavarapu , Afnan Shaik , Tyson Tsay , Atharva Mohan , James Begin , Kevin Zhu , Archana Vaidheeswaran , Vasu Sharma

Automating scientific computing workflows requires more than generating executable code: autonomous systems must also select appropriate computational strategies, implement them faithfully, and ensure that the resulting outcomes remain…

Artificial Intelligence · Computer Science 2026-05-29 Geremy Loachamín-Suntaxi , Robert Lazar , Dimitrios G. Giovanis , Ioannis G. Kevrekidis , Eleni D. Koronaki

Agentic AI systems plan, use tools, maintain state, and produce multi-step trajectories with external effects. Those properties create a governance problem that differs materially from single-turn generative AI: important risks emerge dur-…

Artificial Intelligence · Computer Science 2026-04-08 Christopher Koch

Large language models (LLMs) are increasingly deployed in agentic systems, where a fundamental task is mapping user intents to relevant external tools. Errors in tool selection can have severe outcomes, such as unauthorized data access,…

Cryptography and Security · Computer Science 2026-05-14 Jehyeok Yeon , Isha Chaudhary , Gagandeep Singh

Federated Leaning is an emerging approach to manage cooperation between a group of agents for the solution of Machine Learning tasks, with the goal of improving each agent's performance without disclosing any data. In this paper we present…

Machine Learning · Computer Science 2022-08-09 Gabriele Santin , Inna Skarbovsky , Fabiana Fournier , Bruno Lepri

Jailbreaks on large language models (LLMs) have recently received increasing attention. For a comprehensive assessment of LLM safety, it is essential to consider jailbreaks with diverse attributes, such as contextual coherence and…

Machine Learning · Computer Science 2024-06-10 Xingang Guo , Fangxu Yu , Huan Zhang , Lianhui Qin , Bin Hu

Agentic AI systems, built upon large language models (LLMs) and deployed in multi-agent configurations, are redefining intelligence, autonomy, collaboration, and decision-making across enterprise and societal domains. This review presents a…

Artificial Intelligence · Computer Science 2025-12-19 Shaina Raza , Ranjan Sapkota , Manoj Karkee , Christos Emmanouilidis

Modern AI agents execute real-world side effects through tool calls such as file operations, shell commands, HTTP requests, and database queries. A single unsafe action, including accidental deletion, credential exposure, or data…

Artificial Intelligence · Computer Science 2026-05-07 Chenglin Yang

Multi-agent systems built on large language models (LLMs) require many coordination choices that are difficult to fix a priori: which skill protocol to invoke, which agent role should perform a subtask, which model to bind to each role, how…

Multiagent Systems · Computer Science 2026-05-28 Nicole Koenigstein

LLM agents rely heavily on high-quality trajectory data to guide their problem-solving behaviors, yet producing such data requires substantial task design, high-capacity model generation, and manual filtering. Despite the high cost of…

Cryptography and Security · Computer Science 2026-05-05 Wenlong Meng , Chen Gong , Terry Yue Zhuo , Fan Zhang , Kecen Li , Zheng Liu , Zhou Yang , Chengkun Wei , Wenzhi Chen

The emergence of LLMs has catalyzed a paradigm shift in autonomous agent development, enabling systems capable of reasoning, planning, and executing complex multi-step tasks. However, existing agent frameworks often suffer from…

Artificial Intelligence · Computer Science 2026-01-21 Akbar Anbar Jafari , Cagri Ozcinar , Gholamreza Anbarjafari

Ensuring safety alignment is a critical requirement for large language models (LLMs), particularly given increasing deployment in real-world applications. Despite considerable advancements, LLMs remain susceptible to jailbreak attacks,…

Cryptography and Security · Computer Science 2025-06-02 Xin Yi , Yue Li , Dongsheng Shi , Linlin Wang , Xiaoling Wang , Liang He

Large Language Models (LLMs) have enabled the emergence of autonomous agents capable of complex reasoning, planning, and interaction. However, coordinating such agents at scale remains a fundamental challenge, particularly in decentralized…

Multiagent Systems · Computer Science 2025-09-23 Minfeng Qi , Tianqing Zhu , Lefeng Zhang , Ningran Li , Wanlei Zhou

We study AI alignment through the lens of law-and-economics models of deterrence and enforcement. In these models, misconduct is not treated as an external failure, but as a strategic response to incentives: an actor weighs the gain from…

Machine Learning · Computer Science 2026-05-12 Rohit Agarwal , Joshua Lin , Mark Braverman , Elad Hazan

The dominant paradigm for building LLM based agents is the Agent Loop, an iterative cycle where a single language model decides what to do next by reading an ever growing context window. This paradigm has three structural weaknesses:…

Artificial Intelligence · Computer Science 2026-04-14 Hu Wei

AI agents dynamically acquire tools, orchestrate sub-agents, and transact across organizational boundaries, yet no existing security layer verifies what an agent can do, whether it executed what it claims, or what happened in a multi-agent…

Cryptography and Security · Computer Science 2026-03-23 Ziling Zhou

Frontier AI systems require governance mechanisms that can verify internal alignment, not just behavioral compliance. Private governance mechanisms audits, certification, insurance, and procurement are emerging to complement public…

Machine Learning · Computer Science 2025-11-21 Aadit Sengupta , Pratinav Seth , Vinay Kumar Sankarapu

We present an end-to-end framework for systematic evaluation of LLM-generated smart contracts from natural-language specifications. The system parses contractual text into structured schemas, generates Solidity code, and performs automated…

Artificial Intelligence · Computer Science 2026-02-17 Abhinav Goel , Chaitya Shah , Agostino Capponi , Alfio Gliozzo

This paper considers the problem of controller synthesis of signal temporal logic (STL) specifications for large-scale multi-agent systems, where the agents are dynamically coupled and subject to collaborative tasks. A compositional…

Systems and Control · Electrical Eng. & Systems 2025-03-18 Siyuan Liu , Adnane Saoud , Dimos V. Dimarogonas

LLM agents increasingly run inside execution harnesses that dispatch tools, allocate resources, and route messages between specialized components. However, a harness can return a correct, benign answer over a trajectory that accesses…

Computation and Language · Computer Science 2026-05-19 Chengzhi Liu , Yichen Guo , Yepeng Liu , Yuzhe Yang , Qianqi Yan , Xuandong Zhao , Wenyue Hua , Sheng Liu , Sharon Li , Yuheng Bu , Xin Eric Wang