English
Related papers

Related papers: TraceAegis: Securing LLM-Based Agents via Hierarch…

200 papers

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies…

Software Engineering · Computer Science 2026-02-12 Adam AlSayyad , Kelvin Yuxiang Huang , Richik Pal

Agentic systems augment large language models with external tools and iterative decision making, enabling complex tasks such as deep research, function calling, and coding. However, their long and intricate execution traces make failure…

Large Language Models (LLMs) agents augmented with domain tools promise to autonomously execute complex tasks requiring human-level intelligence, such as customer service and digital assistance. However, their practical deployment is often…

Multiagent Systems · Computer Science 2025-08-28 Kevin Song , Anand Jayarajan , Yaoyao Ding , Qidong Su , Zhanda Zhu , Sihang Liu , Gennady Pekhimenko

We address the problem of runtime trajectory anomaly detection, a critical capability for enabling trustworthy LLM agents. Current safety measures predominantly focus on static input/output filtering. However, we argue that ensuring LLM…

Cryptography and Security · Computer Science 2026-02-09 Yibing Liu , Chong Zhang , Zhongyi Han , Hansong Liu , Yong Wang , Yang Yu , Xiaoyan Wang , Yilong Yin

LLM agents increasingly operate through multi-turn tool use and environment interaction, where safety risks often emerge from intermediate steps long before they surface in the final outcome. Reactive auditing is therefore insufficient:…

Computation and Language · Computer Science 2026-05-28 Jiaqian Li , Yanshu Li , Boxuan Zhang , Ruixiang Tang , Kuan-Hao Huang

Credible safety plans for advanced AI development require methods to verify agent behavior and detect potential control deficiencies early. A fundamental aspect is ensuring agents adhere to safety-critical principles, especially when these…

Machine Learning · Computer Science 2025-07-11 Ram Potham

Large language model based multi-agent systems (MAS) have unlocked significant advancements in tackling complex problems, but their increasing capability introduces a structural fragility that makes them difficult to debug. A key obstacle…

Trajectory modeling, which includes research on trajectory data pattern mining and future prediction, has widespread applications in areas such as life services, urban transportation, and public administration. Numerous methods have been…

Computation and Language · Computer Science 2025-10-29 Yuwei Du , Jie Feng , Jie Zhao , Yong Li

Sophisticated evasion tactics in malicious Android applications, combined with their intricate behavioral semantics, enable attackers to conceal malicious logic within legitimate functions, underscoring the critical need for robust and…

Software Engineering · Computer Science 2025-09-12 Guangyu Zhang , Xixuan Wang , Shiyu Sun , Peiyan Xiao , Kun Sun , Yanhai Xiong

LLM agents increasingly run inside execution harnesses that dispatch tools, allocate resources, and route messages between specialized components. However, a harness can return a correct, benign answer over a trajectory that accesses…

Computation and Language · Computer Science 2026-05-19 Chengzhi Liu , Yichen Guo , Yepeng Liu , Yuzhe Yang , Qianqi Yan , Xuandong Zhao , Wenyue Hua , Sheng Liu , Sharon Li , Yuheng Bu , Xin Eric Wang

Large language models (LLMs) are increasingly deployed as agents in various contexts by providing tools at their disposal. However, LLM agents can exhibit unpredictable behaviors, including taking undesirable and/or unsafe actions. In order…

Artificial Intelligence · Computer Science 2025-10-27 Ilija Lichkovski , Alexander Müller , Mariam Ibrahim , Tiwai Mhundwa

In Agentic AI, Large Language Models (LLMs) are increasingly used in the orchestration layer to coordinate multiple agents and to interact with external services, retrieval components, and shared memory. In this setting, failures are not…

Multiagent Systems · Computer Science 2026-03-20 Ciprian Paduraru , Petru-Liviu Bouruc , Alin Stefanescu

Evaluating the safety of LLM-based agents is increasingly important because risks in realistic deployments often emerge over multi-step interactions rather than isolated prompts or final responses. Existing trajectory-level benchmarks…

Artificial Intelligence · Computer Science 2026-05-14 Yu Li , Haoyu Luo , Yuejin Xie , Yuqian Fu , Zhonghao Yang , Shuai Shao , Qihan Ren , Wanying Qu , Yanwei Fu , Yujiu Yang , Jing Shao , Xia Hu , Dongrui Liu

Ethereum smart contracts hold tens of billions of USD in DeFi and NFTs, yet comprehensive security analysis remains difficult due to unverified code, proxy-based architectures, and the reliance on manual inspection of complex execution…

Cryptography and Security · Computer Science 2025-09-04 Shuzheng Wang , Yue Huang , Zhuoer Xu , Yuming Huang , Jing Tang

The rise of LLM-based agents shows great potential to revolutionize task planning, capturing significant attention. Given that these agents will be integrated into high-stake domains, ensuring their reliability and safety is crucial. This…

Computation and Language · Computer Science 2024-10-07 Wenyue Hua , Xianjun Yang , Mingyu Jin , Zelong Li , Wei Cheng , Ruixiang Tang , Yongfeng Zhang

Large Language Models (LLMs) are increasingly used in agentic systems, where their interactions with diverse tools and environments create complex, multi-stage safety challenges. However, existing benchmarks mostly rely on static,…

Cryptography and Security · Computer Science 2026-02-03 Liming Lu , Xiang Gu , Junyu Huang , Jiawei Du , Xu Zheng , Yunhuai Liu , Yongbin Zhou , Shuchao Pang

LLM agents are increasingly deployed as executable systems that use tools, modify workspaces, and produce concrete artifacts. In such workflows, performance depends not only on the base model, but also on the harness: the system layer that…

Artificial Intelligence · Computer Science 2026-05-28 Yilun Yao , Xinyu Tan , Chao-Hsuan Liu , Yaoming Li , Zhengyang Wang , Wenhan Yu , Zhewen Tan , Yuxuan Tian , Guangxiang Zhao , Lin Sun , Xiangzheng Zhang , Tong Yang

AI agents powered by large language models (LLMs) are being deployed at scale, yet we lack a systematic understanding of how the choice of backbone LLM affects agent security. The non-deterministic sequential nature of AI agents complicates…

Cryptography and Security · Computer Science 2026-02-25 Julia Bazinska , Max Mathys , Francesco Casucci , Mateo Rojas-Carulla , Xander Davies , Alexandra Souly , Niklas Pfister

As LLM-based agents increasingly rely on external tools, it is important to evaluate their ability to sustain tool-grounded reasoning beyond familiar workflows and short-range interactions. We introduce AgentEscapeBench, an…

Artificial Intelligence · Computer Science 2026-05-21 Zhengkang Guo , Yiyang Li , Lin Qiu , Xiaohua Wang , Jingwen Xv , Dongyu Ru , Xiaoyu Li , Xiaoqing Zheng , Xuezhi Cao , Xunliang Cai

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural…

Cryptography and Security · Computer Science 2026-04-09 Yen-Shan Chen , Sian-Yao Huang , Cheng-Lin Yang , Yun-Nung Chen
‹ Prev 1 2 3 10 Next ›