English
Related papers

Related papers: Architecting Resilient LLM Agents: A Guide to Secu…

200 papers

Current clinical agent built on small LLMs, such as TxAgent suffer from a \textit{Context Utilization Failure}, where models successfully retrieve biomedical evidence due to supervised finetuning but fail to ground their diagnosis in that…

Artificial Intelligence · Computer Science 2025-12-08 Ting-Ting Xie , Yixin Zhang

As language models (LMs) are used to build autonomous agents in real environments, ensuring their adversarial robustness becomes a critical challenge. Unlike chatbots, agents are compound systems with multiple components taking actions,…

Machine Learning · Computer Science 2025-02-06 Chen Henry Wu , Rishi Shah , Jing Yu Koh , Ruslan Salakhutdinov , Daniel Fried , Aditi Raghunathan

The evolution of Large Language Models (LLMs) has resulted in a paradigm shift towards autonomous agents, necessitating robust security against Prompt Injection (PI) vulnerabilities where untrusted inputs hijack agent behaviors. This SoK…

Cryptography and Security · Computer Science 2026-02-12 Peiran Wang , Xinfeng Li , Chong Xiang , Jinghuai Zhang , Ying Li , Lixia Zhang , Xiaofeng Wang , Yuan Tian

Large language models (LLMs) have exhibited remarkable capabilities across diverse open-domain tasks, yet their application in specialized domains such as civil engineering remains largely unexplored. This paper starts bridging this gap by…

Computation and Language · Computer Science 2025-07-08 Jiachen Liu , Ziheng Geng , Ran Cao , Lu Cheng , Paolo Bocchini , Minghui Cheng

While Large Language Models (LLMs) have achieved remarkable success in code generation, they often struggle with the deep, long-horizon reasoning required for complex software engineering. We attribute this limitation to the nature of…

Software Engineering (SE) agents have shown promising abilities in supporting various SE tasks. Current SE agents remain fundamentally reactive, making decisions mainly based on conversation history and the most recent response. However,…

Software Engineering · Computer Science 2026-02-05 Tse-Hsun , Chen

Despite the growing capabilities of autonomous agents powered by large language models (LLMs), their adoption in high-stakes domains remains limited. A key barrier is security: the inherently nondeterministic behavior of LLM agents defies…

Software Engineering · Computer Science 2026-02-12 Adam AlSayyad , Kelvin Yuxiang Huang , Richik Pal

Recent advancements in large language model (LLM)-based agents have demonstrated that collective intelligence can significantly surpass the capabilities of individual agents, primarily due to well-crafted inter-agent communication…

Multiagent Systems · Computer Science 2025-02-07 Guibin Zhang , Yanwei Yue , Xiangguo Sun , Guancheng Wan , Miao Yu , Junfeng Fang , Kun Wang , Tianlong Chen , Dawei Cheng

Advancements in large language models (LLMs) have led to a surge of prompt engineering (PE) techniques that can enhance various requirements engineering (RE) tasks. However, current LLMs are often characterized by significant uncertainty…

Software Engineering · Computer Science 2025-07-11 Kaicheng Huang , Fanyu Wang , Yutan Huang , Chetan Arora

System Instructions in Large Language Models (LLMs) are commonly used to enforce safety policies, define agent behavior, and protect sensitive operational context in agentic AI applications. These instructions may contain sensitive…

Cryptography and Security · Computer Science 2026-04-02 Anubhab Sahu , Diptisha Samanta , Reza Soosahabi

LLM-powered agents are emerging as a dominant paradigm for autonomous task solving. Unlike standard inference workloads, agents operate in a strictly serial "LLM-tool" loop, where the LLM must wait for external tool execution at every step.…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-03-20 Yifan Sui , Han Zhao , Rui Ma , Zhiyuan He , Hao Wang , Jianxun Li , Yuqing Yang

Large language models (LLMs) are increasingly used to automate or augment penetration testing, but their effectiveness and reliability across attack phases remain unclear. We present a comprehensive evaluation of multiple LLM-based agents,…

Artificial Intelligence · Computer Science 2025-11-14 Lanxiao Huang , Daksh Dave , Tyler Cody , Peter Beling , Ming Jin

The increasing demand for software development has driven interest in automating software engineering (SE) tasks using Large Language Models (LLMs). Recent efforts extend LLMs into multi-agent systems (MAS) that emulate collaborative…

Software Engineering · Computer Science 2025-10-15 Zhenyu Mao , Jacky Keung , Fengji Zhang , Shuo Liu , Yifei Wang , Jialong Li

Large language model (LLM) agents typically rely on reactive decision-making paradigms such as ReAct, selecting actions conditioned on growing execution histories. While effective for short tasks, these approaches often lead to redundant…

Artificial Intelligence · Computer Science 2026-03-02 Yihan , Wen , Xin Chen

Large language models (LLMs) are increasingly used to automate scientific workflows, yet their integration with heterogeneous computational tools remains ad hoc and fragile. Current agentic approaches often rely on unstructured text to…

Rapidly evolving cyberattacks demand incident response systems that can autonomously learn and adapt to changing threats. Prior work has extensively explored the reinforcement learning approach, which involves learning response strategies…

Cryptography and Security · Computer Science 2026-04-16 Yiran Gao , Kim Hammar , Tao Li

Connecting large language models (LLMs) to defensive enforcement requires more than asking a model whether an attack is happening. A defender must decide which model outputs may change the system state, which outputs must be rejected, and…

Cryptography and Security · Computer Science 2026-05-22 Sidnei Barbieri , Ágney Lopes Roth Ferraz , Lourenço Alves Pereira Júnior

Multi-robot task planning requires decomposing natural-language instructions into executable actions for heterogeneous robot teams. Conventional Planning Domain Definition Language (PDDL) planners provide rigorous guarantees but struggle to…

Robotics · Computer Science 2026-02-27 Tomoya Kawabe , Rin Takano

Ensuring functional safety in human-robot interaction is challenging because AI perception is inherently probabilistic, whereas industrial standards require deterministic behavior. We present an LLM-guided safety agent for edge robotics,…

Foundation models, such as large language models (LLMs), have been widely recognised as transformative AI technologies due to their capabilities to understand and generate content, including plans with reasoning capabilities. Foundation…

Artificial Intelligence · Computer Science 2024-04-04 Qinghua Lu , Liming Zhu , Xiwei Xu , Zhenchang Xing , Stefan Harrer , Jon Whittle