English
Related papers

Related papers: TraceAegis: Securing LLM-Based Agents via Hierarch…

200 papers

Large Language Models (LLMs) exhibit substantial promise in enhancing task-planning capabilities within embodied agents due to their advanced reasoning and comprehension. However, the systemic safety of these agents remains an underexplored…

Artificial Intelligence · Computer Science 2025-04-22 Yuting Huang , Leilei Ding , Zhipeng Tang , Tianfu Wang , Xinrui Lin , Wuyang Zhang , Mingxiao Ma , Yanyong Zhang

Since autonomous coding agents generate complex behaviors at high-volume, we may want to use other LLMs to monitor actions to reduce the risk from dangerous misaligned behavior. To better understand the limitations of such monitors against…

Cryptography and Security · Computer Science 2026-05-20 Elle Najt , Colin Toft , Tyler Tracy , Fabien Roger , Joe Benton

The rise of LLM-based agents has opened new frontiers in AI applications, yet evaluating these agents remains a complex and underdeveloped area. This survey provides an in-depth overview of the emerging field of LLM agent evaluation,…

Machine Learning · Computer Science 2025-07-30 Mahmoud Mohammadi , Yipeng Li , Jane Lo , Wendy Yip

Emergency departments worldwide face rising patient volumes, workforce shortages, and variability in triage decisions that threaten the delivery of timely and accurate care. Current triage methods rely primarily on vital signs, routine…

Quantitative Methods · Quantitative Biology 2025-10-21 Kerem Delikoyun , Qianyu Chen , Win Sen Kuan , John Tshon Yit Soong , Matthew Edward Cove , Oliver Hayden

Security Operations Centers (SOCs) are overwhelmed by tens of thousands of daily alerts, with only a small fraction corresponding to genuine attacks. This overload creates alert fatigue, leading to overlooked threats and analyst burnout.…

Computation and Language · Computer Science 2025-10-02 Bowen Wei , Yuan Shen Tay , Howard Liu , Jinhao Pan , Kun Luo , Ziwei Zhu , Chris Jordan

Training trustworthy agentic LLMs requires data that shows the grounded reasoning process, not just the final answer. Existing datasets fall short: question-answering data is outcome-only, chain-of-thought data is not tied to specific…

Information Retrieval · Computer Science 2026-04-30 Saber Zerhoudi , Michael Granitzer , Jelena Mitrovic

As autonomous agents (e.g., OpenClaw) increasingly operate with deep system-level privileges to execute complex tasks, they introduce severe, unmitigated security risks. Current vulnerability analyses overwhelmingly focus on single-turn,…

Cryptography and Security · Computer Science 2026-05-22 Jianan Ma , Xiaohu Du , Ruixiao Lin , Yaoxiang Bian , Jialuo Chen , Jingyi Wang , Xiaofang Yang , Shiwen Cui , Changhua Meng , Xinhao Deng , Zhen Wang

LLM-based agents have recently attracted significant attention due to their ability to autonomously invoke relevant tools to accomplish complex tasks. However, recent studies have shown that these agents face severe security risks, which…

Cryptography and Security · Computer Science 2026-05-28 Jiaqi Luo , Songyang Peng , Jiarun Dai , Zhile Chen , Zhuoxiang Shen , Geng Hong , Xudong Pan , Yuan Zhang , Min Yang

LLM-based agents act through sequences of executable decisions, but their trajectories provide little evidence of which agent or policy produced them, making provenance, ownership, and unauthorized reuse difficult to establish from observed…

Cryptography and Security · Computer Science 2026-05-13 Hyeseon An , Shinwoo Park , Dongsu Kim , Yo-Sub Han

Training AI models has always been challenging, especially when there is a need for custom models to provide personalized services. Algorithm engineers often face a lengthy process to iteratively develop models tailored to specific business…

Artificial Intelligence · Computer Science 2023-11-27 Haoyuan Li , Hao Jiang , Tianke Zhang , Zhelun Yu , Aoxiong Yin , Hao Cheng , Siming Fu , Yuhao Zhang , Wanggui He

Diagnosing failures in LLM agents remains largely manual. Practitioners inspect a small subset of execution traces, form ad-hoc hypotheses, and iterate. This process misses patterns that only emerge across trace populations and does not…

Artificial Intelligence · Computer Science 2026-05-22 Akshay Manglik , Apaar Shanker , Kaustubh Deshpande , Jason Qin , Yash Maurya , Veronica Chatrath , Vijay S. Kalmath , Levi Lentz , Yuan , Xue

Large Language Models (LLMs) often generate code with subtle but critical bugs, especially for complex tasks. Existing automated repair methods typically rely on superficial pass/fail signals, offering limited visibility into program…

Software Engineering · Computer Science 2026-02-09 Jiangping Huang , Wenguang Ye , Weisong Sun , Jian Zhang , Mingyue Zhang , Yang Liu

Significant progress has been made in automated problem-solving using societies of agents powered by large language models (LLMs). In finance, efforts have largely focused on single-agent systems handling specific tasks or multi-agent…

Trading and Market Microstructure · Quantitative Finance 2025-06-04 Yijia Xiao , Edward Sun , Di Luo , Wei Wang

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Artificial Intelligence · Computer Science 2026-02-18 Sanidhya Vijayvargiya , Aditya Bharat Soni , Xuhui Zhou , Zora Zhiruo Wang , Nouha Dziri , Graham Neubig , Maarten Sap

Multimodal large language models (MLLMs) have enabled LLM-based agents to directly interact with application user interfaces (UIs), enhancing agents' performance in complex tasks. However, these agents often suffer from high latency and low…

Artificial Intelligence · Computer Science 2025-05-20 Junting Lu , Zhiyang Zhang , Fangkai Yang , Jue Zhang , Lu Wang , Chao Du , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Agentic AI systems, built upon large language models (LLMs) and deployed in multi-agent configurations, are redefining intelligence, autonomy, collaboration, and decision-making across enterprise and societal domains. This review presents a…

Artificial Intelligence · Computer Science 2025-12-19 Shaina Raza , Ranjan Sapkota , Manoj Karkee , Christos Emmanouilidis

The rapid deployment of LLM-based autonomous agents has introduced safety risks that extend far beyond traditional LLM concerns, prompting a proliferation of safety benchmarks since late 2023. However, these benchmarks have developed…

Computers and Society · Computer Science 2026-05-19 Miles Q. Li , Benjamin C. M. Fung , Boyang Li , Heba Ismail , Farkhund Iqbal

LLM-powered agents face a persistent challenge: learning from their execution experiences to improve future performance. While agents can successfully complete many tasks, they often repeat inefficient patterns, fail to recover from similar…

Artificial Intelligence · Computer Science 2026-03-12 Gaodan Fang , Vatche Isahagian , K. R. Jayaram , Ritesh Kumar , Vinod Muthusamy , Punleuk Oum , Gegi Thomas

Proactive agents that anticipate user intentions without explicit prompts represent a significant evolution in human-AI interaction, promising to reduce cognitive load and streamline workflows. However, existing datasets suffer from two…

Human-Computer Interaction · Computer Science 2026-02-11 Yuanbo Tang , Huaze Tang , Tingyu Cao , Lam Nguyen , Anping Zhang , Xinwen Cao , Chunkang Liu , Wenbo Ding , Yang Li

Previous works on the CERT insider threat detection case have neglected graph and text features despite their relevance to describe user behavior. Additionally, existing systems heavily rely on feature engineering and audit data aggregation…

Machine Learning · Computer Science 2020-07-15 Mathieu Garchery , Michael Granitzer