English
Related papers

Related papers: Securing Agentic AI: A Comprehensive Threat Model …

200 papers

In an era where digital threats are increasingly sophisticated, the intersection of Artificial Intelligence and cybersecurity presents both promising defenses and potent dangers. This paper delves into the escalating threat posed by the…

Cryptography and Security · Computer Science 2024-08-26 Yusuf Usman , Aadesh Upadhyay , Prashnna Gyawali , Robin Chataut

Generative Artificial Intelligence (GAI) stands at the forefront of AI innovation, demonstrating rapid advancement and unparalleled proficiency in generating diverse content. Beyond content creation, GAI has significant analytical abilities…

Cryptography and Security · Computer Science 2024-02-22 Changyuan Zhao , Hongyang Du , Dusit Niyato , Jiawen Kang , Zehui Xiong , Dong In Kim , Xuemin , Shen , Khaled B. Letaief

This whitepaper highlights the dual importance of securing generative AI (genAI) platforms and leveraging genAI for cybersecurity. As genAI technologies proliferate, their misuse poses significant risks, including data breaches, model…

Cryptography and Security · Computer Science 2024-10-21 Hari Hayagreevan , Souvik Khamaru

Generative AI(GenAI) is a kind of AI model capable of producing human-like content in various modalities, including text, image, audio, video, and computer programming. Although GenAI offers great potential for education, its value often…

Human-Computer Interaction · Computer Science 2025-12-09 Yun Dai , Sichen Lai

The leading AI companies are increasingly focused on building generalist AI agents -- systems that can autonomously plan, act, and pursue goals across almost all tasks that humans can perform. Despite how useful these systems might be,…

The rise of AI agents introduces complex safety and security challenges arising from autonomous tool use and environmental interactions. Current guardrail models lack agentic risk awareness and transparency in risk diagnosis. To introduce…

AI agents -- systems that combine foundation models with reasoning, planning, memory, and tool use -- are rapidly becoming a practical interface between natural-language intent and real-world computation. This survey synthesizes the…

Artificial Intelligence · Computer Science 2026-01-06 Bin Xu

Machine learning-based supervised classifiers are widely used for security tasks, and their improvement has been largely focused on algorithmic advancements. We argue that data challenges that negatively impact the performance of these…

Cryptography and Security · Computer Science 2026-05-29 Shravya Kanchi , Neal Mangaokar , Aravind Cheruvu , Sifat Muhammad Abdullah , Shirin Nilizadeh , Atul Prakash , Bimal Viswanath

Retrieval-augmented generation (RAG) systems have become widely used for enhancing large language model capabilities, but they introduce significant security vulnerabilities through prompt injection attacks. We present a comprehensive…

Cryptography and Security · Computer Science 2025-11-21 Badrinath Ramakrishnan , Akshaya Balaji

When combining Large Language Models (LLMs) with autonomous agents, used in network monitoring and decision-making systems, this will create serious security issues. In this research, the MAESTRO framework consisting of the seven layers…

Cryptography and Security · Computer Science 2025-08-15 Pallavi Zambare , Venkata Nikhil Thanikella , Ying Liu

The adoption of Generative AI (GenAI) in applications inevitably comes with the expansion of the attack surface, combining new security threats along with the traditional ones. Consequently, numerous research and industrial initiatives aim…

Cryptography and Security · Computer Science 2025-08-22 Itay Hazan , Idan Habler , Ron Bitton , Itsik Mantin

AI agents powered by large language models (LLMs) are being deployed at scale, yet we lack a systematic understanding of how the choice of backbone LLM affects agent security. The non-deterministic sequential nature of AI agents complicates…

Cryptography and Security · Computer Science 2026-02-25 Julia Bazinska , Max Mathys , Francesco Casucci , Mateo Rojas-Carulla , Xander Davies , Alexandra Souly , Niklas Pfister

This review critically distinguishes between AI Agents and Agentic AI, offering a structured, conceptual taxonomy, application mapping, and analysis of opportunities and challenges to clarify their divergent design philosophies and…

Artificial Intelligence · Computer Science 2025-10-01 Ranjan Sapkota , Konstantinos I. Roumeliotis , Manoj Karkee

This paper provides a comprehensive review of the future of cybersecurity through Generative AI and Large Language Models (LLMs). We explore LLM applications across various domains, including hardware design security, intrusion detection,…

Autonomous AI agents extend large language models into full runtime systems that load skills, ingest external content, maintain memory, plan multi-step actions, and invoke privileged tools. In such systems, security failures rarely remain…

Cryptography and Security · Computer Science 2026-04-28 Yixiang Zhang , Xinhao Deng , Jiaqing Wu , Yue Xiao , Ke Xu , Qi Li

From automated intrusion testing to discovery of zero-day attacks before software launch, agentic AI calls for great promises in security engineering. This strong capability is bound with a similar threat: the security and research…

Cryptography and Security · Computer Science 2025-05-13 Brian Challita , Pierre Parrend

Agentic AI systems present both significant opportunities and novel risks due to their capacity for autonomous action, encompassing tasks such as code execution, internet interaction, and file modification. This poses considerable…

Artificial Intelligence · Computer Science 2025-12-30 Shaun Khoo , Jessica Foo , Roy Ka-Wei Lee

Generative AI systems produce a range of risks. To ensure the safety of generative AI systems, these risks must be evaluated. In this paper, we make two main contributions toward establishing such evaluations. First, we propose a…

AI agent-based systems are becoming increasingly integral to modern software architectures, enabling autonomous decision-making, dynamic task execution, and multimodal interactions through large language models (LLMs). However, these…

This paper advances a methodological proposal for safety research in agentic AI. As systems acquire planning, memory, tool use, persistent identity, and sustained interaction, safety can no longer be analysed primarily at the level of the…

Computers and Society · Computer Science 2026-04-17 Federico Pierucci , Matteo Prandi , Marcantonio Bracale Syrnikov , Marcello Galisai , Piercosma Bisconti