English
Related papers

Related papers: A Comparative Evaluation of AI Agent Security Guar…

200 papers

In the rapidly evolving landscape of communication and network security, the increasing reliance on deep neural networks (DNNs) and cloud services for data processing presents a significant vulnerability: the potential for backdoors that…

Cryptography and Security · Computer Science 2024-03-14 Khondoker Murad Hossain , Tim Oates

We present the first comprehensive evaluation of AI agents against human cybersecurity professionals in a live enterprise environment. We evaluate ten cybersecurity professionals alongside six existing AI agents and ARTEMIS, our new agent…

The rapid advancement and deployment of AI systems have created an urgent need for standard safety-evaluation frameworks. This paper introduces AILuminate v1.0, the first comprehensive industry-standard benchmark for assessing AI-product…

Computers and Society · Computer Science 2025-04-22 Shaona Ghosh , Heather Frase , Adina Williams , Sarah Luger , Paul Röttger , Fazl Barez , Sean McGregor , Kenneth Fricklas , Mala Kumar , Quentin Feuillade--Montixi , Kurt Bollacker , Felix Friedrich , Ryan Tsang , Bertie Vidgen , Alicia Parrish , Chris Knotz , Eleonora Presani , Jonathan Bennion , Marisa Ferrara Boston , Mike Kuniavsky , Wiebke Hutiri , James Ezick , Malek Ben Salem , Rajat Sahay , Sujata Goswami , Usman Gohar , Ben Huang , Supheakmungkol Sarin , Elie Alhajjar , Canyu Chen , Roman Eng , Kashyap Ramanandula Manjusha , Virendra Mehta , Eileen Long , Murali Emani , Natan Vidra , Benjamin Rukundo , Abolfazl Shahbazi , Kongtao Chen , Rajat Ghosh , Vithursan Thangarasa , Pierre Peigné , Abhinav Singh , Max Bartolo , Satyapriya Krishna , Mubashara Akhtar , Rafael Gold , Cody Coleman , Luis Oala , Vassil Tashev , Joseph Marvin Imperial , Amy Russ , Sasidhar Kunapuli , Nicolas Miailhe , Julien Delaunay , Bhaktipriya Radharapu , Rajat Shinde , Tuesday , Debojyoti Dutta , Declan Grabb , Ananya Gangavarapu , Saurav Sahay , Agasthya Gangavarapu , Patrick Schramowski , Stephen Singam , Tom David , Xudong Han , Priyanka Mary Mammen , Tarunima Prabhakar , Venelin Kovatchev , Rebecca Weiss , Ahmed Ahmed , Kelvin N. Manyeki , Sandeep Madireddy , Foutse Khomh , Fedor Zhdanov , Joachim Baumann , Nina Vasan , Xianjun Yang , Carlos Mougn , Jibin Rajan Varghese , Hussain Chinoy , Seshakrishna Jitendar , Manil Maskey , Claire V. Hardgrove , Tianhao Li , Aakash Gupta , Emil Joswin , Yifan Mai , Shachi H Kumar , Cigdem Patlak , Kevin Lu , Vincent Alessi , Sree Bhargavi Balija , Chenhe Gu , Robert Sullivan , James Gealy , Matt Lavrisa , James Goel , Peter Mattson , Percy Liang , Joaquin Vanschoren

The rapid advancements in Large Language Models (LLMs) have enabled their deployment as autonomous agents for handling complex tasks in dynamic environments. These LLMs demonstrate strong problem-solving capabilities and adaptability to…

Artificial Intelligence · Computer Science 2025-02-19 Weidi Luo , Shenghong Dai , Xiaogeng Liu , Suman Banerjee , Huan Sun , Muhao Chen , Chaowei Xiao

Autonomous AI agents powered by large language models are being deployed in production with capabilities including shell execution, file system access, database queries, and multi-party communication. Recent red teaming research…

Cryptography and Security · Computer Science 2026-03-19 Saikat Maiti

Safety filtering is an effective method for enforcing constraints in safety-critical systems, but existing methods typically assume perfect state information. This limitation is especially problematic for systems that rely on neural network…

Systems and Control · Electrical Eng. & Systems 2026-02-06 Nicholas Rober , Alex Rose , Jonathan P. How

Agentic AI systems plan, use tools, maintain state, and produce multi-step trajectories with external effects. Those properties create a governance problem that differs materially from single-turn generative AI: important risks emerge dur-…

Artificial Intelligence · Computer Science 2026-04-08 Christopher Koch

AI agents augment large language models with external tools such as web retrieval, enabling grounded and up-to-date responses. However, incorporating external content into the generation pipeline can weaken the safety alignment mechanisms…

Computation and Language · Computer Science 2026-05-29 Aditya Nawal , Manit Baser , Mohan Gurusamy

The proliferation of AI technology gives rise to a variety of security threats, which significantly compromise the confidentiality and integrity of AI models and applications. Existing software-based solutions mainly target one specific…

Cryptography and Security · Computer Science 2023-11-29 Xiaobei Yan , Han Qiu , Tianwei Zhang

The rapid and dynamic pace of Artificial Intelligence (AI) and Machine Learning (ML) is revolutionizing the insurance sector. AI offers significant, very much welcome advantages to insurance companies, and is fundamental to their…

Machine Learning · Computer Science 2023-01-19 Elisa Luciano , Matteo Cattaneo , Ron Kenett

Agentic AI introduces security vulnerabilities that traditional LLM safeguards fail to address. Although recent work by Unit 42 at Palo Alto Networks demonstrated that ChatGPT-4o successfully executes attacks as an agent that it refuses in…

Cryptography and Security · Computer Science 2025-12-18 Viet K. Nguyen , Mohammad I. Husain

Foundation Model (FM)-based agents are revolutionizing application development across various domains. However, their rapidly growing capabilities and autonomy have raised significant concerns about AI safety. Researchers are exploring…

Software Engineering · Computer Science 2025-01-28 Md Shamsujjoha , Qinghua Lu , Dehai Zhao , Liming Zhu

Ensuring the safety of large language models (LLMs) is critical as they are deployed in real-world applications. Existing guardrails rely on rule-based filtering or single-pass classification, limiting their ability to handle nuanced safety…

Computation and Language · Computer Science 2025-05-29 Xiaofei Wen , Wenxuan Zhou , Wenjie Jacky Mo , Muhao Chen

Generative AI systems are increasingly used not only to produce content but also to retrieve data, invoke tools, and execute actions. This work examines the security and safety implications of that shift across content-level, model-level,…

Cryptography and Security · Computer Science 2026-05-19 Zelin Zhang , Qi Li , Jie Cao , Lingshuang Liu , Jianbing Ni

From face recognition systems installed in phones to self-driving cars, the field of AI is witnessing rapid transformations and is being integrated into our everyday lives at an incredible pace. Any major failure in these system's…

Cryptography and Security · Computer Science 2020-12-14 Ayush Goel

The impact of frontier AI (i.e., AI agents and foundation models) in cybersecurity is rapidly increasing. In this paper, we comprehensively analyze this trend through multiple aspects: quantitative benchmarks, qualitative literature review,…

Cryptography and Security · Computer Science 2025-12-01 Yujin Potter , Wenbo Guo , Zhun Wang , Tianneng Shi , Hongwei Li , Andy Zhang , Patrick Gage Kelley , Kurt Thomas , Dawn Song

This chapter is on the security assessment of artificial intelligence (AI) and neural network (NN) accelerators in the face of fault injection attacks. More specifically, it discusses the assets on these platforms and compares them with…

Cryptography and Security · Computer Science 2021-02-12 Shahin Tajik , Fatemeh Ganji

Guardrails are critical for the safe deployment of Large Language Models (LLMs)-powered software. Unlike traditional rule-based systems with limited, predefined input-output spaces that inherently constrain unsafe behavior, LLMs enable…

Cryptography and Security · Computer Science 2025-09-23 Rui Yang , Michael Fu , Chakkrit Tantithamthavorn , Chetan Arora , Gunel Gulmammadova , Joey Chua

We have convinced ourselves that the way to make AI safe is to make it unsafe. Since 2022, policymakers worldwide have embraced the Regulation Sacrifice - the belief that dismantling safety oversight will deliver security through AI…

Computers and Society · Computer Science 2026-02-05 Gilad Abiri