English
Related papers

Related papers: RedCodeAgent: Automatic Red-teaming Agent against …

200 papers

Automated red-teaming has emerged as a scalable approach for auditing Large Language Models (LLMs) prior to deployment, yet existing approaches lack mechanisms to efficiently adapt to model-specific vulnerabilities at inference. We…

Computation and Language · Computer Science 2026-05-19 Christos Ziakas , Nicholas Loo , Nishita Jain , Alessandra Russo

Large Language Model (LLM) safeguards, which implement request refusals, have become a widely adopted mitigation strategy against misuse. At the intersection of adversarial machine learning and AI safety, safeguard red teaming has…

Cryptography and Security · Computer Science 2025-06-10 Zifan Wang , Christina Q. Knight , Jeremy Kritz , Willow E. Primack , Julian Michael

Recent advances have enabled LLM-powered AI agents to autonomously execute complex tasks by combining language model reasoning with tools, memory, and web access. But can these systems be trusted to follow deployment policies in realistic…

A red team simulates adversary attacks to help defenders find effective strategies to defend their systems in a real-world operational setting. As more enterprise systems adopt AI, red-teaming will need to evolve to address the unique…

Machine Learning · Computer Science 2025-09-16 Anusha Sinha , Keltin Grimes , James Lucassen , Michael Feffer , Nathan VanHoudnos , Zhiwei Steven Wu , Hoda Heidari

Artificial intelligence (AI) is being ubiquitously adopted to automate processes in science and industry. However, due to its often intricate and opaque nature, AI has been shown to possess inherent vulnerabilities which can be maliciously…

Cryptography and Security · Computer Science 2023-12-20 Mathew J. Walter , Aaron Barrett , Kimberly Tam

Anomaly detection (AD) is essential in areas such as fraud detection, network monitoring, and scientific research. However, the diversity of data modalities and the increasing number of specialized AD libraries pose challenges for…

Computation and Language · Computer Science 2025-05-20 Tiankai Yang , Junjun Liu , Wingchun Siu , Jiahang Wang , Zhuangzhuang Qian , Chanjuan Song , Cheng Cheng , Xiyang Hu , Yue Zhao

Recent advances in Large Language Models (LLMs) have spurred transformative applications in various domains, ranging from open-source to proprietary LLMs. However, jailbreak attacks, which aim to break safety alignment and user compliance…

Artificial Intelligence · Computer Science 2025-12-09 Chen Xiong , Pin-Yu Chen , Tsung-Yi Ho

With the widespread application of LLM-based agents across various domains, their complexity has introduced new security threats. Existing red-team methods mostly rely on modifying user prompts, which lack adaptability to new data and may…

Computation and Language · Computer Science 2026-04-14 Yanxu Mao , Peipei Liu , Tiehan Cui , Congying Liu , Mingzhe Xing , Datao You

As large language models (LLMs) are increasingly deployed as black-box components in real-world applications, red teaming has become essential for identifying potential risks. It tests LLMs with adversarial prompts to uncover…

Machine Learning · Computer Science 2026-03-25 Jiale Ding , Xiang Zheng , Yutao Wu , Cong Wang , Wei-Bin Lee , Ling Pan , Xingjun Ma , Yu-Gang Jiang

Recent advances in AI agents capable of solving complex, everyday tasks, from scheduling to customer service, have enabled deployment in real-world settings, but their possibilities for unsafe behavior demands rigorous evaluation. While…

Artificial Intelligence · Computer Science 2026-02-18 Sanidhya Vijayvargiya , Aditya Bharat Soni , Xuhui Zhou , Zora Zhiruo Wang , Nouha Dziri , Graham Neubig , Maarten Sap

Large-scale pre-trained generative models are taking the world by storm, due to their abilities in generating creative content. Meanwhile, safeguards for these generative models are developed, to protect users' rights and safety, most of…

Cryptography and Security · Computer Science 2024-10-14 Guanlin Li , Kangjie Chen , Shudong Zhang , Jie Zhang , Tianwei Zhang

With the wide application of multimodal foundation models in intelligent agent systems, scenarios such as mobile device control, intelligent assistant interaction, and multimodal task execution are gradually relying on such large…

Artificial Intelligence · Computer Science 2025-07-02 Siyuan Liang , Tianmeng Fang , Zhe Liu , Aishan Liu , Yan Xiao , Jinyuan He , Ee-Chien Chang , Xiaochun Cao

Code review, which aims at ensuring the overall quality and reliability of software, is a cornerstone of software development. Unfortunately, while crucial, Code review is a labor-intensive process that the research community is looking to…

Software Engineering · Computer Science 2024-09-26 Xunzhu Tang , Kisub Kim , Yewei Song , Cedric Lothritz , Bei Li , Saad Ezzini , Haoye Tian , Jacques Klein , Tegawende F. Bissyande

Code generation models based on large language models (LLMs) have gained wide adoption, but challenges remain in ensuring safety, accuracy, and controllability, especially for complex tasks. Existing methods often lack dynamic integration…

Software Engineering · Computer Science 2025-10-13 Aofan Liu , Haoxuan Li , Bin Wang , Ao Yang , Hui Li

The rapid growth of Large Language Models (LLMs) presents significant privacy, security, and ethical concerns. While much research has proposed methods for defending LLM systems against misuse by malicious actors, researchers have recently…

Computation and Language · Computer Science 2025-03-06 Alberto Purpura , Sahil Wadhwa , Jesse Zymet , Akshay Gupta , Andy Luo , Melissa Kazemi Rad , Swapnil Shinde , Mohammad Shahed Sorower

Search agents connect LLMs to the Internet, enabling them to access broader and more up-to-date information. However, this also introduces a new threat surface: unreliable search results can mislead agents into producing unsafe outputs.…

Artificial Intelligence · Computer Science 2026-05-29 Jianshuo Dong , Sheng Guo , Hao Wang , Xun Chen , Zhuotao Liu , Tianwei Zhang , Ke Xu , Minlie Huang , Han Qiu

Agentic AI and Multi-Agent Systems are poised to dominate industry and society imminently. Powered by goal-driven autonomy, they represent a powerful form of generative AI, marking a transition from reactive content generation into…

Software Engineering · Computer Science 2025-12-29 Brian Bowers , Smita Khapre , Jugal Kalita

Large language model (LLM) agents are vulnerable to prompt-injection attacks that propagate through multi-step workflows, tool interactions, and persistent context, making input-output filtering alone insufficient for reliable protection.…

Artificial Intelligence · Computer Science 2026-04-21 Hailin Liu , Eugene Ilyushin , Jie Ni , Min Zhu

The rapid evolution of sophisticated cyberattacks has strained modern Security Operations Centers (SOC), which traditionally rely on rule-based or signature-driven detection systems. These legacy frameworks often generate high volumes of…

Cryptography and Security · Computer Science 2026-03-03 Chuanming Tang , Ling Qing , Shifeng Chen

AI systems are entering critical domains like healthcare, finance, and defense, yet remain vulnerable to adversarial attacks. While AI red teaming is a primary defense, current approaches force operators into manual, library-specific…

Artificial Intelligence · Computer Science 2026-05-06 Raja Sekhar Rao Dheekonda , Will Pearce , Nick Landers