English
Related papers

Related papers: Ruby Teaming: Improving Quality Diversity Search w…

200 papers

AI-enabled Security Orchestration, Automation, and Response (SOAR) systems increasingly employ autonomous agents for cyber defense, yet their resilience to adaptive adversaries is underexplored. We introduce an autonomous red teaming…

Cryptography and Security · Computer Science 2026-05-19 Ayan Javeed Shaikh , Nathaniel D. Bastian , Ankit Shah

While Large Language Models (LLMs) are widely used, they remain susceptible to jailbreak prompts that can elicit harmful or inappropriate responses. This paper introduces STAR-Teaming, a novel black-box framework for automated red teaming…

Computation and Language · Computer Science 2026-04-22 MinJae Jung , YongTaek Lim , Chaeyun Kim , Junghwan Kim , Kihyun Kim , Minwoo Kim

Deep neural networks are vulnerable to adversarial examples, which are crafted by adding human-imperceptible perturbations to original images. Most existing adversarial attack methods achieve nearly 100% attack success rates under the…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Guoqiu Wang , Huanqian Yan , Ying Guo , Xingxing Wei

Existing LLM red-teaming approaches prioritize high attack success rate, often resulting in high-perplexity prompts. This focus overlooks low-perplexity attacks that are more difficult to filter, more likely to arise during benign usage,…

Computation and Language · Computer Science 2025-09-24 Amelia F. Hardy , Houjun Liu , Allie Griffith , Bernard Lange , Duncan Eddy , Mykel J. Kochenderfer

Recently, numerous preference optimization algorithms have been introduced as extensions to the Direct Preference Optimization (DPO) family. While these methods have successfully aligned models with human preferences, there is a lack of…

Artificial Intelligence · Computer Science 2025-03-04 Hanyang Zhao , Genta Indra Winata , Anirban Das , Shi-Xiong Zhang , David D. Yao , Wenpin Tang , Sambit Sahu

The dual offensive and defensive utility of Large Language Models (LLMs) highlights a critical gap in AI security: the lack of unified frameworks for dynamic, iterative adversarial adaptation hardening. To bridge this gap, we propose the…

Cryptography and Security · Computer Science 2026-01-28 Lige Huang , Zicheng Liu , Jie Zhang , Lewen Yan , Dongrui Liu , Jing Shao

The deep reinforcement learning community has made several independent improvements to the DQN algorithm. However, it is unclear which of these extensions are complementary and can be fruitfully combined. This paper examines six extensions…

Artificial Intelligence · Computer Science 2017-10-09 Matteo Hessel , Joseph Modayil , Hado van Hasselt , Tom Schaul , Georg Ostrovski , Will Dabney , Dan Horgan , Bilal Piot , Mohammad Azar , David Silver

Red teaming has proven to be an effective method for identifying and mitigating vulnerabilities in Large Language Models (LLMs). Reinforcement Fine-Tuning (RFT) has emerged as a promising strategy among existing red teaming techniques.…

Machine Learning · Computer Science 2025-06-06 Xiang Zheng , Xingjun Ma , Wei-Bin Lee , Cong Wang

Deep ensembles perform better than a single network thanks to the diversity among their members. Recent approaches regularize predictions to increase diversity; however, they also drastically decrease individual members' performances. In…

Machine Learning · Computer Science 2021-01-15 Alexandre Rame , Matthieu Cord

This paper investigates the benefits of Amplify-and-Forward (AF) relaying in the setup of multi-antenna wireless networks. The concept of Random Sequential (RS) relaying is previously introduced in the literature and showed that it achieves…

Information Theory · Computer Science 2009-12-22 Shahab Oveis Gharan , Alireza Bayesteh , Amir K. Khandani

Reasoning-intensive retrieval aims to surface evidence that supports downstream reasoning rather than merely matching topical similarity. This capability is increasingly important for agentic search systems, where retrievers must provide…

Computation and Language · Computer Science 2026-05-06 Yilun Zhao , Jinbiao Wei , Tingyu Song , Siyue Zhang , Chen Zhao , Arman Cohan

Long-context large language models (LLMs)-for example, Gemini-3.1-Pro and Qwen-3.5-are widely used to empower many real-world applications, such as retrieval-augmented generation, autonomous agents, and AI assistants. However, security…

Cryptography and Security · Computer Science 2026-05-01 Yanting Wang , Chenlong Yin , Ying Chen , Jinyuan Jia

As the practicality of Artificial Intelligence (AI) and Machine Learning (ML) based techniques grow, there is an ever increasing threat of adversarial attacks. There is a need to red team this ecosystem to identify system vulnerabilities,…

Cryptography and Security · Computer Science 2022-08-17 Chuyen Nguyen , Caleb Morgan , Sudip Mittal

A red team simulates adversary attacks to help defenders find effective strategies to defend their systems in a real-world operational setting. As more enterprise systems adopt AI, red-teaming will need to evolve to address the unique…

Machine Learning · Computer Science 2025-09-16 Anusha Sinha , Keltin Grimes , James Lucassen , Michael Feffer , Nathan VanHoudnos , Zhiwei Steven Wu , Hoda Heidari

In this paper, we propose a new relaying protocol for large multihop networks combining the concepts of cooperative diversity and opportunistic relaying. The cooperative relaying protocol is based on two diversity mechanisms, incremental…

Information Theory · Computer Science 2015-08-11 Amogh Rajanna , Mos Kaveh

Traditional multimodal retrieval systems rely primarily on bi-encoder architectures, where performance is closely tied to embedding dimensionality. Recent work, Think-Then-Embed (TTE), shows that incorporating multimodal reasoning to elicit…

In this paper a hybrid feature selection method is proposed which takes advantages of wrapper subset evaluation with a lower cost and improves the performance of a group of classifiers. The method uses combination of sample domain filtering…

Machine Learning · Computer Science 2014-03-12 Mehdi Naseriparsa , Amir-Masoud Bidgoli , Touraj Varaee

In industrial recommendation systems on websites and apps, it is essential to recall and predict top-n results relevant to user interests from a content pool of billions within milliseconds. To cope with continuous data growth and improve…

Information Retrieval · Computer Science 2024-11-06 Qiang Zhang , Zhipeng Teng , Disheng Wu , Jiayin Wang

As large language models (LLMs) are increasingly deployed as black-box components in real-world applications, red teaming has become essential for identifying potential risks. It tests LLMs with adversarial prompts to uncover…

Machine Learning · Computer Science 2026-03-25 Jiale Ding , Xiang Zheng , Yutao Wu , Cong Wang , Wei-Bin Lee , Ling Pan , Xingjun Ma , Yu-Gang Jiang

The ability of LLM agents to plan and invoke tools exposes them to new safety risks, making a comprehensive red-teaming system crucial for discovering vulnerabilities and ensuring their safe deployment. We present SIRAJ: a generic…

Cryptography and Security · Computer Science 2025-10-31 Kaiwen Zhou , Ahmed Elgohary , A S M Iftekhar , Amin Saied