English
Related papers

Related papers: N-GLARE: An Non-Generative Latent Representation-E…

200 papers

With the widespread adoption of pre-trained Large Language Models (LLM), there exists a high demand for task-specific test sets to benchmark their performance in domains such as healthcare and biomedicine. However, the cost of labeling test…

Computation and Language · Computer Science 2026-03-23 Aashish Anantha Ramakrishnan , Ardavan Saeedi , Hamid Reza Hassanzadeh , Fazlolah Mohaghegh , Dongwon Lee

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural…

Cryptography and Security · Computer Science 2026-04-09 Yen-Shan Chen , Sian-Yao Huang , Cheng-Lin Yang , Yun-Nung Chen

While prior red-teaming efforts have focused on eliciting harmful text outputs from large language models (LLMs), such approaches fail to capture agent-specific vulnerabilities that emerge through multi-step tool execution, particularly in…

Cryptography and Security · Computer Science 2026-03-25 Hyomin Lee , Sangwoo Park , Yumin Choi , Sohyun An , Seanie Lee , Sung Ju Hwang

Large language models remain vulnerable to adversarial prompts that elicit harmful outputs. Existing safety paradigms typically couple red-teaming and post-training in a closed, policy-centric loop, causing attack discovery to suffer from…

Cryptography and Security · Computer Science 2026-05-14 Xiaozhe Zhang , Chaozhuo Li , Hui Liu , Shaocheng Yan , Bingyu Yan , Qiwei Ye , Haoliang Li

Large Language Models (LLMs) have been augmented with web search to overcome the limitations of the static knowledge boundary by accessing up-to-date information from the open Internet. While this integration enhances model capability, it…

Cryptography and Security · Computer Science 2026-04-20 Haoran Ou , Kangjie Chen , Xingshuo Han , Gelei Deng , Jie Zhang , Han Qiu , Tianwei Zhang

This study presents a multi-stage approach to mental health classification by leveraging traditional machine learning algorithms, deep learning architectures, and transformer-based models. A novel data set was curated and utilized to…

Artificial Intelligence · Computer Science 2025-04-11 Korhan Sevinç

Neural implicit representations have emerged as a promising solution for providing dense geometry in Simultaneous Localization and Mapping (SLAM). However, existing methods in this direction fall short in terms of global consistency and low…

Robotics · Computer Science 2024-08-22 Yunxuan Mao , Xuan Yu , Kai Wang , Yue Wang , Rong Xiong , Yiyi Liao

The ability of LLM agents to plan and invoke tools exposes them to new safety risks, making a comprehensive red-teaming system crucial for discovering vulnerabilities and ensuring their safe deployment. We present SIRAJ: a generic…

Cryptography and Security · Computer Science 2025-10-31 Kaiwen Zhou , Ahmed Elgohary , A S M Iftekhar , Amin Saied

The rapid advancement of Vision-Language Models (VLMs) has brought their safety vulnerabilities into sharp focus. However, existing red teaming methods are fundamentally constrained by an inherent linear exploration paradigm, confining them…

Machine Learning · Computer Science 2026-03-25 Chunxiao Li , Lijun Li , Jing Shao

Recent work has proposed automated red-teaming methods for testing the vulnerabilities of a given target large language model (LLM). These methods use red-teaming LLMs to uncover inputs that induce harmful behavior in a target LLM. In this…

Machine Learning · Computer Science 2025-01-15 Jonathan Nöther , Adish Singla , Goran Radanović

Red teaming is critical for identifying vulnerabilities and building trust in current LLMs. However, current automated methods for Large Language Models (LLMs) rely on brittle prompt templates or single-turn attacks, failing to capture the…

Machine Learning · Computer Science 2025-08-07 Roman Belaire , Arunesh Sinha , Pradeep Varakantham

The rapid growth of Large Language Models (LLMs) presents significant privacy, security, and ethical concerns. While much research has proposed methods for defending LLM systems against misuse by malicious actors, researchers have recently…

Computation and Language · Computer Science 2025-03-06 Alberto Purpura , Sahil Wadhwa , Jesse Zymet , Akshay Gupta , Andy Luo , Melissa Kazemi Rad , Swapnil Shinde , Mohammad Shahed Sorower

AI-enabled Security Orchestration, Automation, and Response (SOAR) systems increasingly employ autonomous agents for cyber defense, yet their resilience to adaptive adversaries is underexplored. We introduce an autonomous red teaming…

Cryptography and Security · Computer Science 2026-05-19 Ayan Javeed Shaikh , Nathaniel D. Bastian , Ankit Shah

Long-context large language models (LLMs)-for example, Gemini-3.1-Pro and Qwen-3.5-are widely used to empower many real-world applications, such as retrieval-augmented generation, autonomous agents, and AI assistants. However, security…

Cryptography and Security · Computer Science 2026-05-01 Yanting Wang , Chenlong Yin , Ying Chen , Jinyuan Jia

Transformer models have recently emerged as one of the foundational models in natural language processing, and as a byproduct, there is significant recent interest and investment in scaling these models. However, the training and inference…

The rapid advancement of large language models (LLMs) has made machine-generated text increasingly difficult to distinguish from human-written text. While recent studies explore leveraging internal representations of language models to…

Applications · Statistics 2026-05-14 Luxu Liang , Xiang Li

As large language models (LLMs) continue to advance in capability and influence, ensuring their security and preventing harmful outputs has become crucial. A promising approach to address these concerns involves training models to…

Computation and Language · Computer Science 2024-12-24 Muxi Diao , Rumei Li , Shiyang Liu , Guogang Liao , Jingang Wang , Xunliang Cai , Weiran Xu

Large Language Models (LLMs) have gained increasing attention for their remarkable capacity, alongside concerns about safety arising from their potential to produce harmful content. Red teaming aims to find prompts that could elicit harmful…

Computation and Language · Computer Science 2025-02-25 Rui Li , Peiyi Wang , Jingyuan Ma , Di Zhang , Lei Sha , Zhifang Sui

Real-world autonomous driving must adhere to complex human social rules that extend beyond legally codified traffic regulations. Many of these semantic constraints, such as yielding to emergency vehicles, complying with traffic officers'…

Robotics · Computer Science 2026-01-06 Qian Cheng , Weitao Zhou , Cheng Jing , Nanshan Deng , Junze Wen , Zhaoyang Liu , Kun Jiang , Diange Yang

Guard models are widely used to detect harmful content in user prompts and LLM responses. However, state-of-the-art guard models rely solely on terminal-layer representations and overlook the rich safety-relevant features distributed across…

Artificial Intelligence · Computer Science 2026-04-21 Difan Jiao , Yilun Liu , Ye Yuan , Zhenwei Tang , Linfeng Du , Haolun Wu , Ashton Anderson