English
Related papers

Related papers: Beyond Attack Success Rate: Temporal Logit Observa…

200 papers

Large language models (LLMs) increasingly operate in multi-agent and safety-critical settings, raising open questions about how their vulnerabilities scale when models interact adversarially. This study examines whether larger models can…

Machine Learning · Computer Science 2026-01-05 Samuel Nathanson , Rebecca Williams , Cynthia Matuszek

Linear Temporal Logic (LTL) is the de-facto standard temporal logic for system specification, whose foundational properties have been studied for over five decades. Safety and cosafety properties define notable fragments of LTL, where a…

Logic in Computer Science · Computer Science 2025-03-14 Alessandro Artale , Luca Geatti , Nicola Gigante , Andrea Mazzullo , Angelo Montanari

Multi-task learning (MTL) seeks to improve the generalized performance of learning specific tasks, exploiting useful information incorporated in related tasks. As a promising area, this paper studies an MTL-based control approach…

Systems and Control · Electrical Eng. & Systems 2024-08-01 Andres Arias , Chuangchuang Sun

As large language models (LLMs) improve, so do their offensive applications: frontier agents now generate working exploits for under $50 in compute (Heelan, 2026). Defensive incident response (IR) agents must keep pace, but existing…

Artificial Intelligence · Computer Science 2026-02-10 Jarrod Barnes

Large language models show promise for vulnerability discovery, yet prevailing methods inspect code in isolation, struggle with long contexts, and focus on coarse function- or file-level detections that offer limited guidance to engineers…

Software Engineering · Computer Science 2026-02-05 Haoran Xi , Minghao Shao , Brendan Dolan-Gavitt , Muhammad Shafique , Ramesh Karri

Current evaluations of LLM safety predominantly rely on severity-based taxonomies to assess the harmfulness of malicious queries. We argue that this formulation requires re-examination as it assumes uniform risk across all malicious…

Cryptography and Security · Computer Science 2026-02-03 Yen-Shan Chen , Zhi Rui Tam , Cheng-Kuang Wu , Yun-Nung Chen

Multi-turn jailbreak attacks simulate real-world human interactions by engaging large language models (LLMs) in iterative dialogues, exposing critical safety vulnerabilities. However, existing methods often struggle to balance semantic…

Computation and Language · Computer Science 2025-03-12 Zonghao Ying , Deyue Zhang , Zonglei Jing , Yisong Xiao , Quanchen Zou , Aishan Liu , Siyuan Liang , Xiangzheng Zhang , Xianglong Liu , Dacheng Tao

Large language models (LLMs) have revolutionized artificial intelligence, but their increasing deployment across critical domains has raised concerns about their abnormal behaviors when faced with malicious attacks. Such vulnerability…

Software Engineering · Computer Science 2025-04-02 Shide Zhou , Tianlin Li , Kailong Wang , Yihao Huang , Ling Shi , Yang Liu , Haoyu Wang

Tool-integrated (TI) reinforcement learning (RL) enables large language models (LLMs) to perform multi-step reasoning by interacting with external tools such as search engines and retrievers. Group Relative Policy Optimization (GRPO),…

Computation and Language · Computer Science 2026-02-03 Wenlong Deng , Yushu Li , Boying Gong , Yi Ren , Christos Thrampoulidis , Xiaoxiao Li

Currently, open-sourced large language models (OSLLMs) have demonstrated remarkable generative performance. However, as their structure and weights are made public, they are exposed to jailbreak attacks even after alignment. Existing…

Cryptography and Security · Computer Science 2026-03-16 Jinman Wu , Yi Xie , Shiqian Zhao , Xiaofeng Chen

Recent large language model (LLM) defenses have greatly improved models' ability to refuse harmful queries, even when adversarially attacked. However, LLM defenses are primarily evaluated against automated adversarial attacks in a single…

Machine Learning · Computer Science 2024-09-05 Nathaniel Li , Ziwen Han , Ian Steneker , Willow Primack , Riley Goodside , Hugh Zhang , Zifan Wang , Cristina Menghini , Summer Yue

This paper presents a comprehensive empirical study on the safety alignment capabilities. We evaluate what matters for safety alignment in LLMs and LRMs to provide essential insights for developing more secure and reliable AI systems. We…

Computation and Language · Computer Science 2026-02-25 Xing Li , Hui-Ling Zhen , Lihao Yin , Xianzhi Yu , Zhenhua Dong , Mingxuan Yuan

Although safely enhanced Large Language Models (LLMs) have achieved remarkable success in tackling various complex tasks in a zero-shot manner, they remain susceptible to jailbreak attacks, particularly the unknown jailbreak attack. To…

Computation and Language · Computer Science 2024-06-12 Fan Liu , Zhao Xu , Hao Liu

As large language models (LLMs) become integral to various applications, ensuring both their safety and utility is paramount. Jailbreak attacks, which manipulate LLMs into generating harmful content, pose significant challenges to this…

Cryptography and Security · Computer Science 2025-02-10 Guobin Shen , Dongcheng Zhao , Yiting Dong , Xiang He , Yi Zeng

Vision-Language Models (VLMs) exhibit impressive performance, yet the integration of powerful vision encoders has significantly broadened their attack surface, rendering them increasingly susceptible to jailbreak attacks. However, lacking…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Jiaxin Song , Yixu Wang , Jie Li , Rui Yu , Yan Teng , Xingjun Ma , Yingchun Wang

The software architecture behind modern autonomous vehicles (AV) is becoming more complex steadily. Safety verification is now an imminent task prior to the large-scale deployment of such convoluted models. For safety-critical tasks in…

Systems and Control · Electrical Eng. & Systems 2024-09-18 Aditya Parameshwaran , Yue Wang

Retrieval-Augmented Generation (RAG) enhances the capabilities of large language models (LLMs) by incorporating external knowledge, but its reliance on potentially poisonable knowledge bases introduces new availability risks. Attackers can…

Cryptography and Security · Computer Science 2026-03-05 Junchen Li , Chao Qi , Rongzheng Wang , Qizhi Chen , Liang Xu , Di Liang , Bob Simons , Shuang Liang

Large language models (LLMs) remain vulnerable to sophisticated prompt engineering attacks that exploit contextual framing to bypass safety mechanisms, posing significant risks in cybersecurity applications. We introduce Jailbreak Mimicry,…

Cryptography and Security · Computer Science 2025-10-28 Pavlos Ntais

Most adversarial evaluations of large language model (LLM) safety assess single prompts and report binary pass/fail outcomes, which fails to capture how safety properties evolve under sustained adversarial interaction. We present ADVERSA,…

Cryptography and Security · Computer Science 2026-03-12 Harry Owiredu-Ashley

As large language models (LLMs) evolve from static chatbots into autonomous agents, the primary vulnerability surface shifts from final outputs to intermediate execution traces. While safety guardrails are well-benchmarked for natural…

Cryptography and Security · Computer Science 2026-04-09 Yen-Shan Chen , Sian-Yao Huang , Cheng-Lin Yang , Yun-Nung Chen