English
Related papers

Related papers: Latent Adversarial Detection: Adaptive Probing of …

200 papers

Transformer-based pre-trained models of code (PTMC) have been widely utilized and have achieved state-of-the-art performance in many mission-critical applications. However, they can be vulnerable to adversarial attacks through identifier…

Cryptography and Security · Computer Science 2023-11-27 Xiaohu Du , Ming Wen , Zichao Wei , Shangwen Wang , Hai Jin

Large language models (LLMs) are increasingly integrated into sensitive workflows, raising the stakes for adversarial robustness and safety. This paper introduces Transient Turn Injection(TTI), a new multi-turn attack technique that…

Cryptography and Security · Computer Science 2026-04-24 Naheed Rayhan , Sohely Jahan

Static analysis is effective for discovering software vulnerabilities but notoriously suffers from incomplete source--sink specifications and excessive false positives (FPs). We present \textsc{AdaTaint}, an LLM-driven taint analysis…

Software Engineering · Computer Science 2025-11-07 Shiyin Lin

Binary vulnerability analysis is increasingly performed by LLM-based agents in an iterative, multi-pass manner, with the model as the core decision-maker. However, how such systems organize exploration over hundreds of reasoning steps…

Artificial Intelligence · Computer Science 2026-03-20 Qiang Li , XiangRui Zhang , Haining Wang

Large Language Models (LLMs) are increasingly exposed to adaptive jailbreaking, particularly in high-stakes Chemical, Biological, Radiological, and Nuclear (CBRN) domains. Although streaming probes enable real-time monitoring, they still…

Computation and Language · Computer Science 2026-04-17 Xuanli He , Bilgehan Sel , Faizan Ali , Jenny Bao , Hoagy Cunningham , Jerry Wei

Large Language Models (LLMs) have demonstrated remarkable capabilities across various tasks, yet they remain vulnerable to adversarial manipulations such as jailbreaking via prompt injection attacks. These attacks bypass safety mechanisms…

Machine Learning · Computer Science 2025-07-08 Xin Wei Chia , Swee Liang Wong , Jonathan Pan

Large language models (LLMs) can often be made to behave in undesirable ways that they are explicitly fine-tuned not to. For example, the LLM red-teaming literature has produced a wide variety of 'jailbreaking' techniques to elicit harmful…

In predictive process monitoring, predictive models are vulnerable to adversarial attacks, where input perturbations can lead to incorrect predictions. Unlike in computer vision, where these perturbations are designed to be imperceptible to…

Machine Learning · Computer Science 2024-11-22 Alexander Stevens , Jari Peeperkorn , Johannes De Smedt , Jochen De Weerdt

Assessing the performance of systems to classify Multi-Party Conversations (MPC) is challenging due to the interconnection between linguistic and structural characteristics of conversations. Conventional evaluation methods often overlook…

Computation and Language · Computer Science 2026-03-30 Nicolò Penzo , Maryam Sajedinia , Bruno Lepri , Sara Tonelli , Marco Guerini

As Large Language Models (LLMs) become increasingly integrated into real-world decision-making systems, understanding their behavioural vulnerabilities remains a critical challenge for AI safety and alignment. While existing evaluation…

Artificial Intelligence · Computer Science 2025-05-20 Lili Zhang , Haomiaomiao Wang , Long Cheng , Libao Deng , Tomas Ward

Large Language Models increasingly power critical infrastructure from healthcare to finance, yet their vulnerability to adversarial manipulation threatens system integrity and user safety. Despite growing deployment, no comprehensive…

Cryptography and Security · Computer Science 2026-03-19 Taiwo Onitiju , Iman Vakilinia

Reasoning models are evaluated on single-turn benchmarks but deployed in multi-turn dialogue, where users push back on correct answers. Under sustained adversarial pressure we find a previously undocumented failure mode: the…

Artificial Intelligence · Computer Science 2026-05-29 Yubo Li , Ramayya Krishnan , Rema Padman

Most LLM benchmarks score how well a model responds to explicit requests. They leave unmeasured a different conversational ability: noticing and acting on needs the user has implied but not said. We call this \emph{conversational…

Machine Learning · Computer Science 2026-05-12 Sepehr Harfi , Ahmad Salimi , Dongming Shen , Alex Smola

Recent large language model (LLM) defenses have greatly improved models' ability to refuse harmful queries, even when adversarially attacked. However, LLM defenses are primarily evaluated against automated adversarial attacks in a single…

Machine Learning · Computer Science 2024-09-05 Nathaniel Li , Ziwen Han , Ian Steneker , Willow Primack , Riley Goodside , Hugh Zhang , Zifan Wang , Cristina Menghini , Summer Yue

Despite their capabilities, large foundation models (LFMs) remain susceptible to adversarial manipulation. Current defenses predominantly rely on the "locality hypothesis", suppressing isolated neurons or features. However, harmful…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Chuancheng Shi , Shangze Li , Wenjun Lu , Wenhua Wu , Cong Wang , Zifeng Cheng , Fei Shen , Tat-Seng Chua

Large Language Models (LLMs) are increasingly integrated into real-world applications, from virtual assistants to autonomous agents. However, their flexibility also introduces new attack vectors-particularly Prompt Injection (PI), where…

Cryptography and Security · Computer Science 2025-09-17 Mengxiao Wang , Yuxuan Zhang , Guofei Gu

Large Language Models (LLMs) can acquire deceptive behaviors through backdoor attacks, where the model executes prohibited actions whenever secret triggers appear in the input. Existing safety training methods largely fail to address this…

Cryptography and Security · Computer Science 2025-10-08 Guangyu Shen , Siyuan Cheng , Xiangzhe Xu , Yuan Zhou , Hanxi Guo , Zhuo Zhang , Xiangyu Zhang

Advanced Persistent Threats (APTs) are prolonged, stealthy intrusions by skilled adversaries that compromise high-value systems to steal data or disrupt operations. Reconstructing complete attack chains from massive, heterogeneous logs is…

Cryptography and Security · Computer Science 2025-09-03 Rujie Dai , Peizhuo Lv , Yujiang Gui , Qiujian Lv , Yuanyuan Qiao , Yan Wang , Degang Sun , Weiqing Huang , Yingjiu Li , XiaoFeng Wang

Recursive language-model loops often settle into recognizable attractor-like patterns. The practical question is how much injected text is needed to move a settled loop somewhere else, and whether that move lasts. We study this in 30-step…

Artificial Intelligence · Computer Science 2026-05-06 Pawel Kaplanski

Large Language Models (LLMs) continue to exhibit vulnerabilities to jailbreaking attacks: carefully crafted malicious inputs intended to circumvent safety guardrails and elicit harmful responses. As such, we present AutoAdv, a novel…

Cryptography and Security · Computer Science 2025-12-25 Aashray Reddy , Andrew Zagula , Nicholas Saban