English
Related papers

Related papers: Transient Turn Injection: Exposing Stateless Multi…

200 papers

Intelligent Transportation Systems (ITS) are increasingly vulnerable to sophisticated cyberattacks due to their complex, interconnected nature. Ensuring the cybersecurity of these systems is paramount to maintaining road safety and…

Cryptography and Security · Computer Science 2025-06-23 Lu Gao , Yongxin Liu , Hongyun Chen , Dahai Liu , Yunpeng Zhang , Jingran Sun

With the rapid development of technology and the acceleration of digitalisation, the frequency and complexity of cyber security threats are increasing. Traditional cybersecurity approaches, often based on static rules and predefined…

Cryptography and Security · Computer Science 2025-04-29 Shuang Tian , Tao Zhang , Jiqiang Liu , Jiacheng Wang , Xuangou Wu , Xiaoqiang Zhu , Ruichen Zhang , Weiting Zhang , Zhenhui Yuan , Shiwen Mao , Dong In Kim

Powerful autonomous systems, which reason, plan, and converse using and between numerous tools and agents, are made possible by Large Language Models (LLMs), Vision-Language Models (VLMs), and new agentic AI systems, like LangChain and…

Cryptography and Security · Computer Science 2025-12-30 Toqeer Ali Syed , Mishal Ateeq Almutairi , Mahmoud Abdel Moaty

Generative large vision-language models (LVLMs) have recently achieved impressive performance gains, and their user base is growing rapidly. However, the security of LVLMs, in particular in a long-context multi-turn setting, is largely…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 Christian Schlarmann , Matthias Hein

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

Cryptography and Security · Computer Science 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

Large Language Models (LLMs) are susceptible to Jailbreaking attacks, which aim to extract harmful information by subtly modifying the attack query. As defense mechanisms evolve, directly obtaining harmful information becomes increasingly…

Machine Learning · Computer Science 2024-10-03 Yixin Cheng , Markos Georgopoulos , Volkan Cevher , Grigorios G. Chrysos

As powerful Large Language Models (LLMs) are now widely used for numerous practical applications, their safety is of critical importance. While alignment techniques have significantly improved overall safety, LLMs remain vulnerable to…

Machine Learning · Computer Science 2024-10-28 Samuel Jacob Chacko , Sajib Biswas , Chashi Mahiul Islam , Fatema Tabassum Liza , Xiuwen Liu

Open-weight models provide researchers and developers with accessible foundations for diverse downstream applications. We tested the safety and security postures of eight open-weight large language models (LLMs) to identify vulnerabilities…

Cryptography and Security · Computer Science 2025-11-06 Amy Chang , Nicholas Conley , Harish Santhanalakshmi Ganesan , Adam Swanda

Large Language Models (LLMs) have achieved remarkable success across domains such as healthcare, education, and cybersecurity. However, this openness also introduces significant security risks, particularly through embedding space…

Computation and Language · Computer Science 2025-07-14 Zhibo Zhang , Yuxi Li , Kailong Wang , Shuai Yuan , Ling Shi , Haoyu Wang

Vision Large Language Models (VLLMs) are increasingly deployed to offer advanced capabilities on inputs comprising both text and images. While prior research has shown that adversarial attacks can transfer from open-source to proprietary…

Computer Vision and Pattern Recognition · Computer Science 2025-05-05 Kai Hu , Weichen Yu , Li Zhang , Alexander Robey , Andy Zou , Chengming Xu , Haoqi Hu , Matt Fredrikson

Large language models (LLMs) are increasingly being harnessed to automate cyberattacks, making sophisticated exploits more accessible and scalable. In response, we propose a new defense strategy tailored to counter LLM-driven cyberattacks.…

Cryptography and Security · Computer Science 2024-11-19 Dario Pasquini , Evgenios M. Kornaropoulos , Giuseppe Ateniese

The widespread adoption of Large Language Models (LLMs) has revolutionized AI deployment, enabling autonomous and semi-autonomous applications across industries through intuitive language interfaces and continuous improvements in model…

Cryptography and Security · Computer Science 2025-10-20 Adam Swanda , Amy Chang , Alexander Chen , Fraser Burch , Paul Kassianik , Konstantin Berlin

When large language model (LLM) systems interact with external data to perform complex tasks, a new attack, namely prompt injection, becomes a significant threat. By injecting instructions into the data accessed by the system, the attacker…

Cryptography and Security · Computer Science 2025-08-26 Sizhe Chen , Yizhu Wang , Nicholas Carlini , Chawin Sitawarin , David Wagner

The recent boom and rapid integration of Large Language Models (LLMs) into a wide range of applications warrants a deeper understanding of their security and safety vulnerabilities. This paper presents a comparative analysis of the…

Cryptography and Security · Computer Science 2025-11-25 Tom Perel

Prompt injection attacks exploit vulnerabilities in large language models (LLMs) to manipulate the model into unintended actions or generate malicious content. As LLM integrated applications gain wider adoption, they face growing…

Cryptography and Security · Computer Science 2024-01-03 Daniel Wankit Yip , Aysan Esmradi , Chun Fai Chan

The integration of Large Language Models (LLMs) into robotics has revolutionized their ability to interpret complex human commands and execute sophisticated tasks. However, such paradigm shift introduces critical security vulnerabilities…

Large Language Models (LLMs) have demonstrated remarkable capabilities in performing tasks across various domains without needing explicit retraining. This capability, known as In-Context Learning (ICL), while impressive, exposes LLMs to a…

Computation and Language · Computer Science 2024-10-16 Bibek Upadhayay , Vahid Behzadan , Amin Karbasi

Large Language Model (LLM) agents are powering a growing share of interactive web applications, yet remain vulnerable to misuse and harm. Prior jailbreak research has largely focused on single-turn prompts, whereas real harassment often…

Artificial Intelligence · Computer Science 2025-10-22 Trilok Padhi , Pinxian Lu , Abdulkadir Erol , Tanmay Sutar , Gauri Sharma , Mina Sonmez , Munmun De Choudhury , Ugur Kursuncu

Despite extensive safety-tuning, large language models (LLMs) remain vulnerable to jailbreak attacks via adversarially crafted instructions, reflecting a persistent trade-off between safety and task performance. In this work, we propose…

Cryptography and Security · Computer Science 2025-08-26 Wei Jie Yeo , Ranjan Satapathy , Erik Cambria

Recent research on large language models (LLMs) has demonstrated their ability to understand and employ deceptive behavior, even without explicit prompting. However, such behavior has only been observed in rare, specialized cases and has…

Computation and Language · Computer Science 2025-06-24 Laurène Vaugrante , Francesca Carlon , Maluna Menke , Thilo Hagendorff