English
Related papers

Related papers: Helping Large Language Models Protect Themselves: …

200 papers

The deployment of multimodal large language models (MLLMs) has brought forth a unique vulnerability: susceptibility to malicious attacks through visual inputs. This paper investigates the novel challenge of defending MLLMs against such…

Cryptography and Security · Computer Science 2024-06-18 Renjie Pi , Tianyang Han , Jianshu Zhang , Yueqi Xie , Rui Pan , Qing Lian , Hanze Dong , Jipeng Zhang , Tong Zhang

Large Language Models (LLMs) have recently emerged as powerful tools in cybersecurity, offering advanced capabilities in malware detection, generation, and real-time monitoring. Numerous studies have explored their application in…

Cryptography and Security · Computer Science 2025-04-11 Hamed Jelodar , Samita Bai , Parisa Hamedi , Hesamodin Mohammadian , Roozbeh Razavi-Far , Ali Ghorbani

With the development of technology, large language models (LLMs) have dominated the downstream natural language processing (NLP) tasks. However, because of the LLMs' instruction-following abilities and inability to distinguish the…

Cryptography and Security · Computer Science 2025-10-07 Yulin Chen , Haoran Li , Yuan Sui , Yangqiu Song , Bryan Hooi

As large language models (LLMs) continue to evolve, their potential use in automating cyberattacks becomes increasingly likely. With capabilities such as reconnaissance, exploitation, and command execution, LLMs could soon become integral…

Cryptography and Security · Computer Science 2024-10-22 Daniel Ayzenshteyn , Roy Weiss , Yisroel Mirsky

Large Language Models (LLMs) are increasingly susceptible to jailbreak attacks, which are adversarial prompts that bypass alignment constraints and induce unauthorized or harmful behaviors. These vulnerabilities undermine the safety,…

Machine Learning · Computer Science 2025-09-30 Javad Forough , Mohammad Maheri , Hamed Haddadi

A novel hack involving Large Language Models (LLMs) has emerged, exploiting adversarial suffixes to deceive models into generating perilous responses. Such jailbreaks can trick LLMs into providing intricate instructions to a malicious user…

Computation and Language · Computer Science 2023-11-08 Gabriel Alon , Michael Kamfonas

Large Language Models (LLMs) demonstrate impressive capabilities across various fields, yet their increasing use raises critical security concerns. This article reviews recent literature addressing key issues in LLM security, with a focus…

Cryptography and Security · Computer Science 2025-11-26 Benji Peng , Keyu Chen , Ming Li , Pohsun Feng , Ziqian Bi , Junyu Liu , Xinyuan Song , Qian Niu

In this work, we introduce a framework for speech summarization that leverages the processing and reasoning capabilities of large language models (LLMs). We propose an end-to-end system that combines an instruction-tuned LLM with an audio…

Audio and Speech Processing · Electrical Eng. & Systems 2024-09-16 Wonjune Kang , Deb Roy

Large Language Models (LLMs) have been applied to automate cyber security activities and processes including cyber investigation and digital forensics. However, the use of such models for cyber investigation and digital forensics should…

Cryptography and Security · Computer Science 2024-04-02 Jonathan Pan , Swee Liang Wong , Xin Wei Chia , Yidi Yuan

Large Language Models (LLMs) enable a new ecosystem with many downstream applications, called LLM applications, with different natural language processing tasks. The functionality and performance of an LLM application highly depend on its…

Cryptography and Security · Computer Science 2025-06-16 Bo Hui , Haolin Yuan , Neil Gong , Philippe Burlina , Yinzhi Cao

This dissertation proposes a framework of user-centered security in Natural Language Processing (NLP), and demonstrates how it can improve the accessibility of related research. Accordingly, it focuses on two security domains within NLP…

Computation and Language · Computer Science 2023-01-12 Chris Emmery

In this paper, we tackle the emerging challenge of unintended harmful content generation in Large Language Models (LLMs) with a novel dual-stage optimisation technique using adversarial fine-tuning. Our two-pronged approach employs an…

Computation and Language · Computer Science 2023-08-29 Charles O'Neill , Jack Miller , Ioana Ciuca , Yuan-Sen Ting , Thang Bui

Large language models (LLMs) are typically aligned to refuse harmful instructions through safety fine-tuning. A recent attack, termed abliteration, identifies and suppresses the single latent direction most responsible for refusal behavior,…

Computation and Language · Computer Science 2025-10-08 Harethah Abu Shairah , Hasan Abed Al Kader Hammoud , Bernard Ghanem , George Turkiyyah

Large Language Models (LLMs) have revolutionized the field of Natural Language Processing (NLP) by automating traditional labor-intensive tasks and consequently accelerated the development of computer-aided applications. As researchers…

Computation and Language · Computer Science 2025-06-24 Summra Saleem , Muhammad Nabeel Asim , Shaista Zulfiqar , Andreas Dengel

The rising use of Large Language Models (LLMs) to create and disseminate malware poses a significant cybersecurity challenge due to their ability to generate and distribute attacks with ease. A single prompt can initiate a wide array of…

Cryptography and Security · Computer Science 2024-09-13 Jamal Al-Karaki , Muhammad Al-Zafar Khan , Marwan Omar

Jailbreaking large language models (LLMs) has emerged as a critical security challenge with the widespread deployment of conversational AI systems. Adversarial users exploit these models through carefully crafted prompts to elicit…

Cryptography and Security · Computer Science 2026-02-23 Sri Durga Sai Sowmya Kadali , Evangelos E. Papalexakis

With the advent of Large Language Models (LLMs), generating rule-based data for real-world applications has become more accessible. Due to the inherent ambiguity of natural language and the complexity of rule sets, especially in long…

Computation and Language · Computer Science 2025-04-21 Teng Wang , Zhenqi He , Wing-Yin Yu , Xiaojin Fu , Xiongwei Han

Multimodal large language models (MLLMs) comprise of both visual and textual modalities to process vision language tasks. However, MLLMs are vulnerable to security-related issues, such as jailbreak attacks that alter the model's input to…

Cryptography and Security · Computer Science 2025-10-27 Xingwei Zhong , Kar Wai Fok , Vrizlynn L. L. Thing

The critical challenge of prompt injection attacks in Large Language Models (LLMs) integrated applications, a growing concern in the Artificial Intelligence (AI) field. Such attacks, which manipulate LLMs through natural language inputs,…

Cryptography and Security · Computer Science 2024-01-17 Xuchen Suo

In the past few years, it has become increasingly evident that deep neural networks are not resilient enough to withstand adversarial perturbations in input data, leaving them vulnerable to attack. Various authors have proposed strong…

Computation and Language · Computer Science 2023-04-19 Shreya Goyal , Sumanth Doddapaneni , Mitesh M. Khapra , Balaraman Ravindran
‹ Prev 1 8 9 10 Next ›