中文
相关论文

相关论文: Prompt Inference Attack on Distributed Large Langu…

200 篇论文

As Large Language Models (LLMs) increasingly become key components in various AI applications, understanding their security vulnerabilities and the effectiveness of defense mechanisms is crucial. This survey examines the security challenges…

机器学习 · 计算机科学 2024-06-04 Frank Weizhen Liu , Chenhui Hu

Large language models (LLMs) have gained widespread adoption across diverse applications due to their impressive generative capabilities. Their plug-and-play nature enables both developers and end users to interact with these models through…

密码学与安全 · 计算机科学 2025-10-21 Zongze Li , Jiawei Guo , Haipeng Cai

As large language models (LLMs) permeate more and more applications, an assessment of their associated security risks becomes increasingly necessary. The potential for exploitation by malicious actors, ranging from disinformation to data…

密码学与安全 · 计算机科学 2024-09-24 Erik Derner , Kristina Batistič , Jan Zahálka , Robert Babuška

Large Language Models (LLMs) are increasingly being integrated into the scientific peer-review process, raising new questions about their reliability and resilience to manipulation. In this work, we investigate the potential for hidden…

密码学与安全 · 计算机科学 2026-03-31 Matteo Gioele Collu , Umberto Salviati , Roberto Confalonieri , Mauro Conti , Giovanni Apruzzese

Sequence models, such as Large Language Models (LLMs) and autoregressive image generators, have a tendency to memorize and inadvertently leak sensitive information. While this tendency has critical legal implications, existing tools are…

密码学与安全 · 计算机科学 2025-06-06 Lorenzo Rossi , Michael Aerni , Jie Zhang , Florian Tramèr

Jailbreaking attacks can effectively manipulate open-source large language models (LLMs) to produce harmful responses. However, these attacks exhibit limited transferability, failing to disrupt proprietary LLMs consistently. To reliably…

机器学习 · 计算机科学 2025-05-20 Runqi Lin , Bo Han , Fengwang Li , Tongling Liu

Large-scale pre-trained models are increasingly adapted to downstream tasks through a new paradigm called prompt learning. In contrast to fine-tuning, prompt learning does not update the pre-trained model's parameters. Instead, it only…

密码学与安全 · 计算机科学 2023-10-19 Yixin Wu , Rui Wen , Michael Backes , Pascal Berrang , Mathias Humbert , Yun Shen , Yang Zhang

As the pre-trained language models (PLMs) continue to grow, so do the hardware and data requirements for fine-tuning PLMs. Therefore, the researchers have come up with a lighter method called \textit{Prompt Learning}. However, during the…

计算与语言 · 计算机科学 2022-09-07 Yundi Shi , Piji Li , Changchun Yin , Zhaoyang Han , Lu Zhou , Zhe Liu

As Large Language Models (LLMs) grow increasingly powerful, multi-agent systems are becoming more prevalent in modern AI applications. Most safety research, however, has focused on vulnerabilities in single-agent LLMs. These include prompt…

多智能体系统 · 计算机科学 2024-10-11 Donghyun Lee , Mo Tiwari

Large language models (LLMs) have demonstrated impressive performance and have come to dominate the field of natural language processing (NLP) across various tasks. However, due to their strong instruction-following capabilities and…

密码学与安全 · 计算机科学 2026-04-10 Yulin Chen , Haoran Li , Yuan Sui , Yue Liu , Yufei He , Xiaoling Bai , Chi Fei , Yabo Li , Haozhe Ma , Yangqiu Song , Bryan Hooi

The advent of Large Language Models LLMs marks a milestone in Artificial Intelligence, altering how machines comprehend and generate human language. However, LLMs are vulnerable to malicious prompt injection attacks, where crafted inputs…

计算与语言 · 计算机科学 2024-10-29 Sahasra Kokkula , Somanathan R , Nandavardhan R , Aashishkumar , G Divya

Federated Learning (FL) is increasingly being adopted in military collaborations to develop Large Language Models (LLMs) while preserving data sovereignty. However, prompt injection attacks-malicious manipulations of input prompts-pose new…

机器学习 · 计算机科学 2026-05-05 Youngjoon Lee , Taehyun Park , Yunho Lee , Jinu Gong , Joonhyuk Kang

Large language models (LLMs) have transformed natural language processing, but their ability to memorize training data poses significant privacy risks. This paper investigates model inversion attacks on the Llama 3.2 model, a multilingual…

机器学习 · 计算机科学 2025-07-08 Sathesh P. Sivashanmugam

Security threats like prompt injection attacks pose significant risks to applications that integrate Large Language Models (LLMs), potentially leading to unauthorized actions such as API misuse. Unlike previous approaches that aim to detect…

密码学与安全 · 计算机科学 2025-04-01 Shih-Han Chan

Traditional security protection methods struggle to address sophisticated attack vectors in large-scale distributed systems, particularly when balancing detection accuracy with data privacy concerns. This paper presents a novel distributed…

密码学与安全 · 计算机科学 2025-02-26 Yuqing Wang , Xiao Yang

Large language models (LLMs) possess extensive knowledge and question-answering capabilities, having been widely deployed in privacy-sensitive domains like finance and medical consultation. During LLM inferences, cache-sharing methods are…

密码学与安全 · 计算机科学 2024-12-02 Xinyao Zheng , Husheng Han , Shangyi Shi , Qiyan Fang , Zidong Du , Xing Hu , Qi Guo

Large Language Models (LLMs) such as ChatGPT can infer personal attributes from seemingly innocuous text, raising privacy risks beyond memorized data leakage. While prior work has demonstrated these risks, little is known about how users…

人机交互 · 计算机科学 2025-09-16 Synthia Wang , Sai Teja Peddinti , Nina Taft , Nick Feamster

Large Language Models (LLMs) are swiftly advancing in architecture and capability, and as they integrate more deeply into complex systems, the urgency to scrutinize their security properties grows. This paper surveys research in the…

计算与语言 · 计算机科学 2023-10-18 Erfan Shayegani , Md Abdullah Al Mamun , Yu Fu , Pedram Zaree , Yue Dong , Nael Abu-Ghazaleh

As large language models (LLMs) scale, their inference incurs substantial computational resources, exposing them to energy-latency attacks, where crafted prompts induce high energy and latency cost. Existing attack methods aim to prolong…

密码学与安全 · 计算机科学 2025-11-12 Xingyu Li , Xiaolei Liu , Cheng Liu , Yixiao Xu , Kangyi Ding , Bangzhou Xin , Jia-Li Yin

Large language models (LLMs) do not preserve privacy at inference-time. The LLM's outputs can inadvertently reveal information about the model's context, which presents a privacy challenge when the LLM is augmented via tools or databases…

计算与语言 · 计算机科学 2026-02-03 Rushil Thareja , Preslav Nakov , Praneeth Vepakomma , Nils Lukas