English
Related papers

Related papers: Fingerprinting LLMs via Prompt Injection

200 papers

There are concerns that the ability of language models (LMs) to generate high quality synthetic text can be misused to launch spam, disinformation, or propaganda. Therefore, the research community is actively working on developing…

Computation and Language · Computer Science 2021-06-04 Nirav Diwan , Tanmoy Chakravorty , Zubair Shafiq

Establishing reliable and verifiable fingerprinting mechanisms is fundamental to controlling the unauthorized redistribution of large language models (LLMs). However, existing approaches face two major challenges: (a) ensuring…

Computation and Language · Computer Science 2026-01-22 Yue Li , Xin Yi , Dongsheng Shi , Yongyi Cui , Gerard de Melo , Linlin Wang

The development of large language models (LLMs) is costly and has significant commercial value. Consequently, preventing unauthorized appropriation of open-source LLMs and protecting developers' intellectual property rights have become…

Computation and Language · Computer Science 2026-02-02 Yiheng Liu , Junhao Ning , Sichen Xia , Haiyang Sun , Yang Yang , Hanyang Chi , Xiaohui Gao , Ning Qiang , Bao Ge , Junwei Han , Xintao Hu

As large language models are increasingly deployed in sensitive environments, fingerprinting attacks pose significant privacy and security risks. We present a study of LLM fingerprinting from both offensive and defensive perspectives. Our…

Cryptography and Security · Computer Science 2025-08-13 Kevin Kurian , Ethan Holland , Sean Oesch

Large Language Models (LLMs) remain vulnerable to prompt injection attacks, representing the most significant security threat in production deployments. We present Prompt Fencing, a novel architectural approach that applies cryptographic…

Cryptography and Security · Computer Science 2025-11-26 Steven Peh

Large language models (LLMs) for code completion and generation are increasingly used in software development, yet they may reproduce training examples verbatim and without authorship attribution, raising legal and ethical concerns around…

Software Engineering · Computer Science 2026-05-28 Andrea Gurioli , Davide D'Ascenzo , Federico Pennino , Maurizio Gabbrielli , Stefano Zacchiroli

Large language model (LLM) outputs arise from complex interactions among prompts, system instructions, model parameters, and architecture. We refer to specific configurations of these factors as generation conditions, each of which can bias…

Artificial Intelligence · Computer Science 2026-05-08 Amal Alnouri , Andreas Hinterreiter , Christina Humer , Furui Cheng , Marc Streit

Current benchmarks for Large Language Models (LLMs) primarily focus on performance metrics, often failing to capture the nuanced behavioral characteristics that differentiate them. This paper introduces a novel ``Behavioral Fingerprinting''…

Computation and Language · Computer Science 2025-09-08 Zehua Pei , Hui-Ling Zhen , Ying Zhang , Zhiyuan Yang , Xing Li , Xianzhi Yu , Mingxuan Yuan , Bei Yu

The proliferation of large language models (LLMs) has intensified concerns over model theft and license violations, necessitating robust and stealthy ownership verification. Existing fingerprinting methods either require impractical…

Cryptography and Security · Computer Science 2025-09-04 Zhenhua Xu , Meng Han , Wenpeng Xing

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

Software Engineering · Computer Science 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

Prompt engineering has emerged as a powerful technique for optimizing large language models (LLMs) for specific applications, enabling faster prototyping and improved performance, and giving rise to the interest of the community in…

Artificial Intelligence · Computer Science 2025-02-17 Roman Levin , Valeriia Cherepanova , Abhimanyu Hans , Avi Schwarzschild , Tom Goldstein

Protecting the copyright of large language models (LLMs) has become crucial due to their resource-intensive training and accompanying carefully designed licenses. However, identifying the original base model of an LLM is challenging due to…

Computation and Language · Computer Science 2025-01-08 Boyi Zeng , Lizheng Wang , Yuncong Hu , Yi Xu , Chenghu Zhou , Xinbing Wang , Yu Yu , Zhouhan Lin

Model fingerprinting has emerged as a powerful tool for model owners to identify their shared model given API access. However, to lower false discovery rate, fight fingerprint leakage, and defend against coalitions of model users attempting…

Cryptography and Security · Computer Science 2025-10-01 Anshul Nasery , Jonathan Hayase , Creston Brooks , Peiyao Sheng , Himanshu Tyagi , Pramod Viswanath , Sewoong Oh

Large language models (LLMs) have been applied in various applications due to their astonishing capabilities. With advancements in technologies such as chain-of-thought (CoT) prompting and in-context learning (ICL), the prompts fed to LLMs…

Computation and Language · Computer Science 2023-12-07 Huiqiang Jiang , Qianhui Wu , Chin-Yew Lin , Yuqing Yang , Lili Qiu

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and…

Software Engineering · Computer Science 2025-06-16 Rogelio Cruz , Jonatan Contreras , Francisco Guerrero , Ezequiel Rodriguez , Carlos Valdez , Citlali Carrillo

Large Language Models (LLMs) are increasingly applied to automate software engineering tasks, including the generation of UML class diagrams from natural language descriptions. While prior work demonstrates that LLMs can produce…

Software Engineering · Computer Science 2026-04-07 Rabia Iftikhar , Andreas Rausch

Recently, Large Language Models (LLMs) have garnered significant attention for their exceptional natural language processing capabilities. However, concerns about their trustworthiness remain unresolved, particularly in addressing…

Computation and Language · Computer Science 2025-01-29 Yue Huang , Jingyu Tang , Dongping Chen , Bingda Tang , Yao Wan , Lichao Sun , Philip S. Yu , Xiangliang Zhang

Growing concerns over the theft and misuse of Large Language Models (LLMs) have heightened the need for effective fingerprinting, which links a model to its original version to detect misuse. In this paper, we define five key properties for…

Cryptography and Security · Computer Science 2025-06-13 Mark Russinovich , Ahmed Salem

Instruction tuning increasingly relies on LLM-based prompt refinement, where prompts in the training corpus are selectively rewritten by an external refiner to improve clarity and instruction alignment. This motivates an instance-level…

Machine Learning · Computer Science 2026-01-06 Bo Yin , Qi Li , Runpeng Yu , Xinchao Wang

Large Language Models (LLMs) are gaining momentum in software development with prompt-driven programming enabling developers to create code from natural language (NL) instructions. However, studies have questioned their ability to produce…

Software Engineering · Computer Science 2025-02-27 Catherine Tony , Nicolás E. Díaz Ferreyra , Markus Mutas , Salem Dhiff , Riccardo Scandariato