English
Related papers

Related papers: Prompt Stealing Attacks Against Large Language Mod…

200 papers

Large Language models (LLMs) have emerged as powerful tools for addressing challenges across diverse domains. Notably, recent studies have demonstrated that large language models significantly enhance the efficiency of biomolecular analysis…

Computation and Language · Computer Science 2025-03-07 Jiyue Jiang , Zikang Wang , Yuheng Shan , Heyan Chai , Jiayi Li , Zixian Ma , Xinrui Zhang , Yu Li

Large Language Models (LLMs), while powerful, are built and trained to process a single text input. In common applications, multiple inputs can be processed by concatenating them together into a single stream of text. However, the LLM is…

Cryptography and Security · Computer Science 2024-03-25 Keegan Hines , Gary Lopez , Matthew Hall , Federico Zarfati , Yonatan Zunger , Emre Kiciman

In recent years, the growing interest in Large Language Models (LLMs) has significantly advanced prompt engineering, transitioning from manual design to model-based optimization. Prompts for LLMs generally comprise two components: the…

Computation and Language · Computer Science 2025-10-09 Qinhao Zhou , Xiang Xiang , Kun He , John E. Hopcroft

Large language models (LLMs) have attracted great attention given their strong performance on a wide range of NLP tasks. In practice, users often expect generated texts to fall within a specific length range, making length controlled…

Computation and Language · Computer Science 2024-06-18 Renlong Jie , Xiaojun Meng , Lifeng Shang , Xin Jiang , Qun Liu

Prompt engineering has become central to eliciting the capabilities of large language models (LLMs). At its core lies prompt selection -- efficiently identifying the most effective prompts. However, most prior investigations overlook a key…

Machine Learning · Computer Science 2026-05-15 Donghao Li , Chengshuai Shi , Weijuan Ou , Cong Shen , Jing Yang

The recent growth in the use of Large Language Models has made them vulnerable to sophisticated adversarial assaults, manipulative prompts, and encoded malicious inputs. Existing countermeasures frequently necessitate retraining models,…

Computation and Language · Computer Science 2026-03-10 Sheikh Samit Muhaimin , Spyridon Mastorakis

Prompt engineering has emerged as an integral technique for extending the strengths and abilities of Large Language Models (LLMs) to gain significant performance gains in various Natural Language Processing (NLP) tasks. This approach, which…

Computation and Language · Computer Science 2026-02-13 Munazza Zaib , Elaf Alhazmi

Large Language Models (LLMs) are increasingly used by software engineers for code generation. However, limitations of LLMs such as irrelevant or incorrect code have highlighted the need for prompt programming (or prompt engineering) where…

Software Engineering · Computer Science 2025-07-09 Ranim Khojah , Francisco Gomes de Oliveira Neto , Mazen Mohamad , Philipp Leitner

Prompts are the interface for eliciting the capabilities of large language models (LLMs). Understanding their structure and components is critical for analyzing LLM behavior and optimizing performance. However, the field lacks a…

Computation and Language · Computer Science 2026-01-27 Sullam Jeoung , Yueyan Chen , Yi Zhang , Shuai Wang , Haibo Ding , Lin Lee Cheong

Prompt-based learning is a new language model training paradigm that adapts the Pre-trained Language Models (PLMs) to downstream tasks, which revitalizes the performance benchmarks across various natural language processing (NLP) tasks.…

Computation and Language · Computer Science 2024-04-10 Yue Xu , Wenjie Wang

Although many large language models (LLMs) have been trained to refuse harmful requests, they are still vulnerable to jailbreaking attacks which rewrite the original prompt to conceal its harmful intent. In this paper, we propose a new…

Computation and Language · Computer Science 2024-06-10 Yihan Wang , Zhouxing Shi , Andrew Bai , Cho-Jui Hsieh

The recent trend in the Large Vision and Language model has brought a new change in how information extraction systems are built. VLMs have set a new benchmark with their State-of-the-art techniques in understanding documents and building…

Computer Vision and Pattern Recognition · Computer Science 2024-08-08 Dipankar Medhi

Large language models (LLMs) are now routinely used to autonomously execute complex tasks, from natural language processing to dynamic workflows like web searches. The usage of tool-calling and Retrieval Augmented Generation (RAG) allows…

Cryptography and Security · Computer Science 2026-04-13 Dennis Rall , Bernhard Bauer , Mohit Mittal , Thomas Fraunholz

Large language models (LLMs) are known to be vulnerable to jailbreak attacks, which typically rely on carefully designed prompts containing explicit semantic structure. These attacks generally operate by fixing an adversarial instruction…

Machine Learning · Computer Science 2026-05-07 Marco Rando , Samuel Vaiter

In this study, we introduce RePD, an innovative attack Retrieval-based Prompt Decomposition framework designed to mitigate the risk of jailbreak attacks on large language models (LLMs). Despite rigorous pretraining and finetuning focused on…

Cryptography and Security · Computer Science 2024-12-02 Peiran Wang , Xiaogeng Liu , Chaowei Xiao

Prompt engineering, as an efficient and effective way to leverage Large Language Models (LLM), has drawn a lot of attention from the research community. The existing research primarily emphasizes the importance of adapting prompts to…

Computation and Language · Computer Science 2024-07-08 Yuyan Chen , Zhihao Wen , Ge Fan , Zhengyu Chen , Wei Wu , Dayiheng Liu , Zhixu Li , Bang Liu , Yanghua Xiao

Many recent prompting strategies for large language models (LLMs) query the model multiple times sequentially -- first to produce intermediate results and then the final answer. However, using these methods, both decoder and model are…

Computation and Language · Computer Science 2023-11-10 Luca Beurer-Kellner , Mark Niklas Müller , Marc Fischer , Martin Vechev

Prompt engineering has emerged as a powerful technique for guiding large language models (LLMs) toward desired responses, significantly enhancing their performance across diverse tasks. Beyond their role as static predictors, LLMs…

Machine Learning · Computer Science 2025-03-27 Ryumei Nakada , Wenlong Ji , Tianxi Cai , James Zou , Linjun Zhang

Large language models (LLMs) can perform recommendation tasks by taking prompts written in natural language as input. Compared to traditional methods such as collaborative filtering, LLM-based recommendation offers advantages in handling…

Information Retrieval · Computer Science 2025-07-21 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Large language models (LLMs) have demonstrated impressive performance and have come to dominate the field of natural language processing (NLP) across various tasks. However, due to their strong instruction-following capabilities and…

Cryptography and Security · Computer Science 2026-04-10 Yulin Chen , Haoran Li , Yuan Sui , Yue Liu , Yufei He , Xiaoling Bai , Chi Fei , Yabo Li , Haozhe Ma , Yangqiu Song , Bryan Hooi