English
Related papers

Related papers: Large Language Models are Few-shot Generators: Pro…

200 papers

As the popularity of Large Language Models (LLMs) grow, combining model safety with utility becomes increasingly important. The challenge is making sure that LLMs can recognize and decline dangerous prompts without sacrificing their ability…

Computation and Language · Computer Science 2024-08-30 Ruchira Ray , Ruchi Bhalani

Utilizing large language models (LLMs) for zero-shot document ranking is done in one of two ways: (1) prompt-based re-ranking methods, which require no further training but are only feasible for re-ranking a handful of candidate documents…

Information Retrieval · Computer Science 2024-10-22 Shengyao Zhuang , Xueguang Ma , Bevan Koopman , Jimmy Lin , Guido Zuccon

Prevailing methods for mapping large generative language models to supervised tasks may fail to sufficiently probe models' novel capabilities. Using GPT-3 as a case study, we show that 0-shot prompts can significantly outperform few-shot…

Computation and Language · Computer Science 2021-02-16 Laria Reynolds , Kyle McDonell

Large language models (LLMs) have achieved remarkable performance in generating human-like text and solving reasoning tasks of moderate complexity, such as question-answering and mathematical problem-solving. However, their capabilities in…

Computation and Language · Computer Science 2025-02-21 Cole Gawin , Yidan Sun , Mayank Kejriwal

The increasing reliance on large language models (LLMs) such as ChatGPT in various fields emphasizes the importance of ``prompt engineering,'' a technology to improve the quality of model outputs. With companies investing significantly in…

Cryptography and Security · Computer Science 2024-02-21 Zeyang Sha , Yang Zhang

Large Language Models (LLMs) have demonstrated strong capabilities in multilingual machine translation, sometimes even outperforming traditional neural systems. However, previous research has highlighted the challenges of using LLMs,…

Computation and Language · Computer Science 2025-05-29 Samuel Frontull , Thomas Ströhle

Safety-aligned large language models (LLMs) sometimes falsely refuse pseudo-harmful prompts, like "how to kill a mosquito," which are actually harmless. Frequent false refusals not only frustrate users but also provoke a public backlash…

Computation and Language · Computer Science 2025-06-12 Bang An , Sicheng Zhu , Ruiyi Zhang , Michael-Andrei Panaitescu-Liess , Yuancheng Xu , Furong Huang

Due to their architecture and vast pre-training data, large language models (LLMs) demonstrate strong text classification performance. However, LLM output - here, the category assigned to a text - depends heavily on the wording of the…

Computation and Language · Computer Science 2025-12-04 Kylie L. Anglin , Stephanie Milan , Brittney Hernandez , Claudia Ventura

Numerous studies have investigated methods for jailbreaking Large Language Models (LLMs) to generate harmful content. Typically, these methods are evaluated using datasets of malicious prompts designed to bypass security policies…

Cryptography and Security · Computer Science 2025-01-03 Johan Wahréus , Ahmed Mohamed Hussain , Panos Papadimitratos

Developing effective prompts demands significant cognitive investment to generate reliable, high-quality responses from Large Language Models (LLMs). By deploying case-specific prompt engineering techniques that streamline frequently…

Computation and Language · Computer Science 2026-04-30 Valentin Romanov , Steven A Niederer

Augmenting large language models (LLMs) with user-specific knowledge is crucial for real-world applications, such as personal AI assistants. However, LLMs inherently lack mechanisms for prompt-driven knowledge capture. This paper…

Computation and Language · Computer Science 2024-02-02 Tolga Çöplü , Arto Bendiken , Andrii Skomorokhov , Eduard Bateiko , Stephen Cobb , Joshua J. Bouw

The prompt has become an effective linguistic tool for utilizing pre-trained language models. However, in few-shot scenarios, subtle changes in the prompt design always make the result widely different, and the prompt learning methods also…

Computation and Language · Computer Science 2024-03-13 Jinta Weng , Yifan Deng , d Donghao Li , Hao You , Yue Hu , Heyan Huang

Large Language Models (LLMs) are deployed in interactive contexts with direct user engagement, such as chatbots and writing assistants. These deployments are vulnerable to prompt injection and jailbreaking (collectively, prompt hacking), in…

Prompt Recovery, reconstructing prompts from the outputs of large language models (LLMs), has grown in importance as LLMs become ubiquitous. Most users access LLMs through APIs without internal model weights, relying only on outputs and…

Computation and Language · Computer Science 2025-04-08 Shenyang Liu , Yang Gao , Shaoyan Zhai , Liqiang Wang

Large language models (LLMs) are known to effectively perform tasks by simply observing few exemplars. However, in low-resource languages, obtaining such hand-picked exemplars can still be challenging, where unsupervised techniques may be…

Computation and Language · Computer Science 2024-07-22 Xuan-Phi Nguyen , Sharifah Mahani Aljunied , Shafiq Joty , Lidong Bing

Few-shot learning for open domain multi-hop question answering typically relies on the incontext learning capability of large language models (LLMs). While powerful, these LLMs usually contain tens or hundreds of billions of parameters,…

Computation and Language · Computer Science 2024-02-14 Mingda Chen , Xilun Chen , Wen-tau Yih

The rapid expansion of social media leads to a marked increase in hate speech, which threatens personal lives and results in numerous hate crimes. Detecting hate speech presents several challenges: diverse dialects, frequent code-mixing,…

Computation and Language · Computer Science 2025-07-01 Ruhina Tabasshum Prome , Tarikul Islam Tamiti , Anomadarshi Barua

Prompt engineering enables Large Language Models (LLMs) to perform a variety of tasks. However, lengthy prompts significantly increase computational complexity and economic costs. To address this issue, we study six prompt compression…

Computation and Language · Computer Science 2025-05-02 Zheng Zhang , Jinyi Li , Yihuai Lan , Xiang Wang , Hao Wang

This study harnesses state-of-the-art AI technology for detecting mental disorders through user-generated textual content. Existing studies typically rely on fully supervised machine learning, which presents challenges such as the…

Computation and Language · Computer Science 2025-03-17 Haoxin Liu , Wenli Zhang , Jiaheng Xie , Buomsoo Kim , Zhu Zhang , Yidong Chai , Sudha Ram

Batch prompting is a common technique in large language models (LLMs) used to process multiple inputs simultaneously, aiming to improve computational efficiency. However, as batch sizes increase, performance degradation often occurs due to…

Computation and Language · Computer Science 2024-10-03 Longyu Feng , Mengze Hong , Chen Jason Zhang