English
Related papers

Related papers: Revisiting Prompt Engineering: A Comprehensive Eva…

200 papers

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

Prompt engineering is crucial for achieving reliable and effective outputs from large language models (LLMs), but its design requires specialized knowledge of prompting techniques and a deep understanding of target tasks. To address this…

Computation and Language · Computer Science 2025-10-22 Yohei Ikenoue , Hitomi Tashiro , Shigeru Kuroyanagi

Recently, large language models (LLMs) have been successfully applied to many fields, showing outstanding comprehension and reasoning capabilities. Despite their great potential, LLMs usually require dedicated pre-training and fine-tuning…

Networking and Internet Architecture · Computer Science 2024-12-31 Hao Zhou , Chengming Hu , Dun Yuan , Ye Yuan , Di Wu , Xi Chen , Hina Tabassum , Xue Liu

Large language models (LLMs) have the potential to enhance K-12 STEM education by improving both teaching and learning processes. While previous studies have shown promising results, there is still a lack of comprehensive understanding…

Computation and Language · Computer Science 2024-10-16 Eason Chen , Danyang Wang , Luyi Xu , Chen Cao , Xiao Fang , Jionghao Lin

The remarkable advancements in large language models (LLMs) have brought about significant improvements in Natural Language Processing(NLP) tasks. This paper presents a comprehensive review of in-context learning techniques, focusing on…

Computation and Language · Computer Science 2023-09-26 Yinheng Li

Large language models (LLMs) have shown remarkable abilities in different fields, including standard Natural Language Processing (NLP) tasks. To elicit knowledge from LLMs, prompts play a key role, consisting of natural language…

Computation and Language · Computer Science 2024-10-08 Mohamed Bayan Kmainasi , Rakif Khan , Ali Ezzat Shahroor , Boushra Bendou , Maram Hasanain , Firoj Alam

Large Language Models (LLMs) have the potential to revolutionize automated traceability by overcoming the challenges faced by previous methods and introducing new possibilities. However, the optimal utilization of LLMs for automated…

Software Engineering · Computer Science 2023-08-02 Alberto D. Rodriguez , Katherine R. Dearstyne , Jane Cleland-Huang

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

Large Language Models (LLMs) have shown remarkable capabilities in manipulating natural language across multiple applications, but their ability to handle simple reasoning tasks is often questioned. In this work, we aim to provide a…

Computation and Language · Computer Science 2025-05-05 Alessandro Raganato , Rafael Peñaloza , Marco Viviani , Gabriella Pasi

Large language models (LLMs) are widely used for open-ended tasks, but underspecified prompts can lead to low-quality answers and additional interaction. This paper studies whether structured prompt design improves response quality while…

Computation and Language · Computer Science 2026-05-20 Saurav Ghosh , Gabriella Polach , Abdou Sow

The versatility of Large Language Models (LLMs) on natural language understanding tasks has made them popular for research in social sciences. To properly understand the properties and innate personas of LLMs, researchers have performed…

Computation and Language · Computer Science 2024-04-03 Bangzhao Shu , Lechen Zhang , Minje Choi , Lavinia Dunagan , Lajanugen Logeswaran , Moontae Lee , Dallas Card , David Jurgens

Prompt engineering is an essential technique for enhancing the abilities of large language models (LLMs) by providing explicit and specific instructions. It enables LLMs to excel in various tasks, such as arithmetic reasoning, question…

Computation and Language · Computer Science 2024-03-29 Fobo Shi , Peijun Qing , Dong Yang , Nan Wang , Youbo Lei , Haonan Lu , Xiaodong Lin , Duantengchuan Li

Large language models (LLMs) are increasingly utilized in various complex reasoning tasks due to their excellent instruction following capability. However, the model's performance is highly dependent on the open-ended characteristics of the…

Computation and Language · Computer Science 2026-04-28 Zhenzhen Huang , Chaoning Zhang , Fachrina Dewi Puspitasari , Jiaquan Zhang , Yitian Zhou , Shuxu Chen , Yang Yang

In this paper, we conduct a comprehensive SWOT analysis of prompt engineering techniques within the realm of Large Language Models (LLMs). Emphasizing linguistic principles, we examine various techniques to identify their strengths,…

Computation and Language · Computer Science 2024-10-18 Aditi Singh , Abul Ehtesham , Gaurav Kumar Gupta , Nikhil Kumar Chatta , Saket Kumar , Tala Talaei Khoei

Large language models (LLMs) enable system builders today to create competent NLP systems through prompting, where they only need to describe the task in natural language and provide a few examples. However, in other ways, LLMs are a step…

Computation and Language · Computer Science 2023-08-24 Vijay Viswanathan , Chenyang Zhao , Amanda Bertsch , Tongshuang Wu , Graham Neubig

Software documentation is essential for program comprehension, developer onboarding, code review, and long-term maintenance. Yet producing quality documentation manually is time-consuming and frequently yields incomplete or inconsistent…

Software Engineering · Computer Science 2026-04-20 Afia Farjana , Zaiyu Cheng , Antonio Mastropaolo

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

Computation and Language · Computer Science 2024-08-05 Xiangyu Zhao , Chengqian Ma

Effective prompt engineering is critical to realizing the promised productivity gains of large language models (LLMs) in knowledge-intensive tasks. Yet, many users struggle to craft prompts that yield high-quality outputs, limiting the…

Human-Computer Interaction · Computer Science 2025-10-02 Niklas Gutheil , Valentin Mayer , Leopold Müller , Jörg Rommelt , Niklas Kühl

System prompts provide a lightweight yet powerful mechanism for conditioning large language models (LLMs) at inference time. While prior work has focused on English-only settings, real-world deployments benefit from having a single prompt…

Computation and Language · Computer Science 2025-12-03 Lechen Zhang , Yusheng Zhou , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

Leveraging large language models (LLMs) for complex natural language tasks typically requires long-form prompts to convey detailed requirements and information, which results in increased memory usage and inference costs. To mitigate these…

Computation and Language · Computer Science 2024-10-18 Zongqian Li , Yinhong Liu , Yixuan Su , Nigel Collier