English
Related papers

Related papers: Exploring Prompt Engineering: A Systematic Review …

200 papers

Generative large language models (LLMs) have demonstrated exceptional proficiency in various natural language processing (NLP) tasks, including machine translation, question answering, text summarization, and natural language understanding.…

Computation and Language · Computer Science 2024-01-17 Nooshin Pourkamali , Shler Ebrahim Sharifi

Prompt engineering has rapidly emerged as a critical skill for effective interaction with large language models (LLMs). However, the cognitive and neural underpinnings of this expertise remain largely unexplored. This paper presents…

The performance of large language models (LLMs) is significantly influenced by the quality of the prompts provided. In response, researchers have developed enormous prompt engineering strategies aimed at modifying the prompt text to enhance…

Computation and Language · Computer Science 2024-10-23 Zhiyuan He , Huiqiang Jiang , Zilong Wang , Yuqing Yang , Luna Qiu , Lili Qiu

Since the advent of large language models (LLMs), prompt engineering has been a crucial step for eliciting desired responses for various Natural Language Processing (NLP) tasks. However, prompt engineering remains an impediment for end…

Large Language Models (LLMs) are nowadays extensively used for various types of software engineering tasks, primarily code generation. Previous research has shown how suitable prompt engineering could help developers in improving their code…

Software documentation is essential for program comprehension, developer onboarding, code review, and long-term maintenance. Yet producing quality documentation manually is time-consuming and frequently yields incomplete or inconsistent…

Software Engineering · Computer Science 2026-04-20 Afia Farjana , Zaiyu Cheng , Antonio Mastropaolo

Artificial Intelligence and especially Large Language Models (LLM), such as ChatGPT has revolutionized the way educators work. The results we get from LLMs depend on how we ask them to help us. The process and the technique behind an…

Physics Education · Physics 2025-10-13 Dimitrios Gousopoulos

In this paper, we propose a novel prompting approach aimed at enhancing the ability of Large Language Models (LLMs) to generate accurate Python code. Specifically, we introduce a prompt template designed to improve the quality and…

Software Engineering · Computer Science 2025-06-16 Rogelio Cruz , Jonatan Contreras , Francisco Guerrero , Ezequiel Rodriguez , Carlos Valdez , Citlali Carrillo

The paper aims to fulfil three main functions: (1) to serve as an introduction for the physics education community to the functioning of Large Language Models (LLMs), (2) to present a series of illustrative examples demonstrating how…

Physics Education · Physics 2024-01-31 Giulia Polverini , Bor Gregorcic

Large Language Models (LLMs), such as ChatGPT, exhibit advanced capabilities in generating text, images, and videos. However, their effective use remains constrained by challenges in prompt formulation, personalization, and opaque…

Human-Computer Interaction · Computer Science 2025-03-04 Si Thu , A. Baki Kocaballi

The potential of large language models (LLMs) to mitigate the time- and cost- related challenges associated with inductive thematic analysis (ITA) has been extensively explored in the literature. However, the use of LLMs to support ITA has…

Human-Computer Interaction · Computer Science 2025-04-01 Muhammad Talal Khalid , Ann-Perry Witmer

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

Prompt Engineering (PE) has emerged as a critical technique for guiding Large Language Models (LLMs) in solving intricate tasks. Its importance is highlighted by its potential to significantly enhance the efficiency and effectiveness of…

Machine Learning · Computer Science 2023-11-06 Yifan Luo , Yiming Tang , Chengfeng Shen , Zhennan Zhou , Bin Dong

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Large language models (LLMs) are incredibly powerful at comprehending and generating data in the form of text, but are brittle and error-prone. There has been an advent of toolkits and recipes centered around so-called prompt…

Databases · Computer Science 2023-08-09 Aditya G. Parameswaran , Shreya Shankar , Parth Asawa , Naman Jain , Yujie Wang

Prompt engineering reduces reasoning mistakes in Large Language Models (LLMs). However, its effectiveness in mitigating vulnerabilities in LLM-generated code remains underexplored. To address this gap, we implemented a benchmark to…

Software Engineering · Computer Science 2025-02-11 Marc Bruni , Fabio Gabrielli , Mohammad Ghafari , Martin Kropp

Large language model performance can be improved in a large number of ways. Many such techniques, like fine-tuning or advanced tool usage, are time-intensive and expensive. Although prompt engineering is significantly cheaper and often…

Computation and Language · Computer Science 2025-06-03 Philipp Schoenegger , Cameron R. Jones , Philip E. Tetlock , Barbara Mellers

This paper presents a comprehensive exploration of the evolution of prompt engineering and generation in the field of natural language processing (NLP). Starting from the early language models and information retrieval systems, we trace the…

Computation and Language · Computer Science 2023-11-29 Golam Md Muktadir

Prompt engineering has emerged as a powerful technique for guiding large language models (LLMs) toward desired responses, significantly enhancing their performance across diverse tasks. Beyond their role as static predictors, LLMs…

Machine Learning · Computer Science 2025-03-27 Ryumei Nakada , Wenlong Ji , Tianxi Cai , James Zou , Linjun Zhang

GPT-3 and several other language models (LMs) can effectively address various natural language processing (NLP) tasks, including machine translation and text summarization. Recently, they have also been successfully employed in the business…

Artificial Intelligence · Computer Science 2023-04-17 Kiran Busch , Alexander Rochlitzer , Diana Sola , Henrik Leopold