English
Related papers

Related papers: Autonomous Prompt Engineering in Large Language Mo…

200 papers

Handling and digesting a huge amount of information in an efficient manner has been a long-term demand in modern society. Some solutions to map key points (short textual summaries capturing essential information and filtering redundancies)…

Computation and Language · Computer Science 2022-11-29 Ahnaf Mozib Samin , Behrooz Nikandish , Jingyan Chen

Auto-GPT is an autonomous agent that leverages recent advancements in adapting Large Language Models (LLMs) for decision-making tasks. While there has been a growing interest in Auto-GPT stypled agents, questions remain regarding the…

Artificial Intelligence · Computer Science 2023-06-06 Hui Yang , Sifu Yue , Yunzhong He

Prompt engineering has emerged as a critical component in optimizing large language models (LLMs) for domain-specific tasks. However, the role of prompt specificity, especially in domains like STEM (physics, chemistry, biology, computer…

Computation and Language · Computer Science 2025-05-26 Dimitri Schreiter

Prompt engineering is critical for the development of LLM-based applications. However, it is usually done manually in a "trial and error" fashion that can be time consuming, ineffective, and sub-optimal. Even for the prompts which seemingly…

Artificial Intelligence · Computer Science 2024-06-11 Weize Kong , Spurthi Amba Hombaiah , Mingyang Zhang , Qiaozhu Mei , Michael Bendersky

Systematic reviews are vital for guiding practice, research, and policy, yet they are often slow and labour-intensive. Large language models (LLMs) could offer a way to speed up and automate systematic reviews, but their performance in such…

Computation and Language · Computer Science 2024-04-11 Qusai Khraisha , Sophie Put , Johanna Kappenberg , Azza Warraitch , Kristin Hadfield

Large language models (LLMs) have shown success in generating high-quality responses. In order to achieve better alignment with LLMs with human preference, various works are proposed based on specific optimization process, which, however,…

Computation and Language · Computer Science 2024-09-04 Zhuo Li , Yuhao Du , Jinpeng Hu , Xiang Wan , Anningzhe Gao

In a rapidly evolving digital landscape autonomous tools and robots are becoming commonplace. Recognizing the significance of this development, this paper explores the integration of Large Language Models (LLMs) like Generative pre-trained…

Human-Computer Interaction · Computer Science 2024-03-22 Younes Lakhnati , Max Pascher , Jens Gerken

This paper investigates the utilization of Large Language Models (LLMs) for solving complex linguistic puzzles, a domain requiring advanced reasoning and adept translation capabilities akin to human cognitive processes. We explore specific…

Computation and Language · Computer Science 2025-02-04 Zheng-Lin Lin , Yu-Fei Shih , Shu-Kai Hsieh

The emergence of large language models (LLMs) like GPT-4 has revolutionized natural language processing (NLP), enabling diverse, complex tasks. However, extensive token counts lead to high computational and financial burdens. To address…

Computation and Language · Computer Science 2025-03-12 Yun-Hao Cao , Yangsong Wang , Shuzheng Hao , Zhenxing Li , Chengjun Zhan , Sichao Liu , Yi-Qi Hu

This paper aims to efficiently enable Large Language Models (LLMs) to use multimodal tools. Advanced proprietary LLMs, such as ChatGPT and GPT-4, have shown great potential for tool usage through sophisticated prompt engineering.…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Rui Yang , Lin Song , Yanwei Li , Sijie Zhao , Yixiao Ge , Xiu Li , Ying Shan

A growing variety of prompt engineering techniques has been proposed for Large Language Models (LLMs), yet systematic evaluation of each technique on individual software engineering (SE) tasks remains underexplored. In this study, we…

Prompt tuning is a promising method to fine-tune a pre-trained language model without retraining its large-scale parameters. Instead, it attaches a soft prompt to the input text, whereby downstream tasks can be well adapted by merely…

Computation and Language · Computer Science 2024-12-12 Pengxiang Lan , Enneng Yang , Yuting Liu , Guibing Guo , Jianzhe Zhao , Xingwei Wang

The integration of Large Language Models (LLMs) like GPT-4o into robotic systems represents a significant advancement in embodied artificial intelligence. These models can process multi-modal prompts, enabling them to generate more…

Robotics · Computer Science 2024-09-10 Wenxiao Zhang , Xiangrui Kong , Conan Dewitt , Thomas Braunl , Jin B. Hong

This paper reports on the use of prompt engineering and GPT-3.5 for biomedical query-focused multi-document summarisation. Using GPT-3.5 and appropriate prompts, our system achieves top ROUGE-F1 results in the task of obtaining…

Computation and Language · Computer Science 2023-11-10 Diego Mollá

This paper explores the influence of integrating the purpose of the translation and the target audience into prompts on the quality of translations produced by ChatGPT. Drawing on previous translation studies, industry practices, and ISO…

Computation and Language · Computer Science 2024-02-22 Masaru Yamada

[Context]: Companies are increasingly recognizing the importance of automating Requirements Engineering (RE) tasks due to their resource-intensive nature. The advent of GenAI has made these tasks more amenable to automation, thanks to its…

Software Engineering · Computer Science 2023-11-08 Krishna Ronanki , Beatriz Cabrero-Daniel , Jennifer Horkoff , Christian Berger

Context: The rapid evolution of Large Language Models (LLMs) has sparked significant interest in leveraging their capabilities for automating code review processes. Prior studies often focus on developing LLMs for code review automation,…

Software Engineering · Computer Science 2024-06-18 Chanathip Pornprasit , Chakkrit Tantithamthavorn

Machine learning-based automatic scoring faces challenges with unbalanced student responses across scoring categories. To address this, we introduce a novel text data augmentation framework leveraging GPT-4, a generative large language…

Computation and Language · Computer Science 2024-09-09 Luyang Fang , Gyeong-Geon Lee , Xiaoming Zhai

This study investigates the use of prompt engineering to enhance large language models (LLMs), specifically GPT-4o-mini and gemini-1.5-flash, in sentiment analysis tasks. It evaluates advanced prompting techniques like few-shot learning,…

Computation and Language · Computer Science 2026-01-14 Marvin Schmitt , Anne Schwerk , Sebastian Lempert

Large Language Models (LLMs) excel in various tasks, but they rely on carefully crafted prompts that often demand substantial human effort. To automate this process, in this paper, we propose a novel framework for discrete prompt…

Computation and Language · Computer Science 2025-05-02 Qingyan Guo , Rui Wang , Junliang Guo , Bei Li , Kaitao Song , Xu Tan , Guoqing Liu , Jiang Bian , Yujiu Yang