English
Related papers

Related papers: Grammar-Guided Evolutionary Search for Discrete Pr…

200 papers

Large Language Models (LLMs) have become an integral part of many real-world workflows. However, LLMs consume a lot of energy, which becomes a large concern in the scale of the demand for these tools. As LLMs become integrated into…

Software Engineering · Computer Science 2026-05-01 Katelyn Crumpacker , Dimitrios Nikolopoulos

Large Language Models (LLMs) are increasingly embedded in applications, and people can shape model behavior by editing prompt instructions. Yet encoding subtle, domain-specific policies into prompts is challenging. Although this process…

Human-Computer Interaction · Computer Science 2026-03-26 Minjae Lee , Minsuk Kahng

Recent advances in large language models (LLMs) have led to their popularity across multiple use-cases. However, prompt engineering, the process for optimally utilizing such models, remains approximation-driven and subjective. Most of the…

Computational Complexity · Computer Science 2025-04-29 Aashutosh Nema , Samaksh Gulati , Evangelos Giakoumakis , Bipana Thapaliya

The performance of Large Language Models (LLMs) in reasoning tasks depends heavily on prompt design, with Chain-of-Thought (CoT) and self-consistency being critical methods that enhance this ability. However, these methods do not fully…

Computation and Language · Computer Science 2024-10-08 Chuanyang Zheng , Zhengying Liu , Enze Xie , Zhenguo Li , Yu Li

Large Language Models (LLMs) have significantly enhanced Information Retrieval (IR) across various modules, such as reranking. Despite impressive performance, current zero-shot relevance ranking with LLMs heavily relies on human prompt…

Artificial Intelligence · Computer Science 2025-05-21 Can Jin , Hongwu Peng , Shiyu Zhao , Zhenting Wang , Wujiang Xu , Ligong Han , Jiahui Zhao , Kai Zhong , Sanguthevar Rajasekaran , Dimitris N. Metaxas

The robustness of large language models (LLMs) becomes increasingly important as their use rapidly grows in a wide range of domains. Retrieval-Augmented Generation (RAG) is considered as a means to improve the trustworthiness of text…

Computation and Language · Computer Science 2025-05-22 Zhibo Hu , Chen Wang , Yanfeng Shu , Helen , Paik , Liming Zhu

Large language model performance can be improved in a large number of ways. Many such techniques, like fine-tuning or advanced tool usage, are time-intensive and expensive. Although prompt engineering is significantly cheaper and often…

Computation and Language · Computer Science 2025-06-03 Philipp Schoenegger , Cameron R. Jones , Philip E. Tetlock , Barbara Mellers

Prompt Learning has recently gained great popularity in bridging the gap between pretraining tasks and various downstream tasks. It freezes Pretrained Language Models (PLMs) and only tunes a few task-related parameters (prompts) for…

Computation and Language · Computer Science 2022-06-07 Yuezihan Jiang , Hao Yang , Junyang Lin , Hanyu Zhao , An Yang , Chang Zhou , Hongxia Yang , Zhi Yang , Bin Cui

We introduce Directional Stimulus Prompting, a novel framework for guiding black-box large language models (LLMs) toward specific desired outputs. Instead of directly adjusting LLMs, our method employs a small tunable policy model (e.g.,…

Computation and Language · Computer Science 2023-10-11 Zekun Li , Baolin Peng , Pengcheng He , Michel Galley , Jianfeng Gao , Xifeng Yan

Prompt engineering is crucial for effective interaction with generative artificial intelligence systems, yet existing optimisation methods often operate over an unstructured and vast prompt space, leading to high computational costs and…

Artificial Intelligence · Computer Science 2026-05-15 Devika Prasad , Luke Gerschwitz , Tong Li , Henry Xiao , Anjin Liu , Coco Wu , Anna Leontjeva , Luiz Pizzato

Phenotype-driven gene prioritization is a critical process in the diagnosis of rare genetic disorders for identifying and ranking potential disease-causing genes based on observed physical traits or phenotypes. While traditional approaches…

Quantitative Methods · Quantitative Biology 2024-04-04 Junyoung Kim , Jingye Yang , Kai Wang , Chunhua Weng , Cong Liu

The performance of large language models (LLMs) depends on how they are prompted, with choices spanning both the high-level prompting pattern (e.g., Zero-Shot, CoT, ReAct, ReWOO) and the specific prompt content (instructions and few-shot…

Machine Learning · Computer Science 2025-11-05 Claudio Spiess , Mandana Vaziri , Louis Mandel , Martin Hirzel

The integration of Large Language Models (LLMs) with evolutionary computation (EC) has introduced a promising paradigm for automating the design of metaheuristic algorithms. However, existing frameworks, such as the Large Language Model…

Neural and Evolutionary Computing · Computer Science 2024-12-05 Haoran Yin , Anna V. Kononova , Thomas Bäck , Niki van Stein

Recent research has shown that large language models pretrained using unsupervised approaches can achieve significant performance improvement on many downstream tasks. Typically when adapting these language models to downstream tasks, like…

Computation and Language · Computer Science 2022-06-08 Xiaodi Sun , Sunny Rajagopalan , Priyanka Nigam , Weiyi Lu , Yi Xu , Belinda Zeng , Trishul Chilimbi

Recent reasoning-focused language models such as DeepSeek R1 and OpenAI o1 have demonstrated strong performance on structured reasoning benchmarks including GSM8K, MATH, and multi-hop question answering tasks. However, their performance…

Computation and Language · Computer Science 2026-03-31 Rahul Soni

Prompt engineering is essential for optimizing large language models (LLMs), yet the link between prompt structures and task performance remains underexplored. This work introduces an evolutionary approach that combines context-free grammar…

Computation and Language · Computer Science 2025-04-22 Gabriel Machado Santos , Rita Maria da Silva Julia , Marcelo Zanchetta do Nascimento

Large Language Models are transforming software engineering, yet prompt management in practice remains ad hoc, hindering reliability, reuse, and integration into industrial workflows. We present Prompt-with-Me, a practical solution for…

Software Engineering · Computer Science 2025-09-23 Ziyou Li , Agnia Sergeyuk , Maliheh Izadi

Due to rapid advancements in the development of Large Language Models (LLMs), programming these models with prompts has recently gained significant attention. However, the sheer number of available prompt engineering techniques creates an…

Computation and Language · Computer Science 2024-02-26 Oluwole Fagbohun , Rachel M. Harrison , Anton Dereventsov

Prompt compression methods enhance the efficiency of Large Language Models (LLMs) and minimize the cost by reducing the length of input context. The goal of prompt compression is to shorten the LLM prompt while maintaining a high generation…

Computation and Language · Computer Science 2025-08-25 Tinghui Zhang , Yifan Wang , Daisy Zhe Wang

In this paper, we propose a simple yet efficient approach based on prompt engineering that leverages the large language model itself to optimize its answers without relying on auxiliary models. We introduce an iterative self-evaluating…

Computation and Language · Computer Science 2023-05-09 Tianqiang Yan , Tiansheng Xu