English
Related papers

Related papers: Prompt Stability Matters: Evaluating and Optimizin…

200 papers

Large language models can now generate substantial code and draft research text, but research-software projects require more than either artifact alone. The mathematical thesis, executable system, benchmark surface, and public claims must…

Software Engineering · Computer Science 2026-05-04 Halley Young , Nikolaj Björner

Prompt engineering is pivotal for harnessing the capabilities of large language models (LLMs) across diverse applications. While existing prompt optimization methods improve prompt effectiveness, they often lead to prompt drifting, where…

Computation and Language · Computer Science 2024-10-14 Yurong Wu , Yan Gao , Bin Benjamin Zhu , Zineng Zhou , Xiaodi Sun , Sheng Yang , Jian-Guang Lou , Zhiming Ding , Linjun Yang

As large language models (LLMs) are increasingly deployed in high-stakes and operational settings, evaluation strategies based solely on aggregate accuracy are often insucient to characterize system reliability. This study proposes a…

Artificial Intelligence · Computer Science 2026-05-06 Hikmat Karimov , Rahid Zahid Alekberli

There has been considerable divergence of opinion on the reasoning abilities of Large Language Models (LLMs). While the initial optimism that reasoning might emerge automatically with scale has been tempered thanks to a slew of…

Artificial Intelligence · Computer Science 2024-08-06 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

Large Language Models (LLMs) are increasingly integrated into software applications, giving rise to a broad class of prompt-enabled systems, in which prompts serve as the primary 'programming' interface for guiding system behavior. Building…

Software Engineering · Computer Science 2026-01-28 Zhenpeng Chen , Chong Wang , Weisong Sun , Xuanzhe Liu , Jie M. Zhang , Yang Liu

Financial documents like earning reports or balance sheets often involve long tables and multi-page reports. Large language models have become a new tool to help numerical reasoning and understanding these documents. However, prompt quality…

Artificial Intelligence · Computer Science 2025-11-17 Yaoning Yu , Kai-Min Chang , Ye Yu , Kai Wei , Haojing Luo , Haohan Wang

In large language models (LLM)-based recommendation systems (LLM-RSs), accurately predicting user preferences by leveraging the general knowledge of LLMs is possible without requiring extensive training data. By converting recommendation…

Information Retrieval · Computer Science 2024-12-20 Genki Kusano , Kosuke Akimoto , Kunihiro Takeoka

Existing debiasing techniques are typically training-based or require access to the model's internals and output distributions, so they are inaccessible to end-users looking to adapt LLM outputs for their particular needs. In this study, we…

Computation and Language · Computer Science 2024-05-20 Shaz Furniturewala , Surgan Jandial , Abhinav Java , Pragyan Banerjee , Simra Shahid , Sumit Bhatia , Kokil Jaidka

Despite the remarkable successes of large language models (LLMs), the underlying Transformer architecture has inherent limitations in handling complex reasoning tasks. Chain-of-thought (CoT) prompting has emerged as a practical workaround,…

Computation and Language · Computer Science 2025-06-03 Xiang Zhang , Juntai Cao , Jiaqi Wei , Chenyu You , Dujian Ding

Large language models (LLMs) transfer well to new tasks out-of-the-box simply given a natural language prompt that demonstrates how to perform the task and no additional training. Prompting is a brittle process wherein small modifications…

Computation and Language · Computer Science 2022-11-22 Simran Arora , Avanika Narayan , Mayee F. Chen , Laurel Orr , Neel Guha , Kush Bhatia , Ines Chami , Frederic Sala , Christopher Ré

The latest generation of LLMs can be prompted to achieve impressive zero-shot or few-shot performance in many NLP tasks. However, since performance is highly sensitive to the choice of prompts, considerable effort has been devoted to…

Computation and Language · Computer Science 2023-11-06 Alina Leidinger , Robert van Rooij , Ekaterina Shutova

Single-prompt accuracy is the dominant way to benchmark language models, but it can miss reliability failures that matter. We evaluate a 15-model open-weight corpus, with the main reliability analyses focused on 10 instruct models across…

Computation and Language · Computer Science 2026-05-05 Ranit Karmakar , Jayita Chatterjee

This study provides the first comprehensive assessment of consistency and reproducibility in Large Language Model (LLM) outputs in finance and accounting research. We evaluate how consistently LLMs produce outputs given identical inputs…

General Finance · Quantitative Finance 2025-09-16 Julian Junyan Wang , Victor Xiaoqi Wang

While code generation has been widely used in various software development scenarios, the quality of the generated code is not guaranteed. This has been a particular concern in the era of large language models (LLMs)- based code generation,…

Software Engineering · Computer Science 2023-10-11 Zhenlan Ji , Pingchuan Ma , Zongjie Li , Shuai Wang

Responsible prompt engineering has emerged as a critical framework for ensuring that generative artificial intelligence (AI) systems serve society's needs while minimizing potential harms. As generative AI applications become increasingly…

Computers and Society · Computer Science 2025-04-24 Christian Djeffal

Large language models (LLMs) are widely used for open-ended tasks, but underspecified prompts can lead to low-quality answers and additional interaction. This paper studies whether structured prompt design improves response quality while…

Computation and Language · Computer Science 2026-05-20 Saurav Ghosh , Gabriella Polach , Abdou Sow

Assessing risk of bias (RoB) in randomized controlled trials is essential for trustworthy evidence synthesis, but the process is resource-intensive and prone to variability across reviewers. Large language models (LLMs) offer a route to…

Artificial Intelligence · Computer Science 2025-12-02 Lingbo Li , Anuradha Mathrani , Teo Susnjak

The rise of foundation models has shifted focus from resource-intensive fine-tuning to prompt engineering, a paradigm that steers model behavior through input design rather than weight updates. While manual prompt engineering faces…

Artificial Intelligence · Computer Science 2025-02-18 Wenwu Li , Xiangfeng Wang , Wenhao Li , Bo Jin

Large Language Models (LLMs) are increasingly used in intelligent systems that perform reasoning, summarization, and code generation. Their ability to follow natural-language instructions, while powerful, also makes them vulnerable to a new…

Cryptography and Security · Computer Science 2025-11-13 Daniyal Ganiuly , Assel Smaiyl

Large Language Models (LLMs) exhibit remarkable proficiency in addressing a diverse array of tasks within the Natural Language Processing (NLP) domain, with various prompt design strategies significantly augmenting their capabilities.…

Computation and Language · Computer Science 2024-08-05 Xiangyu Zhao , Chengqian Ma