English
Related papers

Related papers: Inference-Aware Prompt Optimization for Aligning B…

200 papers

This study examines the effect of prompt engineering on the performance of Large Language Models (LLMs) in clinical note generation. We introduce an Automatic Prompt Optimization (APO) framework to refine initial prompts and compare the…

Computation and Language · Computer Science 2024-07-08 Zonghai Yao , Ahmed Jaafar , Beining Wang , Zhichao Yang , Hong Yu

Gradient-free prompt optimization methods have made significant strides in enhancing the performance of closed-source Large Language Models (LLMs) across a wide range of tasks. However, existing approaches make light of the importance of…

Computation and Language · Computer Science 2024-10-03 Muchen Yang , Moxin Li , Yongle Li , Zijun Chen , Chongming Gao , Junqi Zhang , Yangyang Li , Fuli Feng

Ensemble learning of LLMs has emerged as a promising alternative to enhance performance, but existing approaches typically treat models as black boxes, combining the inputs or final outputs while overlooking the rich internal…

Recent advances in test-time alignment methods, such as Best-of-N sampling, offer a simple and effective way to steer language models (LMs) toward preferred behaviors using reward models (RM). However, these approaches can be…

Computation and Language · Computer Science 2026-03-16 Vinod Raman , Hilal Asi , Satyen Kale

Large Language Models (LLMs) rely on Human Preference Alignment (HPA) to ensure the generation of safe content. Due to the heavy cost associated with fine-tuning, fine-tuning-free methods have emerged, typically modifying LLM decoding with…

Computation and Language · Computer Science 2024-02-15 Feifan Song , Yuxuan Fan , Xin Zhang , Peiyi Wang , Houfeng Wang

Large language models (LLMs) are highly sensitive to prompts, but most automatic prompt optimization (APO) methods assume access to ground-truth references (e.g., labeled validation data) that are costly to obtain. We propose the Prompt…

Computation and Language · Computer Science 2026-04-10 Yuanchen Wu , Saurabh Verma , Justin Lee , Fangzhou Xiong , Poppy Zhang , Amel Awadelkarim , Xu Chen , Yubai Yuan , Shawndra Hill

Large language models (LLMs) have recently advanced in reasoning when optimized with reinforcement learning (RL) under verifiable rewards. Existing methods primarily rely on outcome-based supervision to strengthen internal LLM reasoning,…

Artificial Intelligence · Computer Science 2026-05-29 Siyao Song , Cong Ma , Zhihao Cheng , Shiye Lei , Minghao Li , Ying Zeng , Huaixiao Tou , Kai Jia

LLM-based automatic speech recognition (ASR), a well-established approach, connects speech foundation models to large language models (LLMs) through a speech-to-LLM projector, yielding promising results. A common design choice in these…

Large Language Models (LLMs) perform best with well-crafted prompts, yet prompt engineering remains manual, inconsistent, and inaccessible to non-experts. We introduce Promptomatix, an automatic prompt optimization framework that transforms…

Computation and Language · Computer Science 2025-07-28 Rithesh Murthy , Ming Zhu , Liangwei Yang , Jielin Qiu , Juntao Tan , Shelby Heinecke , Caiming Xiong , Silvio Savarese , Huan Wang

Large language models (LLMs) have achieved huge success in numerous natural language process (NLP) tasks. However, it faces the challenge of significant resource consumption during inference. In this paper, we aim to improve the inference…

Computation and Language · Computer Science 2024-02-05 Hanlin Zhu , Banghua Zhu , Jiantao Jiao

Large reasoning models often reach correct answers through flawed intermediate steps, creating a gap between final accuracy and reasoning reliability. Existing alignment strategies address this with external verifiers or massive sampling,…

Artificial Intelligence · Computer Science 2026-05-11 Kejia Chen , Jiawen Zhang , Yihong Wu , Kewei Gao , Jian Lou , Zunlei Feng , Mingli Song , Ruoxi Jia

Inference-time scaling can enhance the reasoning capabilities of large language models (LLMs) on complex problems that benefit from step-by-step problem solving. Although lengthening generated scratchpads has proven effective for…

Large Language Models (LLMs) have shown impressive capabilities in many scenarios, but their performance depends, in part, on the choice of prompt. Past research has focused on optimizing prompts specific to a task. However, much less…

Computation and Language · Computer Science 2026-04-07 Lechen Zhang , Tolga Ergen , Lajanugen Logeswaran , Moontae Lee , David Jurgens

Deploying large language model (LLM)-driven conversational agents in enterprise settings requires prompts that are simultaneously correct at launch and resilient to the non-deterministic behavioral drift that characterizes production LLM…

Artificial Intelligence · Computer Science 2026-05-18 Keshava Chaitanya , Jahnavi Gundakaram

Parameter-Efficient Fine-Tuning (PEFT) is widely used for adapting Large Language Models (LLMs) for various tasks. Recently, there has been an increasing demand for fine-tuning a single LLM for multiple tasks because it requires overall…

Computation and Language · Computer Science 2026-05-15 Anjir Ahmed Chowdhury , Syed Zawad , Xiaolong Ma , Xu Dong , Feng Yan

Large language models (LLMs) have shown success in generating high-quality responses. In order to achieve better alignment with LLMs with human preference, various works are proposed based on specific optimization process, which, however,…

Computation and Language · Computer Science 2024-09-04 Zhuo Li , Yuhao Du , Jinpeng Hu , Xiang Wan , Anningzhe Gao

The large language models have achieved superior performance on various natural language tasks. One major drawback of such approaches is they are resource-intensive in fine-tuning new datasets. Soft-prompt tuning presents a…

Computation and Language · Computer Science 2023-10-30 Guoxin Chen , Yiming Qian , Bowen Wang , Liangzhi Li

Reasoning capabilities in large language models (LLMs) have generally advanced significantly. However, it is still challenging for existing reasoning-based LLMs to perform effective decision-making abilities in multi-agent environments, due…

Computation and Language · Computer Science 2026-04-17 Jiashuo Wang , Jiawen Duan , Jian Wang , Kaitao Song , Chunpu Xu , Johnny K. W. Ho , Fenggang Yu , Wenjie Li , Johan F. Hoorn

Large language models (LLMs) are increasingly recognized for their exceptional generative capabilities and versatility across various tasks. However, the high inference costs associated with these models have not received adequate…

Computation and Language · Computer Science 2025-03-18 Soham Poddar , Paramita Koley , Janardan Misra , Sanjay Podder , Niloy Ganguly , Saptarshi Ghosh

Prompt optimization improves the reasoning abilities of large language models (LLMs) without requiring parameter updates to the target model. Following heuristic-based "Think step by step" approaches, the field has evolved in two main…

Computation and Language · Computer Science 2025-07-25 Andreea Nica , Ivan Zakazov , Nicolas Mario Baldwin , Saibo Geng , Robert West