English

Improving Minimum Bayes Risk Decoding with Multi-Prompt

Computation and Language 2024-10-07 v2

Abstract

While instruction fine-tuned LLMs are effective text generators, sensitivity to prompt construction makes performance unstable and sub-optimal in practice. Relying on a single "best" prompt cannot capture all differing approaches to a generation problem. Using this observation, we propose multi-prompt decoding, where many candidate generations are decoded from a prompt bank at inference-time. To ensemble candidates, we use Minimum Bayes Risk (MBR) decoding, which selects a final output using a trained value metric. We show multi-prompt improves MBR across a comprehensive set of conditional generation tasks, and show this is a result of estimating a more diverse and higher quality candidate space than that of a single prompt. Further experiments confirm multi-prompt improves generation across tasks, models and metrics.

Keywords

Cite

@article{arxiv.2407.15343,
  title  = {Improving Minimum Bayes Risk Decoding with Multi-Prompt},
  author = {David Heineman and Yao Dou and Wei Xu},
  journal= {arXiv preprint arXiv:2407.15343},
  year   = {2024}
}

Comments

Accepted to EMNLP 2024

R2 v1 2026-06-28T17:49:03.763Z