English

Incentive-Aligned Multi-Source LLM Summaries

Computation and Language 2026-02-26 v2 Artificial Intelligence Computer Science and Game Theory

Abstract

Large language models (LLMs) are increasingly used in modern search and answer systems to synthesize multiple, sometimes conflicting, texts into a single response, yet current pipelines offer weak incentives for sources to be accurate and are vulnerable to adversarial content. We introduce Truthful Text Summarization (TTS), an incentive-aligned framework that improves factual robustness without ground-truth labels. TTS (i) decomposes a draft synthesis into atomic claims, (ii) elicits each source's stance on every claim, (iii) scores sources with an adapted multi-task peer-prediction mechanism that rewards informative agreement, and (iv) filters unreliable sources before re-summarizing. We establish formal guarantees that align a source's incentives with informative honesty, making truthful reporting the utility-maximizing strategy. Experiments show that TTS improves factual accuracy and robustness while preserving fluency, aligning exposure with informative corroboration and disincentivizing manipulation.

Keywords

Cite

@article{arxiv.2509.25184,
  title  = {Incentive-Aligned Multi-Source LLM Summaries},
  author = {Yanchen Jiang and Zhe Feng and Aranyak Mehta},
  journal= {arXiv preprint arXiv:2509.25184},
  year   = {2026}
}

Comments

Accepted at ICLR 2026

R2 v1 2026-07-01T06:05:28.227Z