English

Arg-LLaDA: Argument Summarization via Large Language Diffusion Models and Sufficiency-Aware Refinement

Computation and Language 2025-11-21 v4

Abstract

Argument summarization aims to generate concise, structured representations of complex, multi-perspective debates. While recent work has advanced the identification and clustering of argumentative components, the generation stage remains underexplored. Existing approaches typically rely on single-pass generation, offering limited support for factual correction or structural refinement. To address this gap, we introduce Arg-LLaDA, a novel large language diffusion framework that iteratively improves summaries via sufficiency-guided remasking and regeneration. Our method combines a flexible masking controller with a sufficiency-checking module to identify and revise unsupported, redundant, or incomplete spans, yielding more faithful, concise, and coherent outputs. Empirical results on two benchmark datasets demonstrate that Arg-LLaDA surpasses state-of-the-art baselines in 7 out of 10 automatic evaluation metrics. In addition, human evaluations reveal substantial improvements across core dimensions, coverage, faithfulness, and conciseness, validating the effectiveness of our iterative, sufficiency-aware generation strategy.

Keywords

Cite

@article{arxiv.2507.19081,
  title  = {Arg-LLaDA: Argument Summarization via Large Language Diffusion Models and Sufficiency-Aware Refinement},
  author = {Hao Li and Yizheng Sun and Viktor Schlegel and Kailai Yang and Riza Batista-Navarro and Goran Nenadic},
  journal= {arXiv preprint arXiv:2507.19081},
  year   = {2025}
}

Comments

Preprint

R2 v1 2026-07-01T04:18:31.102Z