English

Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoning

Computation and Language 2026-05-27 v1 Artificial Intelligence

Abstract

Repeated sampling with a verifier is the standard way to allocate test-time compute for code generation, with pass@KK as the canonical metric. Yet the standard policy class draws KK independent samples from a single answer distribution, so attempts often collapse onto near-duplicate reasoning paths and waste the budget on redundant rollouts. This failure is costly in competitive programming, where many problems admit multiple distinct algorithmic strategies and pass@KK requires only one correct attempt. We propose Coordinated Pass@KK Policy Optimization (CPPO), which turns pass@KK generation into joint exploration over strategies: a planner emits a tuple of K=4K{=}4 alternative high-level methods, and a shared solver attempts one solution per method. CPPO trains this joint policy with a multiplicative planner reward, Rplan=JψRoutR_{\mathrm{plan}} = J_\psi \cdot R_{\mathrm{out}}, assigning credit only to valid strategy tuples that lead to verifier-confirmed pass@KK success. Across APPS, CodeContests, and LiveCodeBench-v6, CPPO improves pass@44 over direct sampling, planning baselines, planner-only SFT, and pass@KK-oriented RL under the same K=4K{=}4 solver-attempt budget, with statistically significant gains on six of nine model--benchmark cells. The largest single gain is +0.16+0.16 on Qwen3.5-9B LiveCodeBench-v6 over the strongest baseline, PKPO (0.5880.7480.588 \rightarrow 0.748; paired bootstrap, p<0.05p < 0.05).

Keywords

Cite

@article{arxiv.2605.27000,
  title  = {Cast a Wider Net: Coordinated Pass@K Policy Optimization for Code Reasoning},
  author = {Yilong Li and Suman Banerjee and Tong Che},
  journal= {arXiv preprint arXiv:2605.27000},
  year   = {2026}
}

Comments

Code reasoning; pass@K optimization; coordinated planning; verifiable rewards; strategy diversity