English

Ranking-aware Reinforcement Learning for Ordinal Ranking

Machine Learning 2026-01-29 v1 Artificial Intelligence

Abstract

Ordinal regression and ranking are challenging due to inherent ordinal dependencies that conventional methods struggle to model. We propose Ranking-Aware Reinforcement Learning (RARL), a novel RL framework that explicitly learns these relationships. At its core, RARL features a unified objective that synergistically integrates regression and Learning-to-Rank (L2R), enabling mutual improvement between the two tasks. This is driven by a ranking-aware verifiable reward that jointly assesses regression precision and ranking accuracy, facilitating direct model updates via policy optimization. To further enhance training, we introduce Response Mutation Operations (RMO), which inject controlled noise to improve exploration and prevent stagnation at saddle points. The effectiveness of RARL is validated through extensive experiments on three distinct benchmarks.

Keywords

Cite

@article{arxiv.2601.20585,
  title  = {Ranking-aware Reinforcement Learning for Ordinal Ranking},
  author = {Aiming Hao and Chen Zhu and Jiashu Zhu and Jiahong Wu and Xiangxiang Chu},
  journal= {arXiv preprint arXiv:2601.20585},
  year   = {2026}
}

Comments

Accepted to ICASSP2026

R2 v1 2026-07-01T09:23:55.112Z