English

RLHF: A comprehensive Survey for Cultural, Multimodal and Low Latency Alignment Methods

Machine Learning 2025-11-07 v1 Artificial Intelligence Computation and Language

Abstract

Reinforcement Learning from Human Feedback (RLHF) is the standard for aligning Large Language Models (LLMs), yet recent progress has moved beyond canonical text-based methods. This survey synthesizes the new frontier of alignment research by addressing critical gaps in multi-modal alignment, cultural fairness, and low-latency optimization. To systematically explore these domains, we first review foundational algo- rithms, including PPO, DPO, and GRPO, before presenting a detailed analysis of the latest innovations. By providing a comparative synthesis of these techniques and outlining open challenges, this work serves as an essential roadmap for researchers building more robust, efficient, and equitable AI systems.

Keywords

Cite

@article{arxiv.2511.03939,
  title  = {RLHF: A comprehensive Survey for Cultural, Multimodal and Low Latency Alignment Methods},
  author = {Raghav Sharma and Manan Mehta and Sai Tiger Raina},
  journal= {arXiv preprint arXiv:2511.03939},
  year   = {2025}
}
R2 v1 2026-07-01T07:23:45.934Z