English
Related papers

Related papers: EvoRubric: Self-Evolving Rubric-Driven RL for Open…

200 papers

In response to the limitations of reinforcement learning and evolutionary algorithms (EAs) in complex problem-solving, Evolutionary Reinforcement Learning (EvoRL) has emerged as a synergistic solution. EvoRL integrates EAs and reinforcement…

Neural and Evolutionary Computing · Computer Science 2024-02-22 Yuanguo Lin , Fan Lin , Guorong Cai , Hong Chen , Lixin Zou , Pengcheng Wu

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

Machine Learning · Computer Science 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Open-ended evaluation is essential for deploying large language models in real-world settings. In studying HealthBench, we observe that using the model itself as a grader and generating rubric-based reward signals substantially improves…

Computation and Language · Computer Science 2025-10-01 Zhiling Ye , Yun Yue , Haowen Wang , Xudong Han , Jiadi Jiang , Cheng Wei , Lei Fan , Jiaxin Liang , Shuowen Zhang , Ji Li , Chunxiao Guo , Jian Wang , Peng Wei , Jinjie Gu

Statefulness is essential for large language model (LLM) agents to perform long-term planning and problem-solving. This makes memory a critical component, yet its management and evolution remain largely underexplored. Existing evaluations…

Reinforcement learning with verifiable rewards (RLVR) has demonstrated significant success in enhancing mathematical reasoning and coding performance of large language models (LLMs), especially when structured reference answers are…

Computation and Language · Computer Science 2025-04-02 Yi Su , Dian Yu , Linfeng Song , Juntao Li , Haitao Mi , Zhaopeng Tu , Min Zhang , Dong Yu

Recent studies increasingly explore Large Language Models (LLMs) as a new paradigm for recommendation systems due to their scalability and world knowledge. However, existing work has three key limitations: (1) most efforts focus on…

The open-ended generation in LLMs usually requires multi-dimensional rubrics to adequately assess quality and guide the improvement of reinforcement learning. However, a critical dilemma inherent in this training paradigm is the imbalanced…

Machine Learning · Computer Science 2026-05-27 Yu Huang , Zihua Zhao , Zhaoxin Huan , Wanli Gu , Feng Hong , Xinmu Ge , Lin Yuan , Weichang Wu , Qiang Hu , Xiaolu Zhang , Jun Zhou , Jiangchao Yao

Large Language Models (LLMs) have demonstrated great potential in automating the generation of Verilog hardware description language code for hardware design. This automation is critical to reducing human effort in the complex and…

Hardware Architecture · Computer Science 2025-08-20 Ping Guo , Yiting Wang , Wanghao Ye , Yexiao He , Ziyao Wang , Xiaopeng Dai , Ang Li , Qingfu Zhang

Generative reward models (GRMs) for vision-language models (VLMs) often evaluate outputs via a three-stage pipeline: rubric generation, criterion-based scoring, and a final verdict. However, the intermediate rubric is rarely optimized…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Weijie Qiu , Dai Guan , Junxin Wang , Zhihang Li , Yongbo Gai , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

A fundamental challenge in creative writing lies in reconciling the inherent tension between maintaining global coherence in long-form narratives and preserving local expressiveness in short-form texts. While long-context generation…

Artificial Intelligence · Computer Science 2026-04-08 Xiaolong Wei , Zerun Zhu , Simin Niu , Xingyu Zhang , Peiying Yu , Changxuan Xiao , Yuchen Li , Jicheng Yang , Zhejun Zhao , Chong Meng , Long Xia , Daiting Shi

Reinforcement Learning with Verifiable Rewards(RLVR) has demonstrated great potential in enhancing the reasoning capabilities of large language models (LLMs). However, its success has thus far been largely confined to the mathematical and…

Artificial Intelligence · Computer Science 2026-02-05 Mengyu Zhang , Siyu Ding , Weichong Yin , Yu Sun , Hua Wu

Large Language Models (LLMs) have demonstrated remarkable capabilities across diverse domains, including programming, planning, and decision-making. However, their performance often degrades when faced with highly complex problem instances…

Artificial Intelligence · Computer Science 2025-08-21 Yang Cheng , Zilai Wang , Weiyu Ma , Wenhui Zhu , Yue Deng , Jian Zhao

Designing aligned and robust rewards for open-ended generation remains a key barrier to RL post-training. Rubrics provide structured, interpretable supervision, but scaling rubric construction is difficult: expert rubrics are costly,…

Conventional reward modeling relies on gradient descent over neural weights, creating opaque, data-hungry "black boxes." We propose a paradigm shift from implicit to explicit reward parameterization, recasting optimization from continuous…

Machine Learning · Computer Science 2026-02-06 Lipeng Xie , Sen Huang , Zhuo Zhang , Anni Zou , Yunpeng Zhai , Dingchao Ren , Kezun Zhang , Haoyuan Hu , Boyin Liu , Haoran Chen , Zhaoyang Liu , Bolin Ding

We propose Reinforcement Learning with Explicit Human Values (RLEV), a method that aligns Large Language Model (LLM) optimization directly with quantifiable human value signals. While Reinforcement Learning with Verifiable Rewards (RLVR)…

Machine Learning · Computer Science 2025-10-24 Dian Yu , Yulai Zhao , Kishan Panaganti , Linfeng Song , Haitao Mi , Dong Yu

Despite chain-of-thought (CoT) playing crucial roles in LLM reasoning, directly rewarding it is difficult: training a reward model demands heavy human labeling efforts, and static RMs struggle with evolving CoT distributions and reward…

Artificial Intelligence · Computer Science 2026-02-12 Leheng Sheng , Wenchang Ma , Ruixin Hong , Xiang Wang , An Zhang , Tat-Seng Chua

Evolutionary Reinforcement Learning (EvoRL) has emerged as a promising approach to overcoming the limitations of traditional reinforcement learning (RL) by integrating the Evolutionary Computation (EC) paradigm with RL. However, the…

Neural and Evolutionary Computing · Computer Science 2025-07-22 Bowen Zheng , Ran Cheng , Kay Chen Tan

Reinforcement Learning with verifiable rewards (RLVR) has emerged as a primary learning paradigm for enhancing the reasoning capabilities of multi-modal large language models (MLLMs). However, during RL training, the enormous state space of…

Machine Learning · Computer Science 2026-03-13 Zhuoxu Huang , Mengxi Jia , Hao Sun , Xuelong Li , Jungong Han

Large language models (LLMs) are increasingly trained with reinforcement learning from verifiable rewards (RLVR), yet real-world deployment demands models that can self-improve without labels or external judges. Existing self-improvement…

Machine Learning · Computer Science 2026-02-19 Yujun Zhou , Zhenwen Liang , Haolin Liu , Wenhao Yu , Kishan Panaganti , Linfeng Song , Dian Yu , Xiangliang Zhang , Haitao Mi , Dong Yu

We propose a new Verbal Reinforcement Learning (VRL) framework for interpretable task-level planning in mobile robotic systems operating under execution uncertainty. The framework follows a closed-loop architecture that enables iterative…