English
Related papers

Related papers: FairGRPO: Fair Reinforcement Learning for Equitabl…

200 papers

Group-Relative Policy Optimization (GRPO) has emerged as the standard for training reasoning capabilities in large language models through reinforcement learning. By estimating advantages using group-mean rewards rather than a learned…

Artificial Intelligence · Computer Science 2026-03-06 Anisha Garg , Claire Zhang , Nishit Neema , David Bick , Ganesh Venkatesh , Joel Hestness

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an indispensable paradigm for enhancing reasoning in Large Language Models (LLMs). However, standard policy optimization methods, such as Group Relative Policy…

Machine Learning · Computer Science 2026-02-09 Pengyi Li , Elizaveta Goncharova , Andrey Kuznetsov , Ivan Oseledets

Traditional Chinese Medicine (TCM) presents a rich and structurally unique knowledge system that challenges conventional applications of large language models (LLMs). Although previous TCM-specific LLMs have shown progress through…

Computation and Language · Computer Science 2025-10-21 Jiacheng Xie , Shuai Zeng , Yang Yu , Xiaoting Tang , Guanghui An , Dong Xu

Despite their sophisticated general-purpose capabilities, Large Language Models (LLMs) often fail to align with diverse individual preferences because standard post-training methods, like Reinforcement Learning with Human Feedback (RLHF),…

Large language models (LLMs) are increasingly adopted in clinical decision support, yet aligning them with the multifaceted reasoning pathways of real-world medicine remains a major challenge. Using more than 8,000 infertility treatment…

Machine Learning · Computer Science 2025-11-25 Dou Liu , Ying Long , Sophia Zuoqiu , Kaipeng Xie , Runze Yang , Di Liu , Kang Li , Yiting Lin , Hanyi Liu , Rong Yin , Tian Tang

Recent advances in large language models (LLMs) have shown that reasoning ability can be significantly enhanced through Reinforcement Learning with Verifiable Rewards (RLVR). Group Relative Policy Optimization (GRPO) has emerged as the de…

Computation and Language · Computer Science 2025-10-13 Jingyu Zhou , Lu Ma , Hao Liang , Chengyu Shen , Bin Cui , Wentao Zhang

RLVR has enhanced the reasoning capabilities of Large Language Models (LLMs) across various tasks. However, GRPO, a representative RLVR algorithm, suffers from a critical limitation: when all responses within a group are either entirely…

Machine Learning · Computer Science 2025-09-24 Gongrui Nan , Siye Chen , Jing Huang , Mengyu Lu , Dexun Wang , Chunmei Xie , Weiqi Xiong , Xianzhou Zeng , Qixuan Zhou , Yadong Li , Xingzhong Xu

Group Relative Policy Optimization (GRPO), a prominent algorithm within the Reinforcement Learning from Verifiable Rewards (RLVR) framework, has achieved strong results in improving the reasoning capabilities of large language models…

Machine Learning · Computer Science 2026-05-21 Xixiang He , Qiyao Sun , Ao Cheng , Xingming Li , Xuanyu Ji , Hailun Lu , Runke Huang , Qingyong Hu

Reinforcement learning with verifiable rewards (RLVR) has emerged as a promising paradigm for enhancing the reasoning capabilities of large language models (LLMs). In this context, models explore reasoning trajectories and exploit rollouts…

Machine Learning · Computer Science 2026-03-02 Yuyang Ding , Chi Zhang , Juntao Li , Haibin Lin , Min Zhang

Vision-Language Foundation Models (VLFM) have shown a tremendous increase in performance in terms of generating high-resolution, photorealistic natural images. While VLFMs show a rich understanding of semantic content across modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Parham Saremi , Amar Kumar , Mohamed Mohamed , Zahra TehraniNasab , Tal Arbel

Aligning large language models (LLMs) with human values and safety constraints is challenging, especially when objectives like helpfulness, truthfulness, and avoidance of harm conflict. Reinforcement Learning from Human Feedback (RLHF) has…

Computation and Language · Computer Science 2025-03-31 Xuying Li , Zhuo Li , Yuji Kosuga , Victor Bian

Group Relative Policy Optimization (GRPO) was introduced and used recently for promoting reasoning in LLMs under verifiable (binary) rewards. We show that the mean + variance calibration of these rewards induces a weighted contrastive loss…

Machine Learning · Computer Science 2025-10-22 Youssef Mroueh

Machine learning models deployed in critical care settings exhibit demographic biases, particularly gender disparities, that undermine clinical trust and equitable treatment. This paper introduces FairMed-XGB, a novel framework that…

Machine Learning · Computer Science 2026-03-17 Mitul Goswami , Romit Chatterjee , Arif Ahmed Sekh

Existing text-to-image generative models reflect or even amplify societal biases ingrained in their training data. This is especially concerning for human image generation where models are biased against certain demographic groups. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Robik Shrestha , Yang Zou , Qiuyu Chen , Zhiheng Li , Yusheng Xie , Siqi Deng

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

Computation and Language · Computer Science 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

Machine Learning · Computer Science 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

Large Language Models (LLMs) often exhibit implicit biases and discriminatory tendencies that reflect underlying social stereotypes. While recent alignment techniques such as RLHF and DPO have mitigated some of these issues, they remain…

Computation and Language · Computer Science 2025-11-11 Deng Yixuan , Ji Xiaoqiang

Reinforcement Learning with Verifiable Rewards (RLVR) has demonstrated remarkable success in enhancing the reasoning capabilities of Large Language Models (LLMs). However, recent studies question whether RL genuinely expands reasoning…

Machine Learning · Computer Science 2026-02-04 Dayu Wang , Jiaye Yang , Weikang Li , Jiahui Liang , Yang Li

Group-Relative Policy Optimization (GRPO) is a key technique for training large reasoning models, yet it suffers from a critical vulnerability: the \emph{Think-Answer Mismatch}, where noisy reward signals corrupt the learning process. This…

Machine Learning · Computer Science 2025-08-11 Si Shen , Peijun Shen , Wenhua Zhao , Danhao Zhu

Objective: Mitigating algorithmic disparities is a critical challenge in healthcare research, where ensuring equity and fairness is paramount. While large-scale healthcare data exist across multiple institutions, cross-institutional…

Computers and Society · Computer Science 2025-08-15 Siqi Li , Qiming Wu , Xin Li , Di Miao , Chuan Hong , Wenjun Gu , Yuqing Shang , Yohei Okada , Michael Hao Chen , Mengying Yan , Yilin Ning , Marcus Eng Hock Ong , Nan Liu