English
Related papers

Related papers: From Competition to Synergy: Unlocking Reinforceme…

200 papers

Building speech deepfake detection models that are generalizable to unseen attacks remains a challenging problem. Although the field has shifted toward a pre-training and fine-tuning paradigm using speech foundation models, most approaches…

Audio and Speech Processing · Electrical Eng. & Systems 2026-03-04 Xin Wang , Ge Wanying , Junichi Yamagishi

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

Computation and Language · Computer Science 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Reinforcement learning has emerged as a paradigm for post-training large language models, boosting their reasoning capabilities. Such approaches compute an advantage value for each sample, reflecting better or worse performance than…

Computation and Language · Computer Science 2025-12-16 Changpeng Yang , Jinyang Wu , Yuchen Liu , Shuai Zhang , Yang Li , Qiliang Liang , Hongzhen Wang , Shuai Nie , Jiaming Xu , Runyu Shi , Ying Huang , Guoquan Zhang

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models. While Group Relative Policy Optimization (GRPO) is widely adopted, its coarse credit assignment uniformly…

Machine Learning · Computer Science 2026-04-03 Gengsheng Li , Tianyu Yang , Junfeng Fang , Mingyang Song , Mao Zheng , Haiyun Guo , Dan Zhang , Jinqiao Wang , Tat-Seng Chua

Streaming autoregressive (AR) video generators combined with few-step distillation achieve low-latency, high-quality synthesis, yet remain difficult to align via reinforcement learning from human feedback (RLHF). Existing SDE-based GRPO…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Dailan He , Guanlin Feng , Xingtong Ge , Yi Zhang , Bingqi Ma , Guanglu Song , Yu Liu , Hongsheng Li

Reinforcement learning (RL) has demonstrated remarkable success in text and image generation, yet its potential in 3D generation remains largely unexplored. Existing attempts typically rely on offline direct preference optimization (DPO)…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhen Zhou , Jian Liu , Biwen Lei , Jing Xu , Haohan Weng , Yiling Zhu , Zhuo Chen , Junfeng Fan , Yunkai Ma , Dazhao Du , Song Guo , Fengshui Jing , Chunchao Guo

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning large-scale generative models, such as diffusion and flow models, to align with complex human preferences and user-specified tasks. A fundamental limitation…

Machine Learning · Computer Science 2026-01-21 Jinmei Liu , Haoru Li , Zhenhong Sun , Chaofeng Chen , Yatao Bian , Bo Wang , Daoyi Dong , Chunlin Chen , Zhi Wang

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

Machine Learning · Computer Science 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Reinforcement learning (RL) has recently emerged as a promising approach for aligning text-to-image generative models with human preferences. A key challenge, however, lies in designing effective and interpretable rewards. Existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xuelu Feng , Yunsheng Li , Ziyu Wan , Zixuan Gao , Junsong Yuan , Dongdong Chen , Chunming Qiao

Generative models have made significant progress in synthesizing visual content, including images, videos, and 3D/4D structures. However, they are typically trained with surrogate objectives such as likelihood or reconstruction loss, which…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Yuanzhi Liang , Yijie Fang , Ke Hao , Rui Li , Ziqi Ni , Ruijie Su , Chi Zhang

Generalized Zero-Shot Learning (GZSL) has emerged as a pivotal research domain in computer vision, owing to its capability to recognize objects that have not been seen during training. Despite the significant progress achieved by generative…

Computer Vision and Pattern Recognition · Computer Science 2023-04-07 Shreyank N Gowda

Process Reinforcement Learning~(PRL) has demonstrated considerable potential in enhancing the reasoning capabilities of Large Language Models~(LLMs). However, introducing additional process reward models incurs substantial computational…

Machine Learning · Computer Science 2025-07-04 Wu Fei , Hao Kong , Shuxian Liang , Yang Lin , Yibo Yang , Jing Tang , Lei Chen , Xiansheng Hua

Contrastive reinforcement learning (CRL) learns goal-conditioned Q-values through a contrastive objective over state-action and goal representations, removing the need for hand-crafted reward functions. Despite impressive success in…

Aligning generative real-world image super-resolution models with human visual preference is challenging due to the perception--fidelity trade-off and diverse, unknown degradations. Prior approaches rely on offline preference optimization…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Shijie Zhao , Xuanyu Zhang , Bin Chen , Weiqi Li , Qunliang Xing , Kexin Zhang , Yan Wang , Junlin Li , Li Zhang , Jian Zhang , Tianfan Xue

Reinforcement learning has emerged as a powerful paradigm for unlocking reasoning capabilities in language models. However, relying on sparse rewards makes this process highly sample-inefficient, as models must navigate vast search spaces…

Machine Learning · Computer Science 2026-05-11 Ilia Mahrooghi , Aryo Lotfi , Emmanuel Abbe

Large Language Models (LLMs) have shown promise in solving complex mathematical problems, yet they still fall short of producing accurate and consistent solutions. Reinforcement Learning (RL) is a framework for aligning these models with…

Artificial Intelligence · Computer Science 2026-02-10 Ali Hatamizadeh , Shrimai Prabhumoye , Igor Gitman , Ximing Lu , Seungju Han , Wei Ping , Yejin Choi , Jan Kautz

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

Computation and Language · Computer Science 2026-05-29 Redacted by arXiv

Many continuous control problems can be formulated as sparse-reward reinforcement learning (RL) tasks. In principle, online RL methods can automatically explore the state space to solve each new task. However, discovering sequences of…

Group Relative Policy Optimization (GRPO) is a promising policy-based approach for Large Language Model alignment, yet its performance is often limited by training instability and suboptimal convergence. In this paper, we identify and…

Machine Learning · Computer Science 2025-12-12 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino , Paolo Mori

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

Computation and Language · Computer Science 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria