中文
相关论文

相关论文: From Competition to Synergy: Unlocking Reinforceme…

200 篇论文

Building speech deepfake detection models that are generalizable to unseen attacks remains a challenging problem. Although the field has shifted toward a pre-training and fine-tuning paradigm using speech foundation models, most approaches…

音频与语音处理 · 电气工程与系统科学 2026-03-04 Xin Wang , Ge Wanying , Junichi Yamagishi

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for improving the reasoning abilities of large language models (LLMs). The Group Relative Policy Optimization (GRPO) family has demonstrated strong…

计算与语言 · 计算机科学 2025-11-10 Chenxi Liu , Junjie Liang , Yuqi Jia , Bochuan Cao , Yang Bai , Heng Huang , Xun Chen

Reinforcement learning has emerged as a paradigm for post-training large language models, boosting their reasoning capabilities. Such approaches compute an advantage value for each sample, reflecting better or worse performance than…

Reinforcement learning with verifiable rewards (RLVR) has become a standard paradigm for post-training large language models. While Group Relative Policy Optimization (GRPO) is widely adopted, its coarse credit assignment uniformly…

机器学习 · 计算机科学 2026-04-03 Gengsheng Li , Tianyu Yang , Junfeng Fang , Mingyang Song , Mao Zheng , Haiyun Guo , Dan Zhang , Jinqiao Wang , Tat-Seng Chua

Streaming autoregressive (AR) video generators combined with few-step distillation achieve low-latency, high-quality synthesis, yet remain difficult to align via reinforcement learning from human feedback (RLHF). Existing SDE-based GRPO…

计算机视觉与模式识别 · 计算机科学 2026-03-19 Dailan He , Guanlin Feng , Xingtong Ge , Yi Zhang , Bingqi Ma , Guanglu Song , Yu Liu , Hongsheng Li

Reinforcement learning (RL) has demonstrated remarkable success in text and image generation, yet its potential in 3D generation remains largely unexplored. Existing attempts typically rely on offline direct preference optimization (DPO)…

计算机视觉与模式识别 · 计算机科学 2026-03-03 Zhen Zhou , Jian Liu , Biwen Lei , Jing Xu , Haohan Weng , Yiling Zhu , Zhuo Chen , Junfeng Fan , Yunkai Ma , Dazhao Du , Song Guo , Fengshui Jing , Chunchao Guo

Reinforcement learning (RL) has emerged as a powerful paradigm for fine-tuning large-scale generative models, such as diffusion and flow models, to align with complex human preferences and user-specified tasks. A fundamental limitation…

机器学习 · 计算机科学 2026-01-21 Jinmei Liu , Haoru Li , Zhenhong Sun , Chaofeng Chen , Yatao Bian , Bo Wang , Daoyi Dong , Chunlin Chen , Zhi Wang

Attention-based sequential recommendation methods have shown promise in accurately capturing users' evolving interests from their past interactions. Recent research has also explored the integration of reinforcement learning (RL) into these…

机器学习 · 计算机科学 2024-04-19 Melissa Mozifian , Tristan Sylvain , Dave Evans , Lili Meng

Reinforcement learning (RL) has recently emerged as a promising approach for aligning text-to-image generative models with human preferences. A key challenge, however, lies in designing effective and interpretable rewards. Existing methods…

计算机视觉与模式识别 · 计算机科学 2025-11-26 Xuelu Feng , Yunsheng Li , Ziyu Wan , Zixuan Gao , Junsong Yuan , Dongdong Chen , Chunming Qiao

Generative models have made significant progress in synthesizing visual content, including images, videos, and 3D/4D structures. However, they are typically trained with surrogate objectives such as likelihood or reconstruction loss, which…

计算机视觉与模式识别 · 计算机科学 2026-01-21 Yuanzhi Liang , Yijie Fang , Ke Hao , Rui Li , Ziqi Ni , Ruijie Su , Chi Zhang

Generalized Zero-Shot Learning (GZSL) has emerged as a pivotal research domain in computer vision, owing to its capability to recognize objects that have not been seen during training. Despite the significant progress achieved by generative…

计算机视觉与模式识别 · 计算机科学 2023-04-07 Shreyank N Gowda

Process Reinforcement Learning~(PRL) has demonstrated considerable potential in enhancing the reasoning capabilities of Large Language Models~(LLMs). However, introducing additional process reward models incurs substantial computational…

机器学习 · 计算机科学 2025-07-04 Wu Fei , Hao Kong , Shuxian Liang , Yang Lin , Yibo Yang , Jing Tang , Lei Chen , Xiansheng Hua

Contrastive reinforcement learning (CRL) learns goal-conditioned Q-values through a contrastive objective over state-action and goal representations, removing the need for hand-crafted reward functions. Despite impressive success in…

Aligning generative real-world image super-resolution models with human visual preference is challenging due to the perception--fidelity trade-off and diverse, unknown degradations. Prior approaches rely on offline preference optimization…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Shijie Zhao , Xuanyu Zhang , Bin Chen , Weiqi Li , Qunliang Xing , Kexin Zhang , Yan Wang , Junlin Li , Li Zhang , Jian Zhang , Tianfan Xue

Reinforcement learning has emerged as a powerful paradigm for unlocking reasoning capabilities in language models. However, relying on sparse rewards makes this process highly sample-inefficient, as models must navigate vast search spaces…

机器学习 · 计算机科学 2026-05-11 Ilia Mahrooghi , Aryo Lotfi , Emmanuel Abbe

Large Language Models (LLMs) have shown promise in solving complex mathematical problems, yet they still fall short of producing accurate and consistent solutions. Reinforcement Learning (RL) is a framework for aligning these models with…

人工智能 · 计算机科学 2026-02-10 Ali Hatamizadeh , Shrimai Prabhumoye , Igor Gitman , Ximing Lu , Seungju Han , Wei Ping , Yejin Choi , Jan Kautz

Reinforcement learning with verifiable rewards (RLVR) has become an effective paradigm for improving reasoning language models on tasks such as mathematics, coding, and scientific question answering. However, widely used group-relative…

计算与语言 · 计算机科学 2026-05-29 Redacted by arXiv

Many continuous control problems can be formulated as sparse-reward reinforcement learning (RL) tasks. In principle, online RL methods can automatically explore the state space to solve each new task. However, discovering sequences of…

Group Relative Policy Optimization (GRPO) is a promising policy-based approach for Large Language Model alignment, yet its performance is often limited by training instability and suboptimal convergence. In this paper, we identify and…

机器学习 · 计算机科学 2025-12-12 Marco Simoni , Aleksandar Fontana , Giulio Rossolini , Andrea Saracino , Paolo Mori

Generating grounded and trustworthy responses remains a key challenge for large language models (LLMs). While retrieval-augmented generation (RAG) with citation-based grounding holds promise, instruction-tuned models frequently fail even in…

计算与语言 · 计算机科学 2025-06-19 Shang Hong Sim , Tej Deep Pala , Vernon Toh , Hai Leong Chieu , Amir Zadeh , Chuan Li , Navonil Majumder , Soujanya Poria