中文
相关论文

相关论文: DACA-GRPO: Denoising-Aware Credit Assignment for R…

200 篇论文

Enhancing the reasoning capabilities of large language models effectively using reinforcement learning (RL) remains a crucial challenge. Existing approaches primarily adopt two contrasting advantage estimation granularities: token-level…

机器学习 · 计算机科学 2025-10-22 Yiran Guo , Lijie Xu , Jie Liu , Dan Ye , Shuang Qiu

Few-step diffusion models enable efficient high-resolution image synthesis but struggle to align with specific downstream objectives due to limitations of existing reinforcement learning (RL) methods in low-step regimes with limited state…

机器学习 · 计算机科学 2026-03-02 Ziyi Zhang , Li Shen , Sen Zhang , Deheng Ye , Yong Luo , Miaojing Shi , Dongjing Shan , Bo Du , Dacheng Tao

Detectors often suffer from performance drop due to domain gap between training and testing data. Recent methods explore diffusion models applied to domain generalization (DG) and adaptation (DA) tasks, but still struggle with large…

计算机视觉与模式识别 · 计算机科学 2025-07-01 Boyong He , Yuxiang Ji , Zhuoyue Tan , Liaoni Wu

Diffusion language models have emerged as a powerful alternative to autoregressive models, enabling fast inference through more flexible and parallel generation paths. This flexibility of sampling is unlocked by new engineered sampling…

Large Language Models (LLMs) are increasingly aligned with human preferences through Reinforcement Learning from Human Feedback (RLHF). Among RLHF methods, Group Relative Policy Optimization (GRPO) has gained attention for its simplicity…

计算与语言 · 计算机科学 2025-09-25 Yuhang Zhou , Jing Zhu , Shengyi Qian , Zhuokai Zhao , Xiyao Wang , Xiaoyu Liu , Ming Li , Paiheng Xu , Wei Ai , Furong Huang

Diffusion models have achieved remarkable success in text-to-image generation. However, their practical applications are hindered by the misalignment between generated images and corresponding text prompts. To tackle this issue,…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Zijing Hu , Fengda Zhang , Long Chen , Kun Kuang , Jiahui Li , Kaifeng Gao , Jun Xiao , Xin Wang , Wenwu Zhu

The black-box nature of large language models (LLMs) poses challenges in interpreting results, impacting issues such as data intellectual property protection and hallucination tracing. Training data attribution (TDA) methods are considered…

计算与语言 · 计算机科学 2024-11-20 Kangxi Wu , Liang Pang , Huawei Shen , Xueqi Cheng

Diffusion-based methods represented as stochastic differential equations on a continuous-time domain have recently proven successful as a non-adversarial generative model. Training such models relies on denoising score matching, which can…

机器学习 · 计算机科学 2024-11-05 Sarthak Mittal , Korbinian Abstreiter , Stefan Bauer , Bernhard Schölkopf , Arash Mehrjou

Predicting drug-target affinity is fundamental to virtual screening and lead optimization. However, existing deep models often suffer from representation collapse in stringent cold-start regimes, where the scarcity of labels and domain…

机器学习 · 统计学 2026-03-13 Yining Qian , Pengjie Wang , Yixiao Li , An-Yang Lu , Cheng Tan , Shuang Li , Lijun Liu

Reinforcement learning is emerging as a primary driver for improving language model reasoning capabilities. A fundamental question is whether current reinforcement learning algorithms -- such as Group Relative Policy Optimization (GRPO),…

机器学习 · 计算机科学 2025-06-23 Andre He , Daniel Fried , Sean Welleck

Aligning large language models with human preferences has emerged as a critical focus in language modeling research. Yet, integrating preference learning into Text-to-Image (T2I) generative models is still relatively uncharted territory.…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Yi Gu , Zhendong Wang , Yueqin Yin , Yujia Xie , Mingyuan Zhou

Recent advances in diffusion language models (DLMs) have presented a promising alternative to traditional autoregressive large language models (LLMs). However, DLMs still lag behind LLMs in reasoning performance, especially as the number of…

计算与语言 · 计算机科学 2025-10-27 Chenglong Wang , Yang Gan , Hang Zhou , Chi Hu , Yongyu Mu , Kai Song , Murun Yang , Bei Li , Chunliang Zhang , Tongran Liu , Jingbo Zhu , Zhengtao Yu , Tong Xiao

Reinforcement learning (RL) for large language model reasoning is frequently hindered by signal loss, a phenomenon where standard uniform sampling with small group sizes fails to uncover informative learning signals for difficult prompts.…

机器学习 · 计算机科学 2025-12-08 Wei Xiong , Chenlu Ye , Baohao Liao , Hanze Dong , Xinxing Xu , Christof Monz , Jiang Bian , Nan Jiang , Tong Zhang

Large language models (LLMs) are increasingly applied to complex reasoning tasks that require executing several complex steps before receiving any reward. Properly assigning credit to these steps is essential for enhancing model…

Locally deployed Small Language Models (SLMs) must continually support diverse tasks under strict memory and computation constraints, making selective reliance on cloud Large Language Models (LLMs) unavoidable. Regulating cloud assistance…

机器学习 · 计算机科学 2026-02-06 Evan Chen , Wenzhi Fang , Shiqiang Wang , Christopher Brinton

In recent years, reinforcement learning has faced several challenges in the multi-agent domain, such as the credit assignment issue. Value function factorization emerges as a promising way to handle the credit assignment issue under the…

机器学习 · 计算机科学 2022-06-06 Hao Chen , Guangkai Yang , Junge Zhang , Qiyue Yin , Kaiqi Huang

Aligning denoising generative models with human preferences or verifiable rewards remains a key challenge. While policy-gradient online reinforcement learning (RL) offers a principled post-training framework, its direct application is…

机器学习 · 计算机科学 2026-04-28 Bingda Tang , Yuhui Zhang , Xiaohan Wang , Jiayuan Mao , Ludwig Schmidt , Serena Yeung-Levy

Group-Relative Policy Optimization (GRPO) has emerged as the standard for training reasoning capabilities in large language models through reinforcement learning. By estimating advantages using group-mean rewards rather than a learned…

人工智能 · 计算机科学 2026-03-06 Anisha Garg , Claire Zhang , Nishit Neema , David Bick , Ganesh Venkatesh , Joel Hestness

Reinforcement learning (RL) can be used to improve the policy (denoiser) of diffusion large language models (dLLMs), while being hindered by the intractability of the policy likelihood. A dominant and efficient family of methods replaces…

机器学习 · 计算机科学 2026-05-29 Xiaohang Tang , Keyue Jiang , Che Liu , Qifang Zhao , Xiaoxiao Xu , Sangwoong Yoon , Ilija Bogunovic

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

计算与语言 · 计算机科学 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi