中文
相关论文

相关论文: Group Critical-token Policy Optimization for Autor…

200 篇论文

Large Language Models (LLMs) empowered with Tool-Integrated Reasoning (TIR) can iteratively plan, call external tools, and integrate returned information to solve complex, long-horizon reasoning tasks. Agentic Reinforcement Learning…

计算与语言 · 计算机科学 2026-01-21 Jianghao Su , Xia Zeng , Luhui Liu , Chao Luo , Ye Chen , Zhuoran Zhuang

Group Relative Policy Optimization (GRPO) has emerged as a promising approach for improving the reasoning capabilities of large language models. However, it struggles to effectively balance the tradeoff between exploration and exploitation…

计算与语言 · 计算机科学 2026-05-13 Cheng Wang , Qin Liu , Wenxuan Zhou , Muhao Chen

Non-autoregressive generative transformers recently demonstrated impressive image generation performance, and orders of magnitude faster sampling than their autoregressive counterparts. However, optimal parallel sampling from the true joint…

计算机视觉与模式识别 · 计算机科学 2022-09-12 José Lezama , Huiwen Chang , Lu Jiang , Irfan Essa

Reinforcement learning with verifiable rewards (RLVR) has demonstrated superior performance in enhancing the reasoning capability of large language models (LLMs). However, this accuracy-oriented learning paradigm often suffers from entropy…

人工智能 · 计算机科学 2026-01-19 Hongye Cao , Zhixin Bai , Ziyue Peng , Boyan Wang , Tianpei Yang , Jing Huo , Yuyao Zhang , Yang Gao

Reinforcement Learning with Verifiable Rewards (RLVR) has become a central post-training paradigm for improving the reasoning capabilities of large language models. Yet existing methods share a common blind spot: they optimize policies…

机器学习 · 计算机科学 2026-04-29 Huaiyang Wang , Xiaojie Li , Deqing Wang , Haoyi Zhou , Zixuan Huang , Yaodong Yang , Jianxin Li , Yikun Ban

Despite rapid advances in text-to-image generation, faithfully realizing user intent remains challenging, often requiring manual multi-turn trial and error. To automate this process, existing systems rely on either simple prompt rewriting…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Jinming Liu , Ruoyu Feng , Yuqi Wang , Wenjun Zeng , Xin Jin

Reinforcement Learning with Verifiable Rewards (RLVR) is a promising paradigm for enhancing the reasoning ability in Large Language Models (LLMs). However, prevailing methods primarily rely on self-exploration or a single off-policy teacher…

计算与语言 · 计算机科学 2025-10-10 Xiaoyang Yuan , Yujuan Ding , Yi Bin , Wenqi Shao , Jinyu Cai , Jingkuan Song , Yang Yang , Heng Tao Shen

Automating clinical documentation with large language models requires precise alignment with priorities such as completeness and factual grounding. We present an evaluation-integrated reinforcement learning framework for long-form clinical…

计算与语言 · 计算机科学 2025-10-06 Samyak Jhaveri , Praphul Singh , Jangwon Kim , Tara Taghavi , Krishnaram Kenthapadi

Safe reinforcement learning (RL) focuses on training reward-maximizing agents subject to pre-defined safety constraints. Yet, learning versatile safe policies that can adapt to varying safety constraint requirements during deployment…

机器学习 · 计算机科学 2024-05-01 Yihang Yao , Zuxin Liu , Zhepeng Cen , Jiacheng Zhu , Wenhao Yu , Tingnan Zhang , Ding Zhao

Employing LLMs for visual generation has recently become a research focus. However, the existing methods primarily transfer the LLM architecture to visual generation but rarely investigate the fundamental differences between language and…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Teng Hu , Jiangning Zhang , Ran Yi , Jieyu Weng , Yabiao Wang , Xianfang Zeng , Zhucun Xue , Lizhuang Ma

Reinforcement Learning with Verifiable Rewards (RLVR), primarily driven by the Group Relative Policy Optimization (GRPO) algorithm, is a leading approach for enhancing the reasoning abilities of Large Language Models (LLMs). Despite its…

机器学习 · 计算机科学 2025-10-21 Kangqi Ni , Zhen Tan , Zijie Liu , Pingzhi Li , Tianlong Chen

Recent advancements in Multimodal Large Language Models (MLLMs) have incentivized models to ``think with images'' by actively invoking visual tools during multi-turn reasoning. The common Reinforcement Learning (RL) practice of relying on…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuchen Zhou , Xiaobo Xia , Yuanyu Wan , Lijun Zhang , Tat-Seng Chua

Group Relative Policy Optimization (GRPO) significantly enhances the reasoning performance of Large Language Models (LLMs). However, this success heavily relies on expensive external verifiers or human rules. Such dependency not only leads…

计算与语言 · 计算机科学 2026-03-03 Nonghai Zhang , Weitao Ma , Zhanyu Ma , Jun Xu , Jiuchong Gao , Jinghua Hao , Renqing He , Jingwen Xu

Vision Transformers (ViTs) have computational costs scaling quadratically with the number of tokens, calling for effective token pruning policies. Most existing policies are handcrafted, lacking adaptivity to varying inputs. Moreover, they…

计算机视觉与模式识别 · 计算机科学 2025-04-01 Chenglong Lu , Shen Liang , Xuewei Wang , Wei Wang

Visuomotor policies often suffer from perceptual challenges, where visual differences between training and evaluation environments degrade policy performance. Policies relying on state estimations, like 6D pose, require task-specific…

机器人学 · 计算机科学 2025-10-07 Yunchu Zhang , Shubham Mittal , Zhengyu Zhang , Liyiming Ke , Siddhartha Srinivasa , Abhishek Gupta

Autoregressive models, built based on the Next Token Prediction (NTP) paradigm, show great potential in developing a unified framework that integrates both language and vision tasks. Pioneering works introduce NTP to autoregressive visual…

计算机视觉与模式识别 · 计算机科学 2025-03-20 Yatian Pang , Peng Jin , Shuo Yang , Bin Lin , Bin Zhu , Zhenyu Tang , Liuhan Chen , Francis E. H. Tay , Ser-Nam Lim , Harry Yang , Li Yuan

Large reasoning models (LRMs) are typically trained using reinforcement learning with verifiable reward (RLVR) to enhance their reasoning abilities. In this paradigm, policies are updated using both positive and negative self-generated…

计算与语言 · 计算机科学 2025-12-29 Xinyu Tang , Yuliang Zhan , Zhixun Li , Wayne Xin Zhao , Zhenduo Zhang , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Autoregressive (AR) models, long dominant in language generation, are increasingly applied to image synthesis but are often considered less competitive than Diffusion-based models. A primary limitation is the substantial number of image…

Generative design refers to computational design methods that can automatically conduct design exploration under constraints defined by designers. Among many approaches, topology optimization-based generative designs aim to explore diverse…

计算机视觉与模式识别 · 计算机科学 2022-10-04 Seowoo Jang , Soyoung Yoo , Namwoo Kang

Group Relative Policy Optimization (GRPO) enables stable and preference-oriented updates via group-wise comparisons for post-training video generation. However, GRPO directly optimizes reward-induced advantages. Under sustained…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Rui Li , Yuanzhi Liang , Ziqi Ni , Haibing Huang , Chi Zhang , Xuelong Li