中文
相关论文

相关论文: Learning What to Trust: Bayesian Prior-Guided Opti…

200 篇论文

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

计算机视觉与模式识别 · 计算机科学 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Group Relative Policy Optimization (GRPO) has emerged as an effective method for training reasoning models. While it computes advantages based on group mean, GRPO treats each output as an independent sample during the optimization and…

人工智能 · 计算机科学 2026-03-16 Yu Li , Tian Lan , Zhengling Qi

Group Relative Policy Optimization (GRPO) enables stable and preference-oriented updates via group-wise comparisons for post-training video generation. However, GRPO directly optimizes reward-induced advantages. Under sustained…

计算机视觉与模式识别 · 计算机科学 2026-03-18 Rui Li , Yuanzhi Liang , Ziqi Ni , Haibing Huang , Chi Zhang , Xuelong Li

Optimizing communication topology is fundamental to the efficiency and effectiveness of Large Language Model (LLM)-based Multi-Agent Systems (MAS). While recent approaches utilize reinforcement learning to dynamically construct…

计算与语言 · 计算机科学 2026-03-04 Yueyang Cang , Xiaoteng Zhang , Erlu Zhao , Zehua Ji , Yuhang Liu , Yuchen He , Zhiyuan Ning , Chen Yijun , Wenge Que , Li Shi

Group Relative Policy Optimization (GRPO) has recently shown strong performance in post-training large language models and vision-language models. It raises a question of whether the GRPO also significantly promotes the test-time adaptation…

计算机视觉与模式识别 · 计算机科学 2026-05-06 Yujun Li , Hongyuan Zhang , Yuan Yuan

Reinforcement learning algorithms such as group-relative policy optimization (GRPO) have shown strong potential for improving the mathematical reasoning capabilities of large language models. While a growing body of work seeks to improve…

机器学习 · 计算机科学 2026-05-12 Wenquan Lu , Hai Huang , Enqi Liu , Randall Balestriero

High-dimensional Bayesian optimization (BO) tasks such as molecular design often require 10,000 function evaluations before obtaining meaningful results. While methods like sparse variational Gaussian processes (SVGPs) reduce computational…

机器学习 · 计算机科学 2025-06-11 Natalie Maus , Kyurae Kim , Geoff Pleiss , David Eriksson , John P. Cunningham , Jacob R. Gardner

Large-scale flow matching models have achieved strong performance across generative tasks such as text-to-image, video, 3D, and speech synthesis. However, aligning their outputs with human preferences and task-specific objectives remains…

机器学习 · 计算机科学 2026-03-10 Zexiang Liu , Xianglong He , Yangguang Li

Bayesian optimization (BO) iteratively fits a Gaussian process (GP) surrogate to accumulated evaluations and selects new queries via an acquisition function such as expected improvement (EI). In practice, BO often concentrates evaluations…

统计方法学 · 统计学 2026-01-13 Jiguang Li , Hengrui Luo

Text-to-Image (T2I) generation has achieved remarkable progress in recent years. Meanwhile, reinforcement learning methods, particularly those based on Group Relative Policy Optimization (GRPO), have attracted widespread attention and been…

计算机视觉与模式识别 · 计算机科学 2026-05-19 Baoteng Li , Xianghao Zang , Xinran Wang , Xiangyu Na , Zhixiang He , Hao Sun , Chi Zhang , Zhongjiang He , Tianwei Cao , Kongming Liang , Zhanyu Ma

As language models become increasingly capable, users expect them to provide not only accurate responses but also behaviors aligned with diverse human preferences across a variety of scenarios. To achieve this, Reinforcement learning (RL)…

Group Relative Policy Optimization (GRPO) has proven to be an effective tool for post-training language models (LMs). However, AI systems are increasingly expressed as modular programs that mix together multiple LM calls with distinct…

Reinforcement learning from verifiable rewards has significantly advanced the reasoning capabilities of large language models. However, Group Relative Policy Optimization (GRPO) typically assigns a uniform, sequence-level advantage to all…

机器学习 · 计算机科学 2026-04-06 Song Yu , Li Li , Wenwen Zhao , Zhisheng Yang

Many strong decoding methods for text generation follow a sample-and-rerank paradigm: they draw multiple candidates, score each under a utility (reward) function using consensus across samples, and return the best one. Although effective,…

机器学习 · 计算机科学 2026-02-04 Yuki Ichihara , Yuu Jinnai , Kaito Ariu , Eiji Uchibe

Recently, GRPO-based reinforcement learning has shown remarkable progress in optimizing flow-matching models, effectively improving their alignment with task-specific rewards. Within these frameworks, the policy update relies on…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Jing Wang , Jiajun Liang , Jie Liu , Henglin Liu , Gongye Liu , Jun Zheng , Wanyuan Pang , Ao Ma , Zhenyu Xie , Xintao Wang , Meng Wang , Pengfei Wan , Xiaodan Liang

Group Relative Policy Optimization (GRPO) has emerged as a powerful framework for preference alignment in text-to-image (T2I) flow models. However, we observe that the standard paradigm where evaluating a group of generated samples against…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Jiazi Bu , Pengyang Ling , Yujie Zhou , Yibin Wang , Yuhang Zang , Tianyi Wei , Xiaohang Zhan , Jiaqi Wang , Tong Wu , Xingang Pan , Dahua Lin

Reinforcement learning (RL) has proven effective in strengthening the reasoning capabilities of large language models (LLMs). A widely adopted method, Group Relative Policy Optimization (GRPO), has shown strong empirical results in training…

机器学习 · 计算机科学 2026-03-11 Peter Chen , Xiaopeng Li , Ziniu Li , Xi Chen , Tianyi Lin

Group Relative Policy Optimization (GRPO), which is widely adopted by R1-like reasoning models, has advanced mathematical reasoning. Nevertheless, GRPO faces challenges in reward sparsity, verbosity, and inadequate focus on problem…

计算与语言 · 计算机科学 2025-09-23 Jixiao Zhang , Chunsheng Zuo

Segmentation is a fundamental task in computer vision, underpinning pixel-level scene understanding and serving as a cornerstone for applications ranging from autonomous perception to medical image analysis. For complex referring…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Mario Markov , Stefan Maria Ailuro , Mohammad Mahdi , Luc Van Gool , Danda Pani Paudel

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

计算机视觉与模式识别 · 计算机科学 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu