中文
相关论文

相关论文: Regulating Anatomy-Aware Rewards via Trajectory-In…

200 篇论文

Vision-Language Foundation Models (VLFM) have shown a tremendous increase in performance in terms of generating high-resolution, photorealistic natural images. While VLFMs show a rich understanding of semantic content across modalities,…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Parham Saremi , Amar Kumar , Mohamed Mohamed , Zahra TehraniNasab , Tal Arbel

Reinforcement learning methods such as GRPO have seen great popularity in LLM post-training. In GRPO, models produce completions to a set of prompts, which are rewarded, and the policy is updated towards the relatively high reward…

机器学习 · 计算机科学 2026-05-22 Nikolay Blagoev , Oğuzhan Ersoy , Wendelin Boehmer , Lydia Yiyu Chen

Fine-grained Vision-Language Pre-training (FVLP) demonstrates significant potential in 3D medical image understanding by aligning anatomy-level visual representations with corresponding textual descriptions. However, existing FVLP paradigms…

计算机视觉与模式识别 · 计算机科学 2026-05-14 Hanwen Zhang , Yao Liu , Die Dai , Jiaye Yang , Qiao Liu , Yutong Xie , Peng Wang

Group Relative Policy Optimization (GRPO), a prominent algorithm within the Reinforcement Learning from Verifiable Rewards (RLVR) framework, has achieved strong results in improving the reasoning capabilities of large language models…

机器学习 · 计算机科学 2026-05-21 Xixiang He , Qiyao Sun , Ao Cheng , Xingming Li , Xuanyu Ji , Hailun Lu , Runke Huang , Qingyong Hu

Recent advances in medical large language models have explored Test-Time Reinforcement Learning (TTRL) to enhance reasoning. However, standard TTRL often relies on majority voting (MV) as a heuristic supervision signal, which can be…

机器学习 · 计算机科学 2026-03-11 Kailong Fan , Anqi Pu , Yichen Wu , Wanhua Li , Yicong Li , Hanspeter Pfister , Huafeng Liu , Xiang Li , Quanzheng Li , Ning Guo

Current post-training methodologies for adapting Large Vision-Language Models (LVLMs) generally fall into two paradigms: Supervised Fine-Tuning (SFT) and Reinforcement Learning (RL). Despite their prevalence, both approaches suffer from…

机器学习 · 计算机科学 2026-04-21 Yuming Yan , Kai Tang , Sihong Chen , Ke Xu , Dan Hu , Qun Yu , Pengfei Hu

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for facilitating the self-improvement of large language models (LLMs), particularly in the domain of complex reasoning tasks. However,…

机器学习 · 计算机科学 2025-07-17 Ziru Liu , Cheng Gong , Xinyu Fu , Yaofang Liu , Ran Chen , Shoubo Hu , Suiyun Zhang , Rui Liu , Qingfu Zhang , Dandan Tu

The success of Direct Preference Optimization (DPO) in mitigating hallucinations in Vision Language Models (VLMs) critically hinges on the true reward gaps within preference pairs. However, current methods, typically relying on ranking or…

计算与语言 · 计算机科学 2025-11-25 Lehan He , Zeren Chen , Zhelun Shi , Tianyu Yu , Jing Shao , Lu Sheng

Reinforcement Learning with Verifiable Rewards (RLVR) has improved the reasoning abilities of Large Language Models (LLMs) by using rule-based binary feedback. However, current RLVR methods typically assign the same reward to every token.…

机器学习 · 计算机科学 2025-10-21 Guofu Xie , Yunsheng Shi , Hongtao Tian , Ting Yao , Xiao Zhang

Current Text-to-SQL methods are evaluated and only focused on executable queries, overlooking the semantic alignment challenge -- both in terms of the semantic meaning of the query and the correctness of the execution results. Even…

计算与语言 · 计算机科学 2025-11-24 Ashish Kattamuri , Ishita Prasad , Meetu Malhotra , Arpita Vats , Rahul Raja , Albert Lie

Reinforcement Learning with Verifiable Rewards has recently advanced the capabilities of Large Language Models in complex reasoning tasks by providing explicit rule-based supervision. Among RLVR methods, GRPO and its variants have achieved…

机器学习 · 计算机科学 2026-03-11 Zepeng Zhai , Meilin Chen , Jiaxuan Zhao , Junlang Qian , Lei Shen , Yuan Lu

Subject-driven image generation models face a fundamental trade-off between identity preservation (fidelity) and prompt adherence (editability). While online reinforcement learning (RL), specifically GPRO, offers a promising solution, we…

机器学习 · 计算机科学 2026-04-23 Ziwei Huang , Ying Shu , Hao Fang , Quanyu Long , Wenya Wang , Qiushi Guo , Tiezheng Ge , Leilei Gan

Visual generation is dominated by three paradigms: AutoRegressive (AR), diffusion, and Visual AutoRegressive (VAR) models. Unlike AR and diffusion, VARs operate on heterogeneous input structures across their generation steps, which creates…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Shikun Sun , Liao Qu , Huichao Zhang , Yiheng Liu , Yangyang Song , Xian Li , Xu Wang , Yi Jiang , Daniel K. Du , Xinglong Wu , Jia Jia

Vision Language Models (VLMs) have rapidly advanced and show strong promise for text-based person search (TBPS), a task that requires capturing fine-grained relationships between images and text to distinguish individuals. Previous methods…

计算机视觉与模式识别 · 计算机科学 2026-01-06 Tien-Huy Nguyen , Huu-Loc Tran , Thanh Duc Ngo

Reinforcement fine-tuning with verifiable rewards (RLVR) has emerged as a powerful paradigm for equipping large vision-language models (LVLMs) with agentic capabilities such as tool use and multi-step reasoning. Despite striking empirical…

机器学习 · 计算机科学 2026-04-23 Carter Adams , Rafael Oliveira , Gabriel Almeida , Sofia Torres

Long Chain-of-Thought (LCoT), achieved by Reinforcement Learning with Verifiable Rewards (RLVR), has proven effective in enhancing the reasoning capabilities of Large Language Models (LLMs). However, reasoning in current LLMs is primarily…

Despite Multimodal Large Language Models (MLLMs) having shown impressive capabilities, they may suffer from hallucinations. Empirically, we find that MLLMs attend disproportionately to task-irrelevant background regions compared with…

计算与语言 · 计算机科学 2025-12-01 Peizheng Guo , Jingyao Wang , Wenwen Qiang , Jiahuan Zhou , Changwen Zheng , Gang Hua

Reasoning capabilities are crucial for reliable medical visual question answering (VQA); however, existing datasets rarely include reasoning explanations. We address this by generating reasoning trajectories for six medical VQA benchmarks…

机器学习 · 计算机科学 2026-05-07 Halil Ibrahim Gulluk , Olivier Gevaert

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Recently, reinforcement learning (RL)-based tuning has shifted the trajectory of Multimodal Large Language Models (MLLMs), particularly following the introduction of Group Relative Policy Optimization (GRPO). However, directly applying it…

计算与语言 · 计算机科学 2025-05-21 Wenhui Zhu , Xuanzhao Dong , Xin Li , Peijie Qiu , Xiwen Chen , Abolfazl Razi , Aris Sotiras , Yi Su , Yalin Wang