中文
相关论文

相关论文: TeViR: Text-to-Video Reward with Diffusion Models …

200 篇论文

Reinforcement learning with verifiable rewards (RLVR) scales the reasoning ability of large language models (LLMs) but remains bottlenecked by limited labeled samples for continued data scaling. Reinforcement learning with intrinsic rewards…

机器学习 · 计算机科学 2025-10-13 Chuyi Tan , Peiwen Yuan , Xinglin Wang , Yiwei Li , Shaoxiong Feng , Yueqi Zhang , Jiayi Shi , Ji Zhang , Boyuan Pan , Yao Hu , Kan Li

Reinforcement learning (RL) algorithms allow artificial agents to improve their selection of actions to increase rewarding experiences in their environments. Temporal Difference (TD) Learning -- a model-free RL method -- is a leading…

机器学习 · 计算机科学 2019-09-05 Jacob Rafati , David C. Noelle

In this work, we investigate how to leverage pre-trained visual-language models (VLM) for online Reinforcement Learning (RL). In particular, we focus on sparse reward tasks with pre-defined textual task descriptions. We first identify the…

机器学习 · 计算机科学 2024-06-06 Yuwei Fu , Haichao Zhang , Di Wu , Wei Xu , Benoit Boulet

Vision-language-action (VLA) models have shown strong generalization across tasks and embodiments; however, their reliance on large-scale human demonstrations limits their scalability owing to the cost and effort of manual data collection.…

机器人学 · 计算机科学 2025-09-30 Rushuai Yang , Hangxing Wei , Ran Zhang , Zhiyuan Feng , Xiaoyu Chen , Tong Li , Chuheng Zhang , Li Zhao , Jiang Bian , Xiu Su , Yi Chen

While Reinforcement Learning with Verifiable Rewards (RLVR) is effective for deterministically checkable tasks, many vision-language tasks are partially verifiable, demanding multi-criteria supervision (e.g., perceptual details, reasoning…

Recent advances in text-conditioned image generation diffusion models have begun paving the way for new opportunities in modern medical domain, in particular, generating Chest X-rays (CXRs) from diagnostic reports. Nonetheless, to further…

计算机视觉与模式识别 · 计算机科学 2024-03-12 Woojung Han , Chanyoung Kim , Dayun Ju , Yumin Shim , Seong Jae Hwang

We have made significant progress towards building foundational video diffusion models. As these models are trained using large-scale unsupervised data, it has become crucial to adapt these models to specific downstream tasks. Adapting…

计算机视觉与模式识别 · 计算机科学 2024-07-12 Mihir Prabhudesai , Russell Mendonca , Zheyang Qin , Katerina Fragkiadaki , Deepak Pathak

This paper presents a novel approach for unsupervised video summarization using reinforcement learning (RL), addressing limitations like unstable adversarial training and reliance on heuristic-based reward functions. The method operates on…

多媒体 · 计算机科学 2025-12-24 Mehryar Abbasi , Hadi Hadizadeh , Parvaneh Saeedi

In offline reinforcement learning (RL), learning from fixed datasets presents a promising solution for domains where real-time interaction with the environment is expensive or risky. However, designing dense reward signals for offline…

机器学习 · 计算机科学 2025-04-15 Younghwan Lee , Tung M. Luu , Donghoon Lee , Chang D. Yoo

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) have demonstrated significant potential in single-turn reasoning tasks. With the paradigm shift toward self-evolving agentic learning, models are increasingly expected…

人工智能 · 计算机科学 2026-04-21 Xinshun Feng , Xinhao Song , Lijun Li , Gongshen Liu , Jing Shao

Reinforcement learning (RL) is a powerful approach to enhance task-oriented dialogue (TOD) systems. However, existing RL methods tend to mainly focus on generation tasks, such as dialogue policy learning (DPL) or response generation (RG),…

人工智能 · 计算机科学 2024-06-21 Huifang Du , Shuqin Li , Minghao Wu , Xuejing Feng , Yuan-Fang Li , Haofen Wang

While Vision-Language-Action (VLA) models have seen rapid progress in pretraining, their advancement in Reinforcement Learning (RL) remains hampered by low sample efficiency and sparse rewards in real-world settings. Developing…

Reinforcement Learning with Verifiable Rewards (RLVR) is a promising approach for enhancing agentic deep search. However, its application is often hindered by low \textbf{Reward Density} in deep search scenarios, where agents expend…

计算与语言 · 计算机科学 2025-10-31 Kun Luo , Hongjin Qian , Zheng Liu , Ziyi Xia , Shitao Xiao , Siqi Bao , Jun Zhao , Kang Liu

Learning behavior in legged robots presents a significant challenge due to its inherent instability and complex constraints. Recent research has proposed the use of a large language model (LLM) to generate reward functions in reinforcement…

机器人学 · 计算机科学 2025-07-01 Runhao Zeng , Dingjie Zhou , Qiwei Liang , Junlin Liu , Hui Li , Changxin Huang , Jianqiang Li , Xiping Hu , Fuchun Sun

Reward engineering, the manual specification of reward functions to induce desired agent behavior, remains a fundamental challenge in multi-agent reinforcement learning. This difficulty is amplified by credit assignment ambiguity,…

人工智能 · 计算机科学 2026-01-14 Haoran Su , Yandong Sun , Congjia Yu

Reinforcement Learning from Verifiable Rewards (RLVR) has substantially enhanced the reasoning capabilities of large language models in abstract reasoning tasks. However, its application to Large Vision-Language Models (LVLMs) remains…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Yuhang Han , Yuyang Wu , Zhengbo Jiao , Yiyu Wang , Xuyang Liu , Shaobo Wang , Hanlin Xu , Xuming Hu , Linfeng Zhang

Large vision-language models (LVLMs) perform outstandingly across various multimodal tasks. However, their ability to evaluate generated content remains limited, and training vision-language reward models (VLRMs) with preference data is…

计算与语言 · 计算机科学 2025-05-23 Chen-An Li , Tzu-Han Lin , Yun-Nung Chen , Hung-yi Lee

Deep reinforcement learning has proven remarkably useful in training agents from unstructured data. However, the opacity of the produced agents makes it difficult to ensure that they adhere to various requirements posed by human engineers.…

机器学习 · 计算机科学 2022-02-10 Raz Yerushalmi , Guy Amir , Achiya Elyasaf , David Harel , Guy Katz , Assaf Marron

Video reasoning has advanced with large multimodal models (LMMs), yet their inference is often a single pass that returns an answer without verifying whether the reasoning is evidence-aligned. We introduce Reinforce to Learn, Elect to…

计算机视觉与模式识别 · 计算机科学 2026-04-07 Songyuan Yang , Weijiang Yu , Jilin Ma , Ziyu Liu , Guijian Tang , Wenjing Yang , Huibin Tan , Nong Xiao

Reinforcement learning with verifiable rewards (RLVR) has been shown to enhance the reasoning capabilities of large language models (LLMs), enabling the development of large reasoning models (LRMs). However, LRMs such as DeepSeek-R1 and…

人工智能 · 计算机科学 2025-11-13 Yuhao Wang , Xiaopeng Li , Cheng Gong , Ziru Liu , Suiyun Zhang , Rui Liu , Xiangyu Zhao