English
Related papers

Related papers: ReCast: Recasting Learning Signals for Reinforceme…

200 papers

Visual Reinforcement Learning (RL) agents must learn to act based on high-dimensional image data where only a small fraction of the pixels is task-relevant. This forces agents to waste exploration and computational resources on irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Andrew Lee , Ian Chuang , Dechen Gao , Kai Fukazawa , Iman Soltani

Multilingual retrieval-augmented generation (MRAG) requires models to effectively acquire and integrate beneficial external knowledge from multilingual collections. However, most existing studies employ a unitive process where queries of…

Computation and Language · Computer Science 2026-04-23 Rui Qi , Fengran Mo , Yufeng Chen , Xue Zhang , Shuo Wang , Hongliang Li , Jinan Xu , Meng Jiang , Jian-Yun Nie , Kaiyu Huang

Text-based interactive recommendation provides richer user feedback and has demonstrated advantages over traditional interactive recommender systems. However, recommendations can easily violate preferences of users from their past…

Computation and Language · Computer Science 2020-05-05 Ruiyi Zhang , Tong Yu , Yilin Shen , Hongxia Jin , Changyou Chen , Lawrence Carin

Reinforcement learning (RL) effectively optimizes Large Language Model (LLM)-based recommenders by contrasting positive and negative items. Empirically, training with beam-search negatives consistently outperforms random negatives, yet the…

Information Retrieval · Computer Science 2026-04-27 Wentao Shi , Qifan Wang , Chen Chen , Fei Liu , Dongfang Liu , Xu Liu , Wanli Ma , Junfeng Pan , Linhong Zhu , Fuli Feng

Controlling the generative model to adapt a new domain with limited samples is a difficult challenge and it is receiving increasing attention. Recently, methods based on meta-learning have shown promising results for few-shot domain…

Computation and Language · Computer Science 2023-09-07 Pengsen Cheng , Jinqiao Dai , Jiamiao Liu , Jiayong Liu , Peng Jia

Reinforcement learning (RL) has become a key driver of progress in large language models, but scaling RL to long chain-of-thought (CoT) trajectories is increasingly constrained by backpropagation over every generated token. Even with…

Machine Learning · Computer Science 2026-03-10 Hejian Sang , Yuanda Xu , Zhengze Zhou , Ran He , Zhipeng Wang

Recent reinforcement learning (RL) approaches have advanced radiology report generation (RRG), yet two core limitations persist: (1) report-level rewards offer limited evidence-grounded guidance for clinical faithfulness; and (2) current…

Machine Learning · Computer Science 2026-04-16 Qin Zhou , Guoyan Liang , Qianyi Yang , Jingyuan Chen , Sai Wu , Chang Yao , Zhe Wang

Reinforcement learning post-training has substantially improved the reasoning accuracy of vision-language models, yet the resulting policies remain poorly calibrated. Terminal correctness rewards provide no gradient that penalizes confident…

Machine Learning · Computer Science 2026-05-19 Peng Cui , Boyao Yang , Jun Zhu

Meta-reinforcement learning (meta-RL) acquires meta-policies that show good performance for tasks in a wide task distribution. However, conventional meta-RL, which learns meta-policies by randomly sampling tasks, has been reported to show…

Machine Learning · Computer Science 2022-04-01 Morio Matsumoto , Hiroya Matsuba , Toshihiro Kujirai

In real-world applications of reinforcement learning (RL), noise from inherent stochasticity of environments is inevitable. However, current policy evaluation algorithms, which plays a key role in many RL algorithms, are either prone to…

Machine Learning · Computer Science 2019-06-19 Tadashi Kozuno , Dongqi Han , Kenji Doya

Off-policy deep reinforcement learning (RL) typically leverages replay buffers for reusing past experiences during learning. This can help improve sample efficiency when the collected data is informative and aligned with the learning…

Machine Learning · Computer Science 2025-06-17 Jiashun Liu , Johan Obando-Ceron , Pablo Samuel Castro , Aaron Courville , Ling Pan

In multi-stage recommender systems, reranking optimizes overall utility by capturing intra-list contextual dependencies, yet its central challenge lies in exploring optimal sequences within an exponentially large permutation space. Recent…

Information Retrieval · Computer Science 2026-05-26 Chaotian Song , Jingyao Zhang , Chenghao Chen , Zisen Sang , Dehai Zhao , Guodong Cao , Boxi Wu , Deng Cai , Jia Jia

The deep neural network (DNN) has been proven effective in various domains. However, they often struggle to perform well on certain minority groups during inference, despite showing strong performance on the majority of data groups. This is…

Machine Learning · Computer Science 2023-12-11 Jiaxu Zhao , Lu Yin , Shiwei Liu , Meng Fang , Mykola Pechenizkiy

Retrieval-Augmented Generation (RAG) systems remain brittle under realistic retrieval noise, even when the required evidence appears in the top-K results. A key reason is that retrievers and rerankers optimize solely for relevance, often…

With the rise of LLMs, there is an increasing need for intelligent recommendation assistants that can handle complex queries and provide personalized, reasoning-driven recommendations. LLM-based recommenders show potential but face…

Information Retrieval · Computer Science 2026-04-10 Jiani Huang , Shijie Wang , Liangbo Ning , Wenqi Fan , Qing Li

Reinforcement learning (RL) has become essential for unlocking advanced reasoning capabilities in large language models (LLMs). RL workflows involve interleaving rollout and training stages with fundamentally different resource…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-04-09 Yongji Wu , Xueshen Liu , Haizhong Zheng , Juncheng Gu , Beidi Chen , Z. Morley Mao , Arvind Krishnamurthy , Ion Stoica

Learning in the combinatorially large output space of sequence generation problems is challenging as providing expert demonstrations scales poorly with sequence length, and RL struggles with sparse rewards. Between dense demonstrations in…

In sequential decision-making problems, Return-Conditioned Supervised Learning (RCSL) has gained increasing recognition for its simplicity and stability in modern decision-making tasks. Unlike traditional offline reinforcement learning (RL)…

Machine Learning · Computer Science 2025-06-11 Zhishuai Liu , Yu Yang , Ruhan Wang , Pan Xu , Dongruo Zhou

Episodic training, where an agent's environment is reset after every success or failure, is the de facto standard when training embodied reinforcement learning (RL) agents. The underlying assumption that the environment can be easily reset…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Zichen Zhang , Luca Weihs

Reinforcement learning (RL) has been widely used in text generation to alleviate the exposure bias issue or to utilize non-parallel datasets. The reward function plays an important role in making RL training successful. However, previous…

Machine Learning · Computer Science 2023-01-19 Yongchang Hao , Yuxin Liu , Lili Mou